Oracle X7-8 Service Manual Download Page 299

Page: 299 / 308

System Indicators Network Access Control (NAC) Names

Name (1x8)

Name (2x4-A Side)

Name (2x4-B

Side)

Description

Rear FRU have a fault. Off: Rear

FRUs have no fault.

/SYS/SMOD0/MB/SP/OK

(A-Side; B-side disabled)

/SYS/SMOD0/MB/SP/OK

/SYS/SMOD1/

MB/SP/OK

SP OK Color: Green Location:

FIM Front Panel and SMOD

rear panel On: SP is normal. Fast

Blink: SP is booting. Off: SP has

no power.

/SYS/CMOD[0-7]/SERVICE /SYS/CMOD[0-3]/

SERVICE

/SYS/

CMOD[4-7]/

SERVICE

CMOD Service Color: Amber

Location: FIM Front Panel On:

CMOD has fault. Off: CMOD

has no fault.

/SYS/CMOD[0-7]/P[0-7]/

SERVICE

IPMI short name: CMODx/P

[0-7]/SVC

/SYS/CMOD[0-3]/P[0-3]/

SERVICE

IPMI short name: CMODx/

P[0-3]/SVC

/SYS/

CMOD[4-7]/

P[4-7]/SERVICE

IPMI short name:

CMODx/P[0-3]/

SVC

Processor Service Color:

Amber Location: CMOD board.

On: Processor has fault. Off:

Processor has no fault.

/SYS/CMOD[0-7]/P[0-7]/

D[0-11]/SERVICE IPMI

short name: CMODx/P[0-7]/

Dxx/SVC

/SYS/CMOD[0-3]/P[0-3]/

D[0-11]/SERVICE IPMI

short name: CMODx/

P[0-3]/Dxx/SVC

/SYS/

CMOD[4-7]/

P[4-7]/D[0-11]/

SERVICE IPMI

short name:

CMODx/P[4-7]/

Dxx/SVC

Memory Service Color: Amber

Location: CMOD board. On:

DIMM has fault. Off: DIMM has

no fault.

/SYS/SMOD[0-1]/SERVICE

/SYS/SMOD0/SERVICE

/SYS/SMOD1/

SERVICE

SMOD Fault Color: Amber

Location: SMOD Back Panel

On: SMOD has fault. Off:

SMOD has no fault.

/SYS/SMOD[0-1]/OK

/SYS/SMOD0/OK

/SYS/SMOD1/OK SMOD OK Color: Green

Location: SMOD Back Panel

On: SMOD is functional. Off:

SMOD not working or not

active. In 1x8 mode, SMOD1

OK LED will be off.

/SYS/SMOD[0-1]/HBA/

SERVICE

/SYS/SMOD0/HBA/

SERVICE

/SYS/SMOD1/

HBA/SERVICE

HBA Fault Color: Amber

Location: SMOD Back Panel

On: HBA has fault. Off: HBA

has no fault.

/SYS/DPCC[0-7]/

PCIE[1-16]/OK

/SYS/DPCC[0-3]/

PCIE[1-8]/OK

/SYS/DPCC[4-7]/

PCIE[9-16]/OK

PCIe OK Color: Green Location:

DPCC PCIe On: PCIe is in use.

Blink: PCIe is in transition.

Off: Ready to be removed

(conditional).

/SYS/DPCC[0-7]/

PCIE[1-16]/SERVICE

/SYS/DPCC[0-3]/

PCIE[1-8]/SERVICE

/SYS/DPCC[4-7]/

PCIE[9-16]/

SERVICE

PCIe Service Color: Amber

Location: DPCC PCIe On: PCIe

has fault. Off: PCIe has no fault.

Fast Blink: Locate

Monitoring and Identifying Server Components

299

Summary of Contents for X7-8

Page 1: ...Oracle Server X7 8 Service Manual Part No E71936 01 October 2017 ...

Page 2: ......

Page 3: ...ation management applications It is not developed or intended for use in any inherently dangerous applications including applications that may create a risk of personal injury If you use this software or hardware in dangerous applications then you shall be responsible to take all appropriate fail safe backup redundancy and other measures to ensure its safe use Oracle Corporation and its affiliates...

Page 4: ...des informations Ce logiciel ou matériel n est pas conçu ni n est destiné à être utilisé dans des applications à risque notamment dans des applications pouvant causer un risque de dommages corporels Si vous utilisez ce logiciel ou ce matériel dans le cadre d applications dangereuses il est de votre responsabilité de prendre toutes les mesures de secours de sauvegarde de redondance et autres mesure...

Page 5: ...ation management applications It is not developed or intended for use in any inherently dangerous applications including applications that may create a risk of personal injury If you use this software or hardware in dangerous applications then you shall be responsible to take all appropriate fail safe backup redundancy and other measures to ensure its safe use Oracle Corporation and its affiliates...

Page 6: ...des informations Ce logiciel ou matériel n est pas conçu ni n est destiné à être utilisé dans des applications à risque notamment dans des applications pouvant causer un risque de dommages corporels Si vous utilisez ce logiciel ou ce matériel dans le cadre d applications dangereuses il est de votre responsabilité de prendre toutes les mesures de secours de sauvegarde de redondance et autres mesure...

Page 7: ...ts Breakdown 24 Component Serviceability Requirements 26 Customer Replaceable Units 26 Field Replaceable Units 27 CPU Module CMOD Overview 28 CMOD Components 29 CMOD Processor 30 CMOD Memory 31 CMOD and Fan Module Power 33 System Module SMOD Overview 34 SMOD Components 36 SMOD Motherboard 38 Server Storage Drives 39 Server Chassis Overview 40 Troubleshooting and Diagnostics 47 Detecting and Managi...

Page 8: ...5 Storage Drive Indicators 69 Dual PCIe Card Carrier DPCC Indicators 70 AC Power Block Inlet Indicators 71 About Controls and Connectors 72 Status Indicator Blink Rates 77 Troubleshooting Server Subsystems 81 Processor Subsystem 82 Memory Subsystem 83 Power Subsystem 83 Cooling Subsystem 84 Storage Subsystem 86 Networking Subsystem 87 PCI Devices Subsystem 88 Attaching Devices to the Server 89 Att...

Page 9: ...OM Web Interface 110 Powering Down the Server 111 Power Down the Server Gracefully Oracle ILOM CLI 112 Power Down the Server Gracefully Oracle ILOM Web Interface 113 Power Down the Server Gracefully 114 Power Down the Server for Immediate Shutdown Oracle ILOM CLI 115 Power Down the Server for Immediate Shutdown Oracle ILOM Web Interface 116 Power Down the Server for Immediate Shutdown 116 Power Of...

Page 10: ... 149 Remove a DPCC 151 Remove a PCIe Card 153 Install a PCIe Card 155 Install a DPCC 158 Servicing CPU Module CMOD Components FRU 160 CMOD Slot Locations and Numbering 160 CMOD Population Rules 161 Remove a CMOD 162 Remove the CMOD Cover 164 Install the CMOD Cover 166 Install a CMOD 167 Servicing Processors 170 Servicing DIMMs 182 DIMM and Processor Physical Layout 183 DIMM Population Scenarios 18...

Page 11: ...Server to Operation 237 Prepare the Server for Operation 237 Power On the Server 238 Setting Up BIOS Configuration Parameters 239 Manage the BIOS Configuration 239 Accessing the BIOS Setup Utility 239 BIOS Setup Utility Menus 240 BIOS Key Mappings 240 Access BIOS Setup Utility Menus 241 Navigate BIOS Setup Utility Menus 242 Using UEFI BIOS 244 Configuration Utilities for Add In Cards 244 Configure...

Page 12: ...emory Configuration Options 283 BIOS Advanced Menu CPU Power Management Configuration Options 284 BIOS Advanced Menu USB Ports Options 285 BIOS Advanced Menu Error Injection Settings Option 285 BIOS Advanced Menu Disk Freeze Lock Settings Option 285 BIOS IO Menu Selections 286 BIOS IO Menu PCI Subsystem Settings Options 287 BIOS IO Menu IO Virtualization Options 288 BIOS IO Menu IOAT Configuration...

Page 13: ...Contents Index 303 13 ...

Page 14: ...14 Oracle Server X7 8 Service Manual October 2017 ...

Page 15: ...ted on the hazards within the equipment and are qualified to remove and replace hardware Required knowledge Advanced experience troubleshooting and replacing hardware Product Documentation Library Documentation and resources for this product and related products are available at http www oracle com goto x7 8 docs Feedback Provide feedback about this documentation at http www oracle com goto docfee...

Page 16: ...16 Oracle Server X7 8 Service Manual October 2017 ...

Page 17: ...pdates in Oracle Server X7 8 Installation Guide Product Description Oracle Server X7 8 is an enterprise class 5 rack unit 5U server You can configure the server as one 4 socket server two independent 4 socket servers or one 8 socket server The system supports the following components Feature System Component Processors CPU module CMOD Up to eight Intel Xeon vx processors are supported Intel 8168 p...

Page 18: ... slots I O Ports One external RJ 45 serial management SER MGT port One external network management NET MGT port Four 10GBASE T ports per SMOD NET0 3 Power Supplies PS Four 3000W power supplies PSU0 3 Two PSUs PSU2 and 3 power SMOD0 CMOD0 3 DPCC0 3 and FM0 3 The other two PSUs PSU0 and 1 power SMOD1 CMOD4 7 DPCC4 7 and FM4 7 Fan Modules FM Eight fan modules FM0 7 Service Processor SP Two integrated...

Page 19: ...stallation Guide For component serviceability locations and designations see Identifying Components on page 24 About Controls and Connectors The following sections describe the controls indicators connectors and drives located on the Oracle Server X7 8 front and back panels Front Panel Components on page 19 Back Panel Components on page 21 Front Panel Components The following figure shows the Orac...

Page 20: ... Required LED amber System OK LED indicator green On Standby button recessed SP OK green System Overtemperature Warning LED amber Chassis rear Fault Service Required LED amber Rear Fault Service Required LED amber CMOD Fault Service Required LEDs 0 1 2 3 amber SMOD1 System B controls and indicators Locate Button LED white Fault Service Required LED amber Front Indicator Module FIM Panel on page 60...

Page 21: ...ottom row 0 2 4 6 SMOD0 System A FM 0 1 2 3 SMOD1 System B FM 4 5 6 7 Troubleshooting System Cooling Issues on page 55 Cooling Subsystem on page 84 4 Two fan frames SMOD0 System A FM 0 1 2 3 SMOD1 System B FM 4 5 6 7 Troubleshooting System Cooling Issues on page 55 Cooling Subsystem on page 84 5 Eight internal CPU Modules CMODs CMOD bays are accessible behind the fan frames System A CMODs 0 3 Syst...

Page 22: ...ork management 10 100 1000BASE T port System Module SMOD Overview on page 34 Servicing System Module SMOD Components FRU on page 195 3 SMOD1 System B SER MGT The SMOD1 System B serial management port service processor SER MGT port uses an RJ 45 cable and terminal or emulator to provide access to the Oracle ILOM command line interface CLI System Module SMOD Overview on page 34 Servicing System Modu...

Page 23: ...MOD0 Fault Service Required Amber System A OK Green SP OK Green System Module SMOD Overview on page 34 System Module SMOD Indicators on page 65 Servicing System Module SMOD Components FRU on page 195 9 SMOD0 System A NET MGT Oracle ILOM service processor SP network management 10 100 1000BASE T port System Module SMOD Overview on page 34 Networking Subsystem on page 87 Servicing System Module SMOD ...

Page 24: ...dicators on page 70 15 AC power block AC inputs with cable clips AC 0 through AC 3 SMOD0 System A AC 3 Top AC 2 SMOD1 System B AC 1 AC 0 bottom Chassis Back Panel Components on page 43 Power Subsystem on page 83 AC Power Block Inlet Indicators on page 71 Note The server does not provide video display ports on the SMODs Use Oracle ILOM rKVMS to display video Identifying Components These sections de...

Page 25: ...ge 88 5 PCIe cards PCIe slots 5 6 7 and 8 are nonfunctional in 4 socket systems Servicing PCIe Cards and Carriers CRU on page 148 6 AC power block The AC power block is not a removable component Servicing Power Supplies CRU on page 138 Power Subsystem on page 83 7 Top cover Preparing for Service on page 97 8 Midplane Replace the Midplane Assembly on page 226 9 Processor front panel accessible Serv...

Page 26: ...t service components can be serviced while the server is powered on and running in Main power mode Warm service components can be serviced while the server is in Standby power mode You can remove and replace CMODs DIMMs and processors and heatsinks without disconnecting the back panel power cords or shutting down Oracle ILOM Cold service components must be serviced when the server is completely po...

Page 27: ...Field Replaceable Units on page 27 Illustrated Parts Breakdown on page 24 Field Replaceable Units The following table lists the field replaceable units FRUs in the server and directs you to the replacement instructions FRU Description Replacement Instructions CMOD Cold serviceable or warm serviceable Add or replace CPU module assemblies CMOD0 7 including a processor and memory Servicing CPU Module...

Page 28: ... Front indicator module FIM Contains push button circuitry and LED indicators that are displayed on the chassis bezel Servicing the Front Indicator Module FRU on page 218 Midplane Cold serviceable Internal midplane busbar assembly in the chassis Replace the Midplane Assembly on page 226 Related Information Customer Replaceable Units on page 26 Illustrated Parts Breakdown on page 24 CPU Module CMOD...

Page 29: ...ors CPUs and DIMM memory components Processor Heatsink Module PHM assembly includes heatsink processor TIM carrier CMOD Processor on page 30 12 DIMM slots arranged in two groups of six CMOD Memory on page 31 Fault Remind Test Circuit which helps you locate failed DIMMs and verify a failed CPU Fault Remind button 12 DIMM slot fault indicators 1 CPU fault indicator The following illustration shows C...

Page 30: ...tor For component serviceability locations and designations see Identifying Components on page 24 CMOD Processor Each CMOD contains one Intel Xeon vx processor shelf 4 processor Four CPU modules installed in slots 0 through 3 Eight CPU modules installed in slots 0 through 7 24 cores per socket 224 total The Processor Heatsink Module PHM is a three part module that is installed above the socket ass...

Page 31: ... material TIM part of PHM 2 Carrier part of PHM 3 Processor part of PHM 4 Socket See Servicing Processors on page 170 CMOD Memory The maximum system memory with DDR4 2666 64 GB LRDIMMs is Four CMODs 3 TB with 48x64 GB Eight CMODs 6 TB with 96x64 GB About the Oracle Server X7 8 31 ...

Page 32: ...2 DIMM Banks D E F 3 Channel F Slot 0 DIMM 0 4 Channel F Slot 1 DIMM 1 5 Channel E Slot 0 DIMM 2 6 Channel E Slot 1 DIMM 3 7 Channel D Slot 0 DIMM 4 8 Channel D Slot 1 DIMM 5 9 Channel A Slot 0 DIMM 6 10 Channel A Slot 1 DIMM 7 11 Channel B Slot 0 DIMM 8 12 Channel B Slot 1 DIMM 9 13 Channel C Slot 0 DIMM 10 14 Channel C Slot 1 DIMM 11 32 Oracle Server X7 8 Service Manual October 2017 ...

Page 33: ...n Module Power Fan modules FMs recieve power from CMODs However only CMODs in even numbered slots supply power to fan modules The following table shows which CMOD slots provide FM power Four fan modules per SMOD are front panel accessible About the Oracle Server X7 8 33 ...

Page 34: ...cle Server X7 8 SMOD features are Two SMODs are installed in the chassis SMOD0 and SMOD1 One Intel Xeon C624 Chipset Platform Controller Hub PCH One Internal PCIe slot for RAID storage HBA connectivity to drive bays This PCIe slot is populated by one PCIe Gen3 x8 HBA per SMOD Oracle Storage 12Gb SAS PCIe RAID HBA Internal 16 Port Four ports in the card are used for SAS connectivity One service pro...

Page 35: ...al on each SMOD Four 10GBase T ports per SMOD NET0 3 Four hot swap capable disk drive bays Four SAS3 storage drive bays 0 7 Four drives in each SMOD SMOD0 0 3 and SMOD1 0 3 Drives can be a total of eight 2 5 inch hot swappable SAS3 hard disk drives HDDs or eight 2 5 inch SAS3 solid state drives SSDs Two SMODs are accessible from the back panel of the server The following illustration shows SMODs a...

Page 36: ...verview on page 28 Product Description on page 17 SMOD Components The following illustration shows an SMOD system module and associated components including an Oracle Storage 12Gb SAS PCIe RAID HBA Internal 16 Port card installed below the SMOD two SAS cables that connect the HBA card to the server storage backplanes and a cable that connects the energy storage module to the HBA card 36 Oracle Ser...

Page 37: ... SMOD motherboard 5 Storage Drive SMOD Midplane connectors 4 6 Four server storage drives 0 3 HDD SSD back panel accessible 7 External USB port back panel accessible 8 NET MGT ILOM service processor SP network management 10 100 1000BASE T port Network port back panel accessible 9 Serial management port labeled SER MGT port IO port back panel accessible About the Oracle Server X7 8 37 ...

Page 38: ... replaceable Service processor SP The system Emulex Pilot 4 service processor SP is located on the SMOD motherboard and is accessible locally and remotely through management ports on the front of the SMOD The SP contains Oracle ILOM an embedded server management tool The SP is not removable System real time clock battery 3V Lithium Coin Cell Battery Energy storage module ESM for the server storage...

Page 39: ...s and designations see Identifying Components on page 24 For replacement procedures see Servicing System Module SMOD Components FRU on page 195 Server Storage Drives The following illustration shows the eight storage drive externally accessible back panel bay locations which are arranged in two rows of four per SMOD Call Out Description 1 SMOD0 System A storage drive 0 HDD SSD 2 SMOD0 System A sto...

Page 40: ...verview These sections describe the server chassis and internal components Chassis Features on page 41 Chassis Internal Components on page 41 Chassis Front Panel Components on page 42 Chassis Back Panel Components on page 43 Switches and Buttons Reference on page 45 The server chassis assembly contains front panel back panel and internal accessible components The following figure shows the server ...

Page 41: ...assemblies SMODs Four front loaded hot swap power supply units PSUs in a two per SMOD 1 1 configuration Expandable IO Eight 16 lane and eight 8 lane PCIe Gen3 chassis slots One x8 PCIe Gen 3 HBA SMOD slot Eight rear loaded DPCC slots each DPCC holds one 16 lane PCIe expansion slot and one eight lane PCIe expansion slot Eight hot swap redundant 100 watt cooling fan modules Cooling is front to back ...

Page 42: ...omponents and the front panel components This component requires cold service Replace the Midplane Assembly on page 226 3 CPU module CMOD bays Chassis CMOD bays can support either four or eight CMODs Servicing CMODs requires warm or cold service CPU Module CMOD Overview on page 28 Servicing CPU Module CMOD Components FRU on page 160 Chassis Front Panel Components The following figure shows the ser...

Page 43: ...Power Supply PS Indicators on page 64 3 Fan module FM0 7 8 Servicing Fan Modules CRU and Fan Frames CRU on page 129 and Fan Module FM Indicators on page 63 4 Fan Frame 2 Servicing Fan Modules CRU and Fan Frames CRU on page 129 5 Server chassis The server chassis is not a removable component Server Chassis Overview on page 40 Chassis Back Panel Components The following illustration shows the chassi...

Page 44: ... 34 System Module SMOD Indicators on page 65 3 System Module B SMOD1 SMOD system B internal components can only be accessed by removing the SMOD from the server back panel System Module SMOD Overview on page 34 System Module SMOD Indicators on page 65 4 Dual PCIe card carrier DPCC bay The DPCC bay contains eight DPCCs and up to 16 PCIe cards PCI Devices Subsystem on page 88 Dual PCIe Card Carrier ...

Page 45: ...6 Host Warm Reset Recessed pinhole button located on the server back panel The Host Reset button allows you to perform an immediate reboot of the server activating the button requires the use of a stylus Back Panel Pinhole Switches on page 76 NMI pinhole button Non maskable Interrupt recessed pinhole button located on the server back panel The NMI button is used by Service personnel only Do not pr...

Page 46: ...46 Oracle Server X7 8 Service Manual October 2017 ...

Page 47: ...ttp www oracle com goto x86admindiag docs Detecting and Managing Server Faults When a server encounters a fault the fault is recorded in a common fault database The fault is then reported by the server in one of several ways depending on the type and severity of the fault This section contains maintenance related information and procedures that you can use to troubleshoot and repair server hardwar...

Page 48: ...it immediately To investigate a hardware fault see the following Basic Troubleshooting Process Troubleshoot Hardware Faults Using the Oracle ILOM Web Interface Basic Troubleshooting Steps When a server encounters a fault the fault is recorded in a common fault database The fault is then reported by the server in one of several ways depending on the type and severity of the fault Use the following ...

Page 49: ...le ILOM User s Guide for System Monitoring and Diagnostics Firmware Release 4 0 x in the Oracle Integrated Lights Out Manager ILOM 4 0 Documentation Library at http www oracle com goto ilom docs If you determine that the hardware fault requires service continue 3 Prepare the server for service See Preparing for Service on page 97 You can use Oracle ILOM to power off the server activate the Locate ...

Page 50: ...e ILOM interfaces refer to the Oracle ILOM documentation 1 Obtain the latest version of the Oracle Server X7 8 Product Notes Release 1 0 2 Log in to the server SP Oracle ILOM web interface Open a browser and type in the IP address of the server SP Enter a user name with administrator privileges and password at the log in screen The Summary Information page appears 3 View the Status section of the ...

Page 51: ... require service In the above example the Status table shows that the Memory subsystem requires service This indicates that a hardware component within the subsystem is in a fault state 4 To identify the component click on the subsystem name Troubleshooting and Diagnostics 51 ...

Page 52: ...ronological list of all the system events and faults that have occurred since the log was last reset and includes additional information such as severity levels and error counts To access it click the System Log link In this example the hardware fault with DIMM 8 of CPU 0 requires local physical access to the server 6 Before going to the server review the server Product Notes document for informat...

Page 53: ... Diagnostics Firmware Release 4 0 x in the Oracle Integrated Lights Out Manager ILOM 4 0 Documentation Library at http www oracle com goto ilom docs Caution The purpose of the Oracle ILOM Fault Management Shell is to help Oracle Service personnel diagnose system problems Customers should not launch this shell or run fault management commands in the shell unless requested to do so by Oracle Service...

Page 54: ...RU repaired FRU repaired faults on a FRU repair FRU repair faults on a FRU rotate errlog rotate error log rotate fltlog rotate fault log 4 Use fmadm faulty and the following options to display active faulty components a Show active faulty components f Show active faulty FRUs r Show active fault FRUs and their fault management states s Show a one line fault summary for each fault event u uuid Show ...

Page 55: ...t you can use to locate failed DIMMs and verify a failed CPU after removing the CMOD from the server The DIMM and CPU Fault Remind circuits hold an electrical charge for 10 minutes after power is removed from the server allowing enough time to remove the CMOD and use the circuit Each CMOD has a motherboard mounted Fault Remind button The button is part of the CMOD Fault Remind circuit The circuit ...

Page 56: ... must be in place for the server to function as a sealed system If these components are not installed correctly the airflow inside the server can become chaotic and non directional which can cause server components to overheat and fail Inspect the server interior to ensure that the air baffle is properly installed Ensure that all external facing slots storage drive PCIe are occupied with either a ...

Page 57: ...anels on the front panel are green when the PS is functioning properly Verify that both AC power cords are connected to the server Verify that the correct power is present at the outlets and monitor the power to verify that it is within the acceptable range You can verify proper connection and operation by verifying the power supply PS indicator panels which are located at the back of the server o...

Page 58: ...u isolate component problems monitor the status of a functioning system and exercise one or more subsystems to disclose more subtle or intermittent hardware related problems Diagnostic tools range in complexity from a comprehensive validation test suite Oracle VTS to a chronological event log Oracle ILOM System Log Tools include standalone software packages firmware based tests and hardware based ...

Page 59: ... Diagnostics and Troubleshooting Guide for Servers With Oracle ILOM 4 0 x at http www oracle com goto x86admindiag docs Oracle VTS Diagnostic tool standalone software Exercise and stress the system run tests in parallel Requires operating system Install Oracle VTS software separately Local or remote access View and control over network Oracle x86 Servers Diagnostics and Troubleshooting Guide for S...

Page 60: ...ft corner of the server as viewed from the front of the server Use buttons to control the server Use indicators to determine server status The FIM provides controls and indicators for three system configurations Single 4 socket The FIM provides controls and indicators for System A SMOD0 only System B SMOD1 buttons and indicators are not operational Dual 4 socket The FIM provides separate controls ...

Page 61: ...age 65 and Troubleshooting Using Status Indicators on page 59 3 System OK chassis SMOD0 System A Green Indicates the operational state of the SMOD0 System A Off AC power is not present or the Oracle ILOM boot is not complete Flashing SMOD0 System A is booting Steady On OS has booted power is on and chassis SMOD0 System A is running See System Module SMOD Indicators on page 65 and Troubleshooting U...

Page 62: ...quired LEDs 0 1 2 3 Amber Indicates that a fault might have occurred in the corresponding CMODs supporting Chassis SMOD0 System A See System Module SMOD Indicators on page 65 and Troubleshooting Using Status Indicators on page 59 9 Locate Button LED SMOD1 System B White Indicates the SMOD1 System B location in the server when pressed Off Server is operating normally Fast blink Use Oracle ILOM to a...

Page 63: ...ates that a fault might have occurred in the SMOD1 system B cooling subsystem The system Fault Service Required LED might also be lit See System Module SMOD Indicators on page 65 and Troubleshooting Using Status Indicators on page 59 15 Chassis rear Fault Service Required LED SMOD1 System B Amber Indicates that a fault might have occurred in SMOD1 System B See System Module SMOD Indicators on page...

Page 64: ...he fan module 2 OK Green Indicates the functional state of the fan module Off Fan module is powered off or functioning abnormally Steady On Fan module is powered on and functioning normally Power Supply PS Indicators Each power supply PS has three indicators arranged in a single row from left to right Power supplies for System A are PS2 and PS3 Power supplies for System B are PS0 and PS1 64 Oracle...

Page 65: ... Off PS is disconnected Steady On PS is powered on and functionaing normally When this LED is lit the AC OK LED is also lit Note Oracle ILOM signals a fault on any installed power supply that is not connected to an AC power source since it might indicate a loss of redundancy 3 AC OK LED Input AC Green Indicates the operational state of the power supply Off PS is not connected to an AC power source...

Page 66: ...ing normally Fast blink Use Oracle ILOM to activate this LED to enable you to locate a system quicklly and easily See Managing the Locate Button LED on page 120 2 Fault Service Required Amber Indicates a fault state in SMOD Off SMOD is operating normally Steady On A fault is present in SMOD Other amber fault indicators might also be lit which can help you isolate the fault to a particular subsyste...

Page 67: ...g Steady On OS has booted power is on and chassis SMOD is running Along with the SP indicator above the System OK LED provides the SMOD power status See Troubleshooting Using Status Indicators on page 59 8 HBA Fault Service Required Amber Indicates a fault state in the SMOD internal HBA Off HBA is operating normally Steady On A fault is present in SMOD HBA Lights when the internal HBA requires ser...

Page 68: ...work Off No activity No link Not operational FLASHING Packet activity Blinks with network traffic NET 1 Link speed LED Top right Bi colored Amber Green Off 10BASE T link if link up 10 GigabitEthernet 10GBASE T Amber ON 100BBASE T link Fast Ethernet 100 BASE TX Green ON 1000BBASE T link GigabitEthernet 1000BASE T 11 NET 2 1 10 GbE Ethernet port Activity and Speed LEDs Activity Top left Green Link s...

Page 69: ...ont of the storage drive carrier and the storage drive indicators Call Out Status LED or Button Icon and Color Description 1 Ready to Remove Blue Off Server is operating normally On Lights when the storage drive is ready to be removed from the server in response to an action initiated from the server OS 2 Fault Service Required LED Amber Indicates a fault state has been detected in the storage dri...

Page 70: ...ault Service Required LED and a recessed pinhole Attention ATTN button The ATTN buttons are used to initiate DPCC removal and install Before removing a DPCC use a stylus topress both ATTN buttons After installing a DPCC that contains a PCIe card press the ATTN button again Call Out Status LED Icon and Color Description 1 ATTN ATTN Attention ATTN DPCC Recessed pinhole button 2 Fault Service Require...

Page 71: ...C power is not present Flashing DPCC is booting Steady On DPCC power is on and running AC Power Block Inlet Indicators Each power inlet on the AC power block at the server back panel has a single green OK indicator that turns on steady only when the power at the connector is sufficient for the power supply unit In the following figure callout 1 shows the OK indicator for inlet AC 0 The server back...

Page 72: ...ls indicators connectors and drives located on the front and back panels Front Indicator Module FIM Panel on page 60 Power Supply PS Indicators on page 64 Fan Module FM Indicators on page 63 Storage Drive Indicators on page 69 System Module SMOD Indicators on page 65 Dual PCIe Card Carrier DPCC Indicators on page 70 AC Power Block Inlet Indicators on page 71 Controls and Indicators on page 72 Cont...

Page 73: ...s for System A SMOD0 and System B SMOD1 8 socket The FIM provides controls and indicators for System A SMOD0 and System B CMODs 4 7 Other System B SMOD1 buttons and indicators are not operational 2 System B SMOD1 Single 4 socket System B SMOD1 buttons and indicators are not operational Dual 4 socket The FIM provides separate controls and indicators for System A SMOD0 and System B SMOD1 8 socket Th...

Page 74: ...te button The buttons on the server front and back allow you to manage System A SMOD0 and System B SMOD1 Locate Buttons LED indicators locally To deactivate or activate the Locate Button LED press and release the button Turn a Locate Button LED on remotely from Oracle ILOM to locate the server in a rack Typically a server readied for service is placed in Standby power mode and the SMOD0 or SMOD1 L...

Page 75: ...EDs front and back are steady on The state of the front and back green On Standby Power OK indicator and the green SP indicator depends on the severity of the condition PS Fault For a server with a PS in a fault state the server amber Fault Service Required LEDs front and back and the amber Fault Service Required indicator on the PS0 3 are on steady The front and back green On Standby Power OK ind...

Page 76: ...on steady The front and back System OK indicators and the SP OK indicator are off Front Panel Lamp Test To perform a lamp test of all front panel indicators press the Locate Button LED button three times within a five second period All the front and back indicators light up and remain on steady for 15 seconds see Unison Steady On on page 80 Back Panel Pinhole Switches This section shows the locati...

Page 77: ...ot and requires a stylus 6 Host Warm Reset button recessed SMOD1 Performs an immediate System B SMOD1 host reboot and requires a stylus Status Indicator Blink Rates This section describes the following indicator blink rates Steady On Steady Off Slow Blink Rate Fast Blink Rate Single Standby Blink Rate Slow Unison Blink Rate Insertion Blink Unison Steady On Alternating Invalid FRU Blink Rate Feedba...

Page 78: ...or or a subsystem not in a fault state unlit amber Fault Service Required LED Slow Blink Rate For the slow blink rate the indicator typically green repeatedly lights for half a second during a one second interval 1 Hz and turns off for half a second The slow blink rate indicates an on going activity For example device rebuilding booting or in transition from one mode to another 78 Oracle Server X7...

Page 79: ...a system or component in Standby mode For example a server in standby power mode or a hot spare device waiting to be used also used with amber indicators to indicate a predicted fault Slow Unison Blink Rate For the slow unison blink rate the indicators on the component blink in unison for half a second during a one second interval 1 Hz Typically this is limited to three successive blinks This conf...

Page 80: ...steady on see Steady On on page 77 This occurs during the front panel lamp test see Front Panel Lamp Test on page 76 This is the only time that the Locate Button LED indicator is on steady Alternating Invalid FRU Blink Rate The alternating invalid FRU blink rate is a repeating sequence of lit green and amber indicators at 1 Hz This indicates that a component has an incorrect version or mismatch fo...

Page 81: ...ly on indicator repeatedly turns off twice during a one second interval 2 Hz see also Fast Blink Rate on page 79 while data activity is taking place Sequential Diagnostic Blink Rate This blink rate is a repeating sequence in which each indicator successively lights for 0 5 sec to indicate that diagnostics are running This blink rate is used only on systems or components capable of running diagnost...

Page 82: ...ket server Intel 8160 processor 24 core 2 1 GHz 150W 4 socket servers or 8 socket server Intel 6140 processor 18 core 2 3 GHz 150W 4 socket servers Intel 6128 processor 6 core 3 4 GHz 125W 4 socket servers Four CMOD configuration Must be in 4 socket mode Must have CMODs in slots 0 3 slots 4 7 for side B DPCC slots 0 3 active 4 7 for side B Both fan frames must be installed All 8 fan modules must b...

Page 83: ...ocket Up to 3 0 TB DRAM with 64 GB DIMMs of DDR4 interface memory 12 DIMMs 6 channels per CMOD See Servicing DIMMs on page 182 memory population rules for order of installation DDR4 interface 2666 MT s 2666 MT s 2DPC Power Subsystem Use the Oracle Integrated Lights Out Manager ILOM Power page to view the overall health and power consumption of the power supplies installed in your system Review the...

Page 84: ...nstalled in your system Additionally you can view the server inlet and exhaust temperatures Review the Fans table for details about the health and location of individual fans System cooling air flows from front to back Primary cooling is provided by eight redundant front panel accessible 100 watt hot swappable cooling fan modules To maintain the integrity of the chassis cooling system ensure that ...

Page 85: ... CMOD3 and is provided by FM2 and FM3 Zone 3 airflow cooling is concentrated on CMOD4 and CMOD5 and is provided by FM4 and FM5 Zone 4 airflow is concentrated on CMOD6 and CMOD7 and is provided by FM6 and FM7 Note In a four CMOD server configuration the fan modules for cooling zones 3 and 4 are not powered However to maintain the integrity of the cooling subsystem FMs 4 7 must be installed in the s...

Page 86: ... Fan Module Redundancy The eight fan modules FMs provide airflow for chassis cooling zones 1 4 For redundancy each zone has two dedicated FMs Replace a failed fan module immediately The FMs are hot serviceable Caution Data Loss Do not remove more than one fan module from a column while the system is in Main power mode This action removes power from the CMODs and causes an immediate shutdown On an ...

Page 87: ...llers The server networking subsystem consists of the following Ethernet Controllers SMOD0 System A NET 0 3 1 10 GbE Network ports labeled NET0 NET1 NET2 and NET3 SMOD1 System B NET 0 3 1 10 GbE Network ports are labeled NET0 NET1 NET2 and NET3 Infiniband Controllers Installation Rules Oracle Dual Port QDR InfiniBand Host Channel Adapter M3 Infiniband card PCIe slot number order A 8 6 4 2 7 5 3 1 ...

Page 88: ...OD0 and SMOD1 4 USB 3 0 ports 2 external one each in SMOD0 and SMOD1 2 internal one each in SMOD0 and SMOD1 Note Internal USB ports are not used See Back Panel Connector Locations on page 90 PCI Devices Subsystem Use the Oracle Integrated Lights Out Manager ILOM PCI Devices page to view inventory properties for the PCIe add in cards and the built in devices that are detected on your server To view...

Page 89: ...ck panel and are located below the SMOD Each DPCC holds one oe two PCIe cards Attaching Devices to the Server The following sections contain procedures for attaching devices to the server Attach devices to access diagnostic tools when troubleshooting and servicing the server Attach Devices to the Server on page 90 Back Panel Connector Locations on page 90 Configuring Serial Port Sharing on page 92...

Page 90: ...r the network connect an Ethernet cable to the Ethernet port labeled NET MGT 3 To access the Oracle ILOM command line interface CLI locally using the management port connect a serial null modem cable to the RJ 45 serial port labeled SER MGT Back Panel Connector Locations The following illustration shows and describes the locations of the back panel connectors Use this information to set up the ser...

Page 91: ...ms NET0 NET1 NET2 and NET3 ports on single 8 socket systems Unused ports on single 4 socket systems System B SMOD1 Dual 4 socket and single 8 socket systems 5 Net management port NET MGT System A SMOD0 All systems 6 Serial management port SER MGT System A SMOD0 All systems 7 USB 3 0 port System A SMOD0 All systems 8 NET0 NET1 NET2 and NET3 ports on all systems System A SMOD0 All systems 9 Power co...

Page 92: ... details about restoring access to the server port on your server see the Oracle Integrated Lights Out Manager ILOM 4 0 Documentation Library at http www oracle com goto ilom docs You can assign serial port output using either the Oracle ILOM web interface or the command line interface CLI For instructions see the following sections Assign Serial Port Output Using SP Oracle ILOM CLI on page 92 Ass...

Page 93: ...e navigation menu on the left side of the screen 3 Select the Serial Port tab The Serial Port Settings page appears Note The serial port sharing setting by default is Service Processor 4 In the Serial Port Settings page select Host Server as the serial port owner 5 Click Save for the changes to take effect 6 Connect a serial host to the server Ethernet Device Naming This section contains informati...

Page 94: ...describe how to get additional help to resolve server related problems Contacting Support on page 94 Locating the Chassis Serial Number on page 95 Contacting Support If the troubleshooting procedures in this chapter fail to solve your problem use the following table to collect information that you might need to communicate to support personnel System Configuration Information Needed Your Informati...

Page 95: ...ASR is a feature available to customers having Oracle Premier Support and is provided to those customers at no additional cost Oracle ASR is the fastest way to restore system availability if a hardware fault occurs Oracle ASR software is secure and customer installable with the software and documentation downloadable from My Oracle Support at https support oracle com When you log in to My Oracle S...

Page 96: ...Auto Service Requests For more information about Oracle ASR go to http www oracle com us support auto service request index html 96 Oracle Server X7 8 Service Manual October 2017 ...

Page 97: ... Oracle ILOM CLI on page 103 Prepare the Server for Hot Service Oracle ILOM Web Interface on page 104 Setting up for warm service Prepare the Server for Warm Service Oracle ILOM CLI on page 105 Prepare the Server for Warm Service Oracle ILOM Web Interface on page 107 Setting up for cold service Prepare the Server for Cold Service Oracle ILOM CLI on page 108 Prepare the Server for Cold Service Orac...

Page 98: ...ight hand side of the chassis front panel Following this practice equalizes the electrical potentials between you and the server Using an Anti static Mat In addition to wearing an anti static wrist strap when handling components create an ESD free work place by using an anti static mat as a work surface and as a place to set ESD sensitive components such as printed circuit boards DIMMs and process...

Page 99: ...e space left vacant by the removal of the fan module Fan modules are hot swap components Removing a fan module from a fully powered server exposes open and active power connectors that can cause electric shock Related Information Performing Electrostatic Discharge and Static Prevention Measures on page 98 FRU Key Identity Properties KIP Automated Update Oracle ILOM includes a key identity properti...

Page 100: ...acement component is programmed by Oracle ILOM to contain the same KIP as the other two components Note Only one of the quorum members can be replaced at a time Automated updates can only be completed when two of the three quorum members contain matching key identity properties Related Information Servicing Components on page 123 Required Tools and Equipment The server can be serviced with the fol...

Page 101: ...the Server for Hot Service Oracle ILOM Web Interface on page 104 Prepare the Server for Warm Service Oracle ILOM CLI on page 105 Prepare the Server for Warm Service Oracle ILOM Web Interface on page 107 Prepare the Server for Cold Service Oracle ILOM CLI on page 108 Prepare the Server for Cold Service Oracle ILOM Web Interface on page 110 Serviceability Overview For detailed information about serv...

Page 102: ...ssors on page 170 DIMM memory Servicing DIMMs on page 182 See Prepare the Server for Warm Service Oracle ILOM CLI on page 105 or Prepare the Server for Warm Service Oracle ILOM Web Interface on page 107 Cold service Cold service components must be serviced when the server is completely powered off and all four AC power cords are disconnected from the server back panel AC power block The following ...

Page 103: ...t Manager Documentation Library at http www oracle com goto ilom docs For additional detailed information see Managing the Locate Button LED on page 120 Servicing Components on page 123 Prepare the Server for Hot Service Oracle ILOM CLI This procedure describes how to prepare the server to remove replace or install hot service components A hot service component can be serviced while the server is ...

Page 104: ...moval and installation procedures on components See Servicing Components on page 123 Prepare the Server for Hot Service Oracle ILOM Web Interface This procedure describes how to prepare the server to remove replace or install hot service components A hot service component can be serviced while the server is operating at Main power mode For more information about component serviceability see Compon...

Page 105: ...M and processor components without accessing the server back panel to disconnect AC power cords or shutting down Oracle ILOM When Oracle ILOM detects that two fan modules in a single cooling zone a vertical column have been removed the SP removes power from the CMODs allowing you to service CMODs and their subcomponents without removing the power cords Oracle ILOM remains available in warm service...

Page 106: ...r on command activates the Locate Button LED indicator LED on the server front panel For other options see Managing the Locate Button LED on page 120 To turn off the Locate Button LED indicator type set System locator_indicator off 4 Power down the server gracefully For graceful power off see Power Down the Server Gracefully Oracle ILOM CLI on page 112 The stop System command powers off the server...

Page 107: ...amage Do not replace any components except for CMODs and internal CMOD subcomponents while the server is in warm service mode Caution Data Loss Do not remove more than one fan module from a column while the system is in Main power mode This action removes power from the CMODs and causes an immediate shutdown On an eight CMOD system this applies to all fan modules On a four CMOD system this applies...

Page 108: ...For more information see Control the Locate Button LED Locally on page 121 6 Set up an ESD safe space at the service location Set up a space where you can set components See Performing Electrostatic Discharge and Static Prevention Measures on page 98 7 Perform warm service removal and installation procedures on components See Servicing Components on page 123 Prepare the Server for Cold Service Ora...

Page 109: ...D indicator type set System locator_indicator off 3 Power down the server gracefully For graceful power off see Power Down the Server Gracefully Oracle ILOM CLI on page 112 The stop System command powers off the server to Standby power mode For more power off options see Powering Down the Server on page 111 4 Once at the service location press the Locate Button LED button to deactivate the indicat...

Page 110: ... Log in to the service processor Oracle ILOM web interface Direct a web browser to Oracle ILOM using the IP address of the server SP and log in as root or a as user with administrator privileges See Accessing Oracle ILOM in Oracle Server X7 8 Installation Guide The Summary Information page appears 2 In the Actions section of the Summary Information page verify that the Power State is ON If the Pow...

Page 111: ...et components See Performing Electrostatic Discharge and Static Prevention Measures on page 98 9 Perform service removal and installation procedures on components See Servicing Components on page 123 Powering Down the Server Determine how you want to power down the server by reviewing the options in the following table Description Link Power down the server gracefully to prevent data from being co...

Page 112: ...ger ILOM 4 0 Documentation Collection at http www oracle com goto ilom docs 2 Notify affected users that the server will be powered down 3 Save any open files and quit all running applications Refer to your application documentation for specific information about these processes 4 Log in to the Oracle ILOM command line interface CLI using an Administrator account For instructions refer to the Orac...

Page 113: ...rt 1 Log in to the server as superuser or equivalent Depending on the nature of the problem you might want to view the system status or the log files or run diagnostics before you shut down the system For log file information refer to the Oracle Integrated Lights Out Manager ILOM 4 0 Documentation Collection at http www oracle com goto ilom docs 2 Notify affected users that the server will be powe...

Page 114: ... ACPI enabled operating systems to perform an orderly shutdown of the operating system Servers not running ACPI enabled operating systems shut down to Standby power mode immediately When Main power is off the Power OK LED on the front panel begins flashing indicating that the server is in Standby power mode See About Controls and Connectors on page 72 and Controls and Indicators on page 72 2 Disco...

Page 115: ... the default command prompt indicating that you have successfully logged in to Oracle ILOM 2 From the CLI prompt type the following command stop f System The server powers down immediately 3 Disconnect the power and data cables from the server See Remove Power on page 119 Caution When you power down the server using Oracle ILOM the server enters Standby power mode Power is still directed to the se...

Page 116: ...s down immediately 4 Disconnect the power and data cables from the server See Remove Power on page 119 Caution When you power down the server using Oracle ILOM the server enters Standby power mode Power is still directed to the service processor remote management subsystem and power supply fans To completely power off the server you must disconnect the power cords from the power supplies Related I...

Page 117: ...ndicators on page 72 Power Down the Server for Immediate Shutdown Oracle ILOM CLI on page 115 Power Down the Server for Immediate Shutdown Oracle ILOM CLI on page 115 Power On the Server on page 238 Power Off the Server Using the Server OS If the server operating system OS is running you can use its shutdown procedure to power off the server to Standby power mode The procedure provides a graceful ...

Page 118: ...er down the server gracefully to prevent data from being corrupted Performing a graceful shutdown ensures that the system is ready for restart To perform a graceful shutdown use the server OS Oracle ILOM or the server front panel Power button Immediate Shutdown An immediate shutdown also referred to as an emergency shutdown shuts down the host immediately without closing files or preparing the fil...

Page 119: ...in See Power Control Shutdown and Reset States on page 118 1 Place the server in Standby power mode Use one of the power off methods See Powering Down the Server on page 111 2 Access the back of the server 3 To remove power from the server lift the power cord retaining clips and disconnect each AC power cable from the AC power block This action completely removes power from the server 4 If you are...

Page 120: ...Button LED to help you identify the server in the rack 1 Open an SSH session and at the command line log in to the SP Oracle ILOM CLI Log in as a user with root or administrator privileges For example ssh root ipaddress where ipaddress is the IP address of the server module SP Type a password when prompted For more information see Using Oracle ILOM in Oracle Server X7 8 Installation Guide The Orac...

Page 121: ...g in as root or a user with administrator privileges See Using Oracle ILOM in Oracle Server X7 8 Installation Guide The Summary Information page appears 2 In the Actions section verify that the Locate Button LED indicator is off and then click the Turn On button 3 Click OK The Locator indicator on the Summary Information page changes to indicate the status of the Locate Button LED indicator Contro...

Page 122: ...five second period All of the front panel indicators light up and remain lit for 15 20 seconds Component Filler Panels and Non Powered Components A filler panel is a metal or plastic enclosure that does not contain any functioning system hardware or cable connectors Filler panels occupy vacant component slots to help control noise EMI and airflow They are installed at the factory and must remain i...

Page 123: ...install CPU modules CMOD including CMOD processor and memory components Servicing CPU Module CMOD Components FRU on page 160 Removing and installing SMOD assembly and components Servicing System Module SMOD Components FRU on page 195 Remove and install the front indicator panel FIM Servicing the Front Indicator Module FRU on page 218 Replacing the midplane assembly Replace the Midplane Assembly on...

Page 124: ...nformation including storage drive slot population rules Storage Drive Slot Locations The eight storage drive slots are in the system module SMOD and directly accessible at the server back panel Slots are arranged in two stacked rows of four slots and designated from right to left Call Out Description 1 HDD 0 SMOD0 2 HDD 1 SMOD0 3 HDD 2 SMOD0 4 HDD 3 SMOD0 124 Oracle Server X7 8 Service Manual Oct...

Page 125: ...umber For component serviceability locations and designations see Identifying Components on page 24 Remove a Storage Drive For storage drive information see Storage Drive Locations and Numbering on page 124 1 Prepare the server for service Choose one of the following methods Prepare the server for hot service Prepare the server for cold service See Preparing the Server for Component Replacement on...

Page 126: ...rive The spring loaded handle pops open 4 To remove the drive rotate the handle to its fully open position and pull the drive out of its slot Rotating the handle to its fully open position disengages the drive from its internal connector 5 Consider your next steps 126 Oracle Server X7 8 Service Manual October 2017 ...

Page 127: ...127 Identifying Components on page 24 Install a Storage Drive For storage drive information see Storage Drive Locations and Numbering on page 124 1 Prepare the server for service Choose one of the following methods Prepare the server for hot service Prepare the server for cold service See Preparing the Server for Component Replacement on page 101 2 If necessary remove the HDD filler panel from the...

Page 128: ...rive into the slot and push it inward until it stops and the handle begins to close 6 Rotate the handle to the closed position Continue pushing the handle until the drive is flush with the front of the SMOD 7 Perform administrative procedures to reconfigure the drive 128 Oracle Server X7 8 Service Manual October 2017 ...

Page 129: ...off the server The fan modules and fan frames are located in the front of the server See the following procedures Fan Module Locations and Numbering on page 129 Remove a Fan Module on page 131 Install a Fan Module on page 133 Remove a Fan Frame on page 136 Install a Fan Frame on page 137 For component serviceability locations and designations see Identifying Components on page 24 Fan Module Locati...

Page 130: ...The eight fan modules are installed in two fan frames The left frame contains FM 0 FM1 FM2 and FM 3 The right frame contains FM 4 FM 5 FM 6 and FM 7 Each vertical pair of FMs provides cooling for the corresponding CPU modules CMODs which are located directly behind the FMs For example FMs 0 and 1 provide cooling for CMODs 0 and 1 and FMs 6 and 7 provide cooling for CMODs 6 and 7 For CMOD designati...

Page 131: ...ver for warm service Access CMODs behind the FMs using a warm service procedure See Remove a CMOD on page 162 Prepare the server for cold service Access CMODs behind the FMs using a cold service procedure See Remove a CMOD on page 162 See Preparing the Server for Component Replacement on page 101 2 Identify the fan module that requires removal by its position and designation Access fan modules FMs...

Page 132: ...and not functioning 3 Release button None Press the green button to release and remove the fan module 3 To unlock the fan module push in the green release button Caution Data Loss Do not remove more than one fan module from a column while the system is in Main power mode This action removes power from the CMODs and causes an immediate shutdown On an eight CMOD system this applies to all fan module...

Page 133: ...ins system cooling and prevents a disruption of server airflow during hot service Caution Server overtemperature The slot s air vane maintains system cooling by preventing a disruption of server airflow Do not open the air vane when the system is running Related Information Remove a Fan Frame on page 136 Install a Fan Module on page 133 Install a Fan Module Use this procedure after removing a fan ...

Page 134: ...e 162 See Preparing the Server for Component Replacement on page 101 2 Align the fan module with the slot Access this component directly from the front of the server Ensure the handle is positioned at the bottom of the slot with the green release button to the left and that the air vane for the slot swings freely Caution Component damage Do not apply excessive force when sliding the fan module int...

Page 135: ...Install a Fan Module The locking action is accompanied by a click sound 4 Verify that the green Fan OK indicator on the fan module lights and is steady on Servicing Components 135 ...

Page 136: ...or warm service Access CMODs behind the FMs using a warm service procedure See Remove a CMOD on page 162 Prepare the server for cold service Access CMODs behind the FMs using a cold service procedure See Remove a CMOD on page 162 See Preparing the Server for Component Replacement on page 101 2 Remove the fans associated with the fan frame 3 To remove the fan frame hold it by the green labels at th...

Page 137: ...formation Remove a CMOD on page 162 Install a Fan Frame When installing a fan frame handle it by the green labels at the center of the frame The two fan frames and all eight fan modules must be installed to operate both a four CMOD and an eight CMOD configured server Before You Begin For removal instructions see Remove a Fan Frame on page 136 Servicing Components 137 ...

Page 138: ... and is flush with the front of the server 3 Install the four FMs See Install a Fan Module on page 133 4 Prepare the server for operation See Identifying Components on page 24 Servicing Power Supplies CRU This section describes how to service power supplies PS Power supplies are customer replaceable units CRUs that do not require you to power off the server For more information about CRUs see Illu...

Page 139: ...with no loss to system availability In maximally configured systems it is possible that the worst case power consumption of the system could exceed the capacity of a single PS The PSs provide an over subscription mode which allows the system to operate with fault tolerance even with modest excursions beyond the rated capacity of a single PS This over subscription support is accomplished using hard...

Page 140: ...power supplies Call Out Description 1 PS 0 System B 2 PS 1 System B 3 PS 2 System A 4 PS 3 System A AC Input Power Block Locations Four AC power block inputs at the server back panel are arranged vertically Starting at the bottom AC inputs are designated AC 0 AC 1 AC 2 and AC 3 The designations match the corresponding power supplies The AC power block is not a removable component The following ill...

Page 141: ...service Choose one of the following methods Prepare the server for hot service Prepare the server for cold service See Preparing the Server for Component Replacement on page 101 2 Identify the power supply that requires removal Access this component directly from the front of the server The following status indicators LEDs are lit when a power supply fault is detected Front and back Fault Service ...

Page 142: ... easily Lights steady on when the power supply is in a fault state 2 OK Power Supply OK LED green Green Indicates the functional state of the power supply Off PS is disconnected Steady On PS is powered on and functionaing normally When this LED is lit the AC OK LED is also lit Note Oracle ILOM signals a fault on any installed power supply that is not connected to an AC power source since it might ...

Page 143: ... the two green release latches at the end of the lever 1 This action is accompanied by a click sound 4 To disengage the power supply from its internal connector rotate the lever to the left 2 Caution Pinch point When operating the lever keep your fingers clear of the hinged end of the lever The pawl at the hinged end of the lever engages the sidewall of the server and provides the pivot point for ...

Page 144: ...4 Install a Power Supply Use this procedure when replacing a failed power supply or after having serviced the FIM 1 Prepare the server for service Choose one of the following methods Prepare the server for hot service Prepare the server for warm service Prepare the server for cold service See Preparing the Server for Component Replacement on page 101 144 Oracle Server X7 8 Service Manual October 2...

Page 145: ...the power supply with its slot Ensure that the connector end of the PS is at the opening of the slot and that the open hinge on the front of the PS is at the bottom and to the left 5 Slide the power supply into the slot until it stops 6 To install the power supply rotate the lever to the right 1 The pawl at the hinged end of the lever engages the sidewall of the server and provides the pivot point...

Page 146: ...your fingers clear of the backside of the lever 7 Verify that the green Power OK indicator on the power supply indicator panel turns steady on and that the amber Fault Service Required LED is not lit 146 Oracle Server X7 8 Service Manual October 2017 ...

Page 147: ... Description 1 Fault Service Required Locate LED Amber White Indicates the location of the power supply in the server Off Power supply is operating normally Fast blink Use Oracle ILOM to activate this LED to enable you to locate a power supply quickly and easily Lights steady on when the power supply is in a fault state Servicing Components 147 ...

Page 148: ...efer to your PCIe card documentation for complete software and cabling information about your card Caution Customers should not use the procedures in this section to service the Oracle Storage 12 Gb SAS PCIe RAID HBA Internal card that is located in SMODs The Oracle Storage 12 Gb SAS PCIe RAID HBA Internal cards are field replaceable units FRUs and should be serviced only by authorized Oracle Serv...

Page 149: ...eability locations and designations see Identifying Components on page 24 PCIe Card and DPCC Overview This section contains reference information for PCIe cards and DPCCs including DPCC population rules DPCC and PCIe Card Slot Locations and Numbering There are sixteen PCIe slots available for eight PCIe carriers The eight dual PCIe card carrier DPCC slots are arranged in a single row at the server...

Page 150: ...e Slot 3 in DPCC 1 11 PCIe Slot 11 in DPCC 5 4 PCIe Slot 4 in DPCC 1 12 PCIe Slot 12 in DPCC 5 5 PCIe Slot 5 in DPCC 2 13 PCIe Slot 13 in DPCC 6 6 PCIe Slot 6 in DPCC 2 14 PCIe Slot 14 in DPCC 6 7 PCIe Slot 7 in DPCC 3 15 PCIe Slot 15 in DPCC 7 8 PCIe Slot 8 in DPCC 3 16 PCIe Slot 16 in DPCC 7 Server PCIe Card Slots The server contains nine low profile PCIe slots eight Gen 3 DPCC slots accessible ...

Page 151: ...clude an OK indicator a Fault Service Required LED and two ATTN buttons The buttons are used to alert the OS to a request for DPCC PCIe card removal and to request acknowledgement of a DPCC installation For a DPCC removal the OS responds by lighting the indicators on the front of the DPCC For an installation the OS lights the green OK indicators DPCC Population Rules One populated DPCC with at lea...

Page 152: ...he ATTN buttons alert the system to a request to remove a PCIe card When the system has acknowledged the request the server takes the device offline and lights indicators for each slot When the indicators are lit you can safely remove the component Note If only a single PCIe card is present press only the corresponding ATTN button For button locations see Dual PCIe Card Carrier DPCC Indicators on ...

Page 153: ...Card on page 153 Remove a PCIe Card To access a PCIe card you must first remove its DPCC see Remove a DPCC on page 151 One or two PCIe cards can be installed in each Dual PCIe Card Carrier DPCC Perform this procedure when replacing a PCIe card or when changing its configuration 1 Prepare the server for service Choose one of the following methods Prepare the server for hot service Servicing Compone...

Page 154: ...card For component serviceability locations and designations see Identifying Components on page 24 3 Remove the DPCC See Remove a DPCC on page 151 4 Orient the DPCC so that the hinge is to the left 5 To open the top of the DPCC lift the release latch at the non hinged end of the lid and rotate the lid upward 154 Oracle Server X7 8 Service Manual October 2017 ...

Page 155: ... DPCC see Remove a DPCC on page 151 One or two PCIe cards can be installed in each Dual PCIe Card Carrier DPCC Perform this procedure when replacing a PCIe card or when changing its configuration 1 Prepare the server for service Choose one of the following methods Prepare the server for hot service Prepare the server for cold service See Preparing the Server for Component Replacement on page 101 2...

Page 156: ...the hinge is to the left 5 To open the top of the DPCC lift the release latch at the non hinged end of the lid and rotate the lid up 6 Ensure that the DPCC top cover is open The top of the DPCC is hinged at one end To open lift the tab on the non hinged end 156 Oracle Server X7 8 Service Manual October 2017 ...

Page 157: ...l the card align the edge connector with the slot in the DPCC and push the card down into the slot 9 To close the top of the DPCC rotate it to the right ensuring the clip on the edge of the top is secured over the unhinged edge of the DPCC Caution Pinch point Keep fingers away from the underside of the top when closing it Servicing Components 157 ...

Page 158: ... a DPCC on page 151 Before You Begin Obtain a stylus for activating recessed buttons 1 Prepare the server for service Choose one of the following methods Prepare the server for hot service Prepare the server for cold service See Preparing the Server for Component Replacement on page 101 2 Ensure the top of the DPCC is closed and secured and the lever on the front of the DPCC is in its fully open p...

Page 159: ...when closing it This action draws the DPCC inward engaging the connectors in the DPCC with the connectors on the server midplane 6 Use a stylus to press both ATTN buttons on the front of the DPCC Note If only a single PCIe card is present press only the corresponding ATTN button If you are doing cold service this step is not necessary The buttons alert the system to a request to bring the devices ...

Page 160: ...ostatic discharge To protect components from damage always use an anti static mat and wrist strap See Performing Electrostatic Discharge and Static Prevention Measures on page 98 For component serviceability locations and designations see Identifying Components on page 24 See CPU Module CMOD Overview on page 28 CMOD Slot Locations and Numbering CPU module slots are arranged in a single row and are...

Page 161: ...gurations Each CMOD supports a single socket containing a single processor Each CMOD contains one Intel Xeon vx processor 28 core shelf 4 processor For the single 4 socket server configuration System module 0 SMOD0 System A and SMOD1 System B must be installed but only SMOD0 is active CPU modules CMODs must be installed in slots 0 3 CMOD slots 4 7 are empty All eight DPCC slots 0 7 must be install...

Page 162: ...ght fan modules FMs must be installed and all FMs are active Both fan frames must be installed Note During Oracle Server X7 8 reconfiguration administrators will need to manually clear all existing faults before an 4 socket to 8 socket mode change Remove a CMOD You need to remove the CMOD to service it or its internal components 1 Prepare the server for service Choose one of the following methods ...

Page 163: ...OD in a failed state the lit fault indicator for the CMOD on the FIM shows you the CMOD number and the group to which it belongs 6 To unlock the CMOD squeeze together the green tabs on the end of the CMOD lever 7 To disconnect the CMOD from the connector on the midplane rotate the CMOD lever down and away from the CMOD Caution Pinch point Keep your fingers clear of the underside of the lever The l...

Page 164: ...he CMOD slide it completely out of the server Related Information Identify and Remove a Faulty DIMM on page 189 Identify and Remove a Faulty Processor on page 171 Install a CMOD on page 167 Remove the CMOD Cover When removing or installing the CMOD cover always maintain component serviceability requirements with regard to static protection 1 Remove a CMOD on page 162 164 Oracle Server X7 8 Service...

Page 165: ...ist and then to a chassis ground See Performing Electrostatic Discharge and Static Prevention Measures on page 98 3 Remove the CMOD top cover To remove the CMOD top cover push the release button slide the CMOD cover toward the back of the CMOD Servicing Components 165 ...

Page 166: ...age 162 2 To install the cover position it over the CMOD chassis with the green button at the front 3 Set the cover on the chassis leaving a gap of approximately 1 inch 25 mm between the lead edge of the cover and the front of the CMOD 4 Ensure that the edges of the cover encapsulate the edges of the chassis and that the pins in the cover are aligned with the slots in the chassis sidewall 166 Orac...

Page 167: ... Install a CMOD Use this procedure to install a CMOD after replacing it or after servicing its internal components See Remove a CMOD on page 162 1 Ensure that the CMOD lever is in the fully open position a Squeeze together the green tabs on the end of the lever b Rotate the lever down and away from the CMOD Servicing Components 167 ...

Page 168: ...Install a CMOD 2 Position the CMOD in the slot Caution The CMOD is heavy Be prepared to hold it firmly when it is clear of the slot 168 Oracle Server X7 8 Service Manual October 2017 ...

Page 169: ...stops In this position the pawl at the lever hinge is aligned with the slot in the server 5 To install the CMOD rotate the lever up until it locks into place and is flush with the front of the CMOD Caution Pinch point When operating the lever keep your fingers clear of the back side and hinged end of the lever Servicing Components 169 ...

Page 170: ...urning the Server to Operation on page 237 Servicing Processors The following section describes how to service processors Processors are field replaceable units FRUs For more information about FRUs see Illustrated Parts Breakdown on page 24 and Field Replaceable Units on page 27 Caution Ensure that all power is removed from the server before removing or installing a processor You must disconnect t...

Page 171: ...tions see Identifying Components on page 24 Identify and Remove a Faulty Processor Caution Be careful not to touch the processor socket pins The processor socket pins are very fragile A light touch can bend the processor socket pins beyond repair Caution Whenever you remove a processor replace it with another processor and reinstall the processor heatsink otherwise the server might overheat due to...

Page 172: ...u press the Fault Remind button it is likely that the capacitor powering the fault remind circuit lost its charge This can happen if you press the Fault Remind button for a long time with the fault LED lit or if power was removed from the server for more than 15 minutes The processor fault LED that is located adjacent to the faulty processor lights If the processor fault LED is off then the proces...

Page 173: ...t secure the processor heatsink module to the socket fully loosen nut 4 then 3 then 2 then 1 1 4 Lift the processor heatsink module from the socket 2 Always hold the processor heatsink module along the axis of the fins to prevent damage 5 Separate the processor from the heatsink Servicing Components 173 ...

Page 174: ...sink module place it on a flat surface and locate the thermal interface material TIM breaker slot b While holding down the processor heatsink module by the edges insert a flat blade screwdriver into the TIM breaker slot 174 Oracle Server X7 8 Service Manual October 2017 ...

Page 175: ... of the screwdriver goes into the slot between the heatsink and processor carrier not between the processor and processor carrier c Using a rocking motion gently pry the corner of the processor carrier away from the heatsink Servicing Components 175 ...

Page 176: ...rk space or other components 6 If you plan on reusing either the heatsink or processor use an alcohol pad to clean the thermal grease on the underside of the heatsink and on the top of the processor Caution Failure to clean thermal grease from the heatsink could result in the accidental contamination of the processor socket or other components Also be careful not to get the grease on your fingers ...

Page 177: ...rocessor is identical to the failed processor that you removed For a description of the processors that are supported by the server see Product Description on page 17 3 Prepare the new processor for installation a Use the syringe supplied with the new or replacement processor to apply approximately 0 3 cc of thermal grease to the center of the underside of the heatsink 1 b Distribute the thermal g...

Page 178: ...e heatsink thermal side down onto the processor carrier until it snaps in place and lies flat Note The processor carrier has latching posts at each corner two that insert into heatsink holes and two that attach to the edge of the heatsink Callout Description 1 Pin 1 indicator 178 Oracle Server X7 8 Service Manual October 2017 ...

Page 179: ...ray c Align the processor heatsink module to the processor socket bolster plate on the motherboard matching the pin 1 location a triangle indicator Callout Description 1 Pin 1 indicator d Place the processor heatsink module on the socket on the motherboard Servicing Components 179 ...

Page 180: ...and that the captive screws align with the threaded socket posts 1 f Using a 12 in lbs ft inch pounds foot torque driver with a Torx T30 bit tighten the processor heatsink module to the socket First fully tighten captive nuts 1 and 2 Then fully tighten nuts 3 and 4 2 As you tighten nuts 3 and 4 some resistance occurs as the bolster leaf spring rises and comes in contact with the heatsink 180 Oracl...

Page 181: ...e ILOM CLI and type the following command to list all known faults on the server show SP faultmgmt The server lists all known faults for example show SP faultmgmt Targets shell 0 SYS MB P0 Properties Commands cd show Alternatively to list all known faults in the server log into the Oracle Solaris OS and issue the fmadm faulty command or log into the Oracle ILOM service processor from the Oracle IL...

Page 182: ...cribes how to service memory modules DIMMs DIMMs are field replaceable units FRUs that require you to power off the server For more information about FRUs see Illustrated Parts Breakdown on page 24 and Customer Replaceable Units on page 26 The Oracle Server X7 8 supports 64 GB quad rank QR Load Reduced DIMMs LRDIMMs and 32 GB dual rank DR and 16 GB DR Registered DIMMs RDIMMs Caution These procedur...

Page 183: ...bels on page 188 Inconsistencies Between DIMM Fault Indicators and the BIOS Isolation of Faulty DIMMs on page 188 Identify and Remove a Faulty DIMM on page 189 Identify and Remove a Faulty DIMM on page 189 Install a DIMM on page 192 For component serviceability locations and designations see Identifying Components on page 24 DIMM and Processor Physical Layout The physical layout of the CMOD memory...

Page 184: ...MM Population Scenarios on page 184 DIMM Population Rules on page 185 DIMM Operating Speeds on page 188 DIMM Rank Classification Labels on page 188 Inconsistencies Between DIMM Fault Indicators and the BIOS Isolation of Faulty DIMMs on page 188 DIMM Population Scenarios There are two scenarios in which you are required to populate DIMMs A DIMM fails and needs to be replaced In this scenario you ca...

Page 185: ... 16 GB DR Registered DIMMs RDIMMs Do not mix 64 GB LRDIMMs and 16 GB or 32 GB RDIMMs in the same server If the server has 64 GB LRDIMMs installed you cannot install 16 GB or 32 GB RDIMMs and vice versa Within a memory channel DIMMs must be populated in the black sockets first and then in the white sockets If you are installing a mix of RDIMM sizes for example 16 GB and 32 GB install the larger siz...

Page 186: ...Channel E Slot 1 DIMM 3 7 Channel D Slot 0 DIMM 4 8 Channel D Slot 1 DIMM 5 9 Channel A Slot 0 DIMM 6 10 Channel A Slot 1 DIMM 7 11 Channel B Slot 0 DIMM 8 12 Channel B Slot 1 DIMM 9 13 Channel C Slot 0 DIMM 10 14 Channel C Slot 1 DIMM 11 DIMM Slot Population Order The DIMM slot population order is as follows 186 Oracle Server X7 8 Service Manual October 2017 ...

Page 187: ... speed will be limited to 1866 MT s A maximum of 8 logical ranks ranks seen by the host per channel is allowed When one DIMM is used it must be populated in DIMM slot 0 farthest away from the CPU of a given channel When single or dual rank RDIMMs are populated for 2DPC two DIMMs per channel always populate the higher quantity rank DIMM first starting from the farthest slot For a 2SPC two slots per...

Page 188: ... speed will be limited by the maximum speed supported by the specific type of processor and the specific memory population All memory installed in the system will operate at the same speed or frequency DIMM Rank Classification Labels DIMMs come in a variety of ranks dual or quad The server supports 64 GB quad rank QR Load Reduced DIMMs LRDIMMs and 32 GB dual rank DR and 16 GB DR Registered DIMMs R...

Page 189: ...ice Prepare the server for cold service See Preparing the Server for Component Replacement on page 101 3 Remove the CMOD that contains the failed DIMM See Remove a CMOD on page 162 4 Remove the CMOD top cover See Remove the CMOD Cover on page 164 To remove the CMOD top cover push the release button slide the CMOD cover toward the back of the CMOD and lift it away 5 Identify and note the location o...

Page 190: ... Status indicator 2 lights if the Fault Remind circuit is operational The Fault Remind circuit remains charged for about 10 minutes after power is removed from the CMOD either by disconnecting power from the server or by removing the CMOD from the chassis When you press the Fault Remind button the Charge Status indicator lights if there is enough power to use the fault remind circuit Otherwise it ...

Page 191: ...nector 9 Remove the faulty DIMM from the CMOD Carefully lift the DIMM straight up to remove it from the socket 10 Replace each faulty DIMM with either another DIMM of the same rank size quadrank or dual rank or leave the socket empty For DIMM replacement instructions see Install a DIMM on page 192 Servicing Components 191 ...

Page 192: ...ight be adversely affected For DIMM socket population rules see DIMM Population Rules on page 185 3 Prepare the server for service Choose one of the following methods Prepare the server for warm service Prepare the server for cold service See Preparing the Server for Component Replacement on page 101 4 Access DIMMs as required Remove the CMOD See Remove a CMOD on page 162 Remove the CMOD top cover...

Page 193: ...re that the notch on the DIMM connector lines up with the key in the DIMM slot d Push the DDR4 DIMM into the connector socket until the ejector tabs lock the DIMM in place If the DIMM does not easily seat into the connector socket verify that the notch in the DIMM is aligned with the connector key in the connector socket If the notch is not aligned damage to the DIMM might occur 7 To install the D...

Page 194: ...faults are automatically cleared after a new DIMM has been installed If you need to manually clear DDR4 DIMM faults refer to the Oracle Integrated Lights Out Manager ILOM 4 0 Documentation Library at http www oracle com goto ilom docs Note If you want to move a faulty DDR4 DIMM to a new DIMM socket or re seat a DIMM for troubleshooting you must first manually clear the associated DIMM fault Otherw...

Page 195: ...eplaced only by authorized Oracle Service personnel See System Module SMOD Overview on page 34 SMOD Population Rules The Oracle Server X7 8 supports two installed SMODs Both SMOD0 System A and SMOD1 System B are accessable from the back panel See System Module SMOD Overview on page 34 Remove an SMOD Perform this procedure to access internal SMOD components such as the HBA card the internal USB por...

Page 196: ... server 3 Disengage the SMOD from the server midplane a To unlock the SMOD handles squeeze together the release latches on the end of both handles b To disengage the SMOD from the server midplane simultaneously rotate both handles downward to their fully open position This action disengages the connectors on the SMOD from the connectors on the server midplane Caution Physical harm or component dam...

Page 197: ...MOD on page 197 Install an SMOD Perform the following tasks before installing the SMOD Before You Begin Remove an SMOD on page 195 Perform this procedure after servicing internal SMOD components such as the HBA card ESM internal USB ports and system battery For component serviceability locations and designations see Identifying Components on page 24 1 Prepare the server for cold service Servicing ...

Page 198: ...ure that the handles on the SMOD are in their fully open position a Access the SMOD directly from the back of the server b To unlock the SMOD handles squeeze together the release latches on the end of both handles c To open rotate both handles downward to their fully open position 4 Orient the SMOD with the handles facing away from the server and the connectors facing toward the open slot in the s...

Page 199: ... handles up until they lock into place Caution Pinch point When operating the lever keep your fingers clear of the back side and hinged end of the lever This action draws the SMOD inward engaging the SMOD connectors with the connectors on the server midplane 8 Connect the cables to the SMOD 9 Prepare the server for operation See Returning the Server to Operation on page 237 Related Information Sys...

Page 200: ...OD motherboard Perform this procedure to replace the HBA card 1 Prepare the server for cold service This is a cold service component Power down the system and disconnect the AC power cables from the server before performing this procedure See Preparing the Server for Component Replacement on page 101 2 Remove the SMOD See Remove an SMOD on page 195 3 Set the SMOD on a flat surface with the front s...

Page 201: ...rd 7 Disconnect the energy storage module ESM extension cable from the HBA 8 Rotate the thumbscrew that secures the green release handle then pull the handle out and down to unlock the HBA card Servicing Components 201 ...

Page 202: ...to push it out from the inside 9 To disconnect the HBA card from its connector on the SMOD motherboard pull the card toward you just far enough so that you can access the SAS cables Note The two storage drive backplane cables are still attached to the card 202 Oracle Server X7 8 Service Manual October 2017 ...

Page 203: ...m the SMOD 11 Remove the HBA card from the SMOD Related Information Install the HBA Card on page 203 Install the HBA Card The host bus adapter HBA card is installed in an internal PCIe slot on the SMOD motherboard Before You Begin Remove the HBA Card on page 200 1 Position the HBA card with the component side facing up and the edge connector pointed away from you Servicing Components 203 ...

Page 204: ...ght 3 Connect the two backplane cables to the connectors on the HBA card 1 4 Align the connector on the HBA card with the PCIe slot on the SMOD motherboard and then push the HBA card into the slot 2 5 Lock the card and secure the thumbscrew 3 a To lock the card rotate the green locking lever up 204 Oracle Server X7 8 Service Manual October 2017 ...

Page 205: ...to the connector on the HBA 8 Install the storage drives See Install a Storage Drive on page 127 9 Install the SMOD See Install an SMOD on page 197 10 Prepare the server for operation See Returning the Server to Operation on page 237 11 Clear any related component faults For more information see Clear Hardware Fault Messages Oracle ILOM on page 53 Related Information Install an SMOD on page 197 Se...

Page 206: ... of the SMOD between the two disk enclosures 1 Prepare the server for cold service This is a cold service component Power down the system and disconnect the AC power cables from the server before performing this procedure See Preparing the Server for Component Replacement on page 101 2 Remove the SMOD See Remove an SMOD on page 195 3 Turn the SMOD upside down on a flat surface with the back side f...

Page 207: ...e ESM extension cable 1 5 Remove the ESM 2 by lifting it out of position The ESM is pushed to the back through the cage and then pulled the rest of the way out of position 6 Insert the new ESM into the holder so that the cable extends out the top 1 Servicing Components 207 ...

Page 208: ...e 237 Replace the ESM Extension Cable 1 Prepare the server for cold service This is a cold service component Power down the system and disconnect the AC power cables from the server before performing this procedure See Preparing the Server for Component Replacement on page 101 2 Remove the SMOD See Remove an SMOD on page 195 3 Rotate the SMOD 180 degrees so the back connector side is facing toward...

Page 209: ...connect the Energy Storage Module ESM cable from the ESM extension cable 1 5 Slide the cable out of the slot 2 6 Turn the SMOD over and locate the HBA The connector back side of the SMOD should still be facing you Servicing Components 209 ...

Page 210: ...m the clips on the enclosure wall 2 9 Remove the old ESM extension cable 10 Route the new ESM extension cable from the HBA under the support beams through the clips 2 and through the slot 3 11 Turn the SMOD over 12 Connect the ESM extension cable to the connector on the ESM 210 Oracle Server X7 8 Service Manual October 2017 ...

Page 211: ...ected to the ESM and the HBA 14 Install the SMOD See Install an SMOD on page 197 15 Prepare the server for operation See Returning the Server to Operation on page 237 Servicing the SAS Cable This section contains information about the Mini SAS4I cables Replace the SAS Cable on page 212 For component serviceability locations and designations see Identifying Components on page 24 Servicing Component...

Page 212: ...ector side is facing toward you 6 Turn the SMOD upside down and locate the HBA Note The connector back side of the SMOD should still be facing you The HBA card is located inside the SMOD and is accessible through the an upward facing opening on the right side 7 Remove the HBA card and disconnect the SAS cables See Remove the HBA Card on page 200 8 Disconnect the SAS cables from the drive backplane...

Page 213: ...ve This is an internal component that is accessible from the back of the server by removing the SMOD Perform this procedure to access and remove internal SMOD USB flash drives 1 Prepare the server for cold service This is a cold service component Power down the system and disconnect the AC power cables from the server before performing this procedure See Preparing the Server for Component Replacem...

Page 214: ...lash drives when instructed by service personnel This is an internal component accessible from the back of the server by removing SMOD0 and SMOD1 1 Prepare the server for cold service This is a cold service component Power down the system and disconnect the AC power cables from the server before performing this procedure See Preparing the Server for Component Replacement on page 101 2 Remove the S...

Page 215: ...rd Note The connector back side of the SMOD should still be facing you The internal USB flash drive port is located inside SMOD0 or SMOD1 next to the HBA card 7 Insert the drive into the USB slot 8 Install the SMOD See Install an SMOD on page 197 9 Repeat these steps for another SMOD as required 10 Prepare the server for operation See Returning the Server to Operation on page 237 Related Informati...

Page 216: ...ons see Identifying Components on page 24 1 Prepare the server for cold service This is a cold service component Power down the system and disconnect the AC power cables from the server before performing this procedure See Preparing the Server for Component Replacement on page 101 2 Remove the SMOD See Remove an SMOD on page 195 3 Set the SMOD on a flat surface with the back side facing toward you...

Page 217: ... from wall and then lift the battery up 5 To orient the replacement battery ensure that the positive side of the battery is facing toward the outside of the SMOD Make sure the positive pole is facing toward the inside of the SMOD Servicing Components 217 ...

Page 218: ...ese steps for another SMOD as required 10 Prepare the server for operation See Returning the Server to Operation on page 237 11 If necessary once the server is operational access the BIOS Setup Utility to set the clock Related Information Install an SMOD on page 197 Servicing the Front Indicator Module FRU This section includes information and procedures for servicing the server front indicator mo...

Page 219: ...Remove the FIM Access this component directly from the front of the server Remove the FIM when you need to replace it 1 Prepare the server for cold service This is a cold service component Power down the system and disconnect the AC power cables from the server before performing this procedure See Preparing the Server for Component Replacement on page 101 2 Remove the top power supply PS3 See Remo...

Page 220: ...Remove the FIM 3 To unlock the FIM reach into the vacant power supply slot locate the release latch on the underside of the FIM and push the latch up 220 Oracle Server X7 8 Service Manual October 2017 ...

Page 221: ...atch and slide the FIM completely out of its slot Related Information Install the FIM on page 221 Install the FIM 1 Position the connector end of the FIM at the opening of the slot Access this component directly from the front of the server Servicing Components 221 ...

Page 222: ...that the open side internal ribbon cable visible of the FIM is facing up 2 To install the FIM slide it into the slot until it locks and is flush with the front of the server 222 Oracle Server X7 8 Service Manual October 2017 ...

Page 223: ... after power is supplied to the server and the server is in Main power mode 6 Clear any related component faults Related Information Clear Hardware Fault Messages Oracle ILOM on page 53 Upgrade the Server from Four to Eight CMODs FRU If you have a server configured with four CMODs you can expand the server s processing capabilities by upgrading the server configuration to eight CMODs Before You Be...

Page 224: ... Prepare the server for cold service Access CMODs behind the FMs using a warm or cold service procedure See Preparing the Server for Component Replacement on page 101 2 Remove all eight fan modules See Remove a Fan Module on page 131 3 Remove both fan frames See Remove a Fan Frame on page 136 In a four CPU configuration the four CMOD slots on the right side of the server are vacant Call Out Descri...

Page 225: ...iption on page 17 d Ensure that the DIMM configuration matches the installed CMODs For DIMM configuration information see DIMM Population Rules on page 185 e Replace the CMOD cover See Install the CMOD Cover on page 166 Lower the cover onto the CMOD To install the CMOD cover align the standoffs on the inside of the cover with the slots in the CMOD chassis This position leaves a gap between the lea...

Page 226: ...idplane and bus bar assembly This is a cold service procedure Power down the system and disconnect all power cables before removing the server access panels This procedure requires a Phillips screwdriver and a mechanical lift Do not lift the server manually Use a mechanical lift instead 1 Prepare the server for cold service This is a cold service component Power down the system and disconnect the ...

Page 227: ... to the original locations c Remove all eight DPCCs See Remove a DPCC on page 151 Before removing the DPCCs label each one populated with PCIe cards noting its slot location For slot designations see Identifying Components on page 24 4 Remove the eight screws that secure the server to the rack at the front of the server 5 Use a lift to remove the server from the rack The midplane assembly is locat...

Page 228: ...ve the panel 7 Carefully remove and retain the protective black plastic insert that covers the top of the midplane assembly Note the orientation of the insert with respect to the opening The insert is fitted to the opening using tabs and flaps 228 Oracle Server X7 8 Service Manual October 2017 ...

Page 229: ...des access to five cables four 20 pin PS cables and one 8 pin cable for the AC power indicator LEDs that are routed through the server and are connected to the backside of the midplane assembly To remove the midplane assembly disconnect these connectors As an aid a label on the side of the chassis shows the arrangement and labeling of the five connectors Servicing Components 229 ...

Page 230: ...Replace the Midplane Assembly The following illustration shows a portion of the label The following illustration shows the label 230 Oracle Server X7 8 Service Manual October 2017 ...

Page 231: ... the back of the midplane assembly Tip To see the connectors direct the light from a flashlight through the small opening in the top access just above the cable connect points The following illustration shows the location and arrangement of the connectors on the back of the midplane Servicing Components 231 ...

Page 232: ...s opening The cables inside the chassis should lie flat so they are not damaged during the installation of the replacement midplane assembly 12 Align and position the replacement midplane assembly in the opening in the top of the server 13 Carefully lower the midplane assembly into the server until the top of the assembly is flush with the top of the server 232 Oracle Server X7 8 Service Manual Oc...

Page 233: ...bly into the server 14 Connect the five cables to the connectors on the back of the midplane assembly Ensure that the connectors are positioned correctly so the key protrusion on the side of the connector is aligned with the notch in the connector on the midplane assembly For best access Servicing Components 233 ...

Page 234: ...sibility first attach the cable labeled PS 0 then PS 2 followed by PS 1 and finally PS 3 Attach the cable for the AC power indicator board last The following illustration shows the label 234 Oracle Server X7 8 Service Manual October 2017 ...

Page 235: ... Ensure that the orientation of the insert is correct The insert is fitted to the opening using tabs and flaps 18 Align the top access cover with the opening in the top of the chassis 19 To secure the cover to the chassis tighten the 19 captive screws 20 Install the chassis in the rack 21 Replace components at the front of the server a Install the CMODs See Install a CMOD on page 167 Your server m...

Page 236: ...SMODs See Install an SMOD on page 197 b Install all eight DPCCs See Install a DPCC on page 158 For slot designations see Identifying Components on page 24 c Attach cables to their respective connectors and ports at back side of the server 23 Prepare the server for operation See Returning the Server to Operation on page 237 24 Update the TLI FRUPROM data containers Service needs to manually reprogr...

Page 237: ...e 1 Remove Antistatic Measures 1 Remove any antistatic straps or conductors from the server chassis 2 Remove the antistatic wrist strap from yourself 2 Ensure that all external front and back components are fully installed 3 Ensure that all cables are connected to the back of the server 4 Connect all AC power cables to their inlets on the back of the server and verify that they are locked The reta...

Page 238: ... Server When AC power is applied to the server power inlets the server boots into standby power mode For information see Server Boot Process and Normal Operating State Indicators on page 73 Use the following procedure to reapply main power for all server components 1 Ensure that the server is in standby power mode 2 To power on the server do one of the following From the front of the server press ...

Page 239: ...BIOS Setup Utility and Oracle ILOM For information about using these tools to manage the BIOS configuration refer to Oracle ILOM Maintaining x86 BIOS Configuration Parameters in the Oracle ILOM Administrator s Guide for Configuration and Maintenance Firmware Release 4 0 in the Oracle Integrated Lights Out Manager ILOM 4 0 Documentation Library at http www oracle com goto ilom docs BIOS Setup Utili...

Page 240: ...IO Manage configuration settings for I O devices such as I O virtualization settings and enable and disable Option ROMs Boot Configure the boot device priority Save Exit Save changes and exit discard changes and exit discard changes or restore the default BIOS settings See BIOS Setup Utility Menu Options on page 269 for examples of each of these screens Related Information Navigate BIOS Setup Util...

Page 241: ... panel of the server Connect to the server using the Oracle ILOM Remote System Console Plus application 1 Reset or power on the server For example to reset the server From the local server press the On Standby button on the front panel of the server to power off the server and then press the On Standby button again to power on the server From the Oracle ILOM web interface click Host Management Pow...

Page 242: ...gate BIOS Setup Utility Menus To navigate the menus or options listed on a menu use the arrow keys The currently selected option or sub menu is highlighted For further instructions on how to navigate and change settings in the BIOS Setup Utility refer to the online information provided on the menu 1 Access the BIOS Setup Utility 242 Oracle Server X7 8 Service Manual October 2017 ...

Page 243: ...s in the right column 4 Modify an option by pressing the or plus or minus keys or by pressing Enter and selecting the desired option from the pop up menus 5 Press the Esc key to return from a sub menu screen to the previous menu screen Pressing Esc from a top level menu is equivalent to selecting the Discard Changes and Exit option from the Save Exit Menu 6 Modify parameters as needed 7 Press the ...

Page 244: ...enu as part of the standard BIOS Setup Utility screens For example if the Oracle Storage 12 Gb SAS PCIe RAID HBA Internal card is installed in the server the configuration utility for the HBA appears as a menu selection Configure and Manage BIOS Using Oracle ILOM Oracle Integrated Lights Out Manager ILOM includes BIOS configuration and management tools You can perform the following BIOS configurat...

Page 245: ... enabled TXT ensures that the operating system OS starts in a trusted environment and provides the OS with additional security capabilities not available to an untrusted OS Using cryptographic techniques TXT provides measurements of software and platform components so that system software as well as local and remote management applications may use those measurements to make trust decisions Trusted...

Page 246: ...m the local server press the On Standby button on the front panel of the server to power off the server and then press the On Standby button again to power on the server From the Oracle ILOM web interface click Host Management Power Control and select Reset from the Select Action list Click Save and then click OK From the Oracle ILOM CLI type reset System 2 After the server resets when prompted pr...

Page 247: ...specified using the F2 key will be in effect after booting from the temporary boot device 1 Reset or power on the server For example to reset the server From the local server press the On Standby button on the front panel of the server to power off the server and then press the On Standby button again to power on the server From the Oracle ILOM web interface click Host Management Power Control and...

Page 248: ...ation Accessing the BIOS Setup Utility on page 239 BIOS Setup Utility Menu Options on page 269 BIOS Key Mappings on page 240 Exit BIOS Setup Utility on page 267 Configure TPM Support If you intend to use the Trusted Platform Module TPM feature set you must configure the server to support this feature TPM support is enabled by default on Oracle Server X7 8 Perform the procedure in this section to d...

Page 249: ...dor 1 Access the BIOS Setup Utility menus See Access BIOS Setup Utility Menus on page 241 2 In the BIOS Setup Utility menus navigate to the Advanced Menu 3 On the Advanced Menu screen select Trusted Computing 2 0 4 On the Trusted Computing 2 0 Configuration screen select Security TPM Device Support and press Enter Do one of the following Select Disable to disable Security TPM Device Support Select...

Page 250: ... Setup Utility on page 239 BIOS Setup Utility Menu Options on page 269 Exit BIOS Setup Utility on page 267 Microsoft s Windows Trusted Platform Module Management documentation Configure UEFI Driver Settings 1 Access the BIOS Setup Utility menus See Access BIOS Setup Utility Menus on page 241 2 In the BIOS Setup Utility menus navigate to the IO Menu 250 Oracle Server X7 8 Service Manual October 201...

Page 251: ...he IO Menu screen select either Internal Devices or Add In Cards and press Enter to display the internal device or add in card slot for which you want to enable or disable the PCI E UEFI Driver Setting Up BIOS Configuration Parameters 251 ...

Page 252: ... press Enter Do one of the following Select Enabled to enable the PCI E UEFI Driver setting Select Disabled to disable the PCI E UEFI Driver setting 6 Press the F10 key to save the changes and exit the BIOS Setup Utility Related Information Accessing the BIOS Setup Utility on page 239 BIOS Setup Utility Menu Options on page 269 Exit BIOS Setup Utility on page 267 252 Oracle Server X7 8 Service Man...

Page 253: ...cation Configure I O Resource Allocation 1 Access the BIOS Setup Utility menus See Access BIOS Setup Utility Menus on page 241 2 In the BIOS Setup Utility menus navigate to the IO Menu Setting Up BIOS Configuration Parameters 253 ...

Page 254: ...Configure I O Resource Allocation 3 On the IO Menu screen select Add In Cards and press Enter to display the add in card slots 254 Oracle Server X7 8 Service Manual October 2017 ...

Page 255: ...r Do one of the following Select Enabled to enable I O resource allocation for the I O card Select Disabled to disable I O resource allocation for the I O card 6 Press the F10 key to save the changes and exit the BIOS Setup Utility Related Information Accessing the BIOS Setup Utility on page 239 BIOS Setup Utility Menu Options on page 269 Exit BIOS Setup Utility on page 267 Setting Up BIOS Configu...

Page 256: ...oot Configure UEFI Secure Boot 1 Access the BIOS Setup Utility menus See Access BIOS Setup Utility Menus on page 241 2 On the Main Menu screen select Security and press Enter 256 Oracle Server X7 8 Service Manual October 2017 ...

Page 257: ...led to disable UEFI Secure Boot Continue with Step 8 to save changes and exit from the BIOS Setup Utility When enabled Secure Boot allows you to manage Secure Boot policy variables 5 To manage Secure Boot policy variables select Key Management and press Enter The Key Management screen provides options to provision factory default Secure Boot keys or to enroll an Extensible Firmware Interface EFI i...

Page 258: ...actory default keys select Provision Factory Defaults and press Enter Do one of the following Select Enabled to allow the provisioning of factory default Secure Boot keys when the system is in Setup Mode When enabled you can select Install 258 Oracle Server X7 8 Service Manual October 2017 ...

Page 259: ...system to User Mode and install all the factory default Secure Boot keys Select Disabled to disable the provisioning of factory default Secure Boot keys When disabled you can select Delete all Secure Boot Variables to Setting Up BIOS Configuration Parameters 259 ...

Page 260: ...Configure UEFI Secure Boot remove all Secure Boot keys from the system Selecting this option also resets the system to Setup Mode 260 Oracle Server X7 8 Service Manual October 2017 ...

Page 261: ...Configure UEFI Secure Boot 7 If you want to enroll an EFI image select Enroll Efi Image and press Enter Setting Up BIOS Configuration Parameters 261 ...

Page 262: ...figure UEFI Secure Boot a On the Select a File System screen Scroll through the list and select the file system that contains the EFI file and press Enter 262 Oracle Server X7 8 Service Manual October 2017 ...

Page 263: ...rough the list and select the EFI file or another available file and press Enter c On the next Select File screen scroll through the list and select the image file that you want to run in Secure Boot mode and press Enter Setting Up BIOS Configuration Parameters 263 ...

Page 264: ...e EFI file and press Enter The Secure Boot policy variables are saved to the root folder in the target file system 8 Press the F10 key to save the changes and exit the BIOS Setup Utility Related Information Accessing the BIOS Setup Utility on page 239 BIOS Setup Utility Menu Options on page 269 UEFI Secure Boot on page 245 Exit BIOS Setup Utility on page 267 264 Oracle Server X7 8 Service Manual O...

Page 265: ...eature must be enabled on your server before enabling Trusted Execution Technology TXT See Configure TPM Support on page 248 1 Access the BIOS Setup Utility menus See Access BIOS Setup Utility Menus on page 241 2 On the Main Menu screen select Security and press Enter Setting Up BIOS Configuration Parameters 265 ...

Page 266: ...o enable TXT Select Disabled to disable TXT 5 Press the F10 key to save the changes and exit the BIOS Setup Utility Related Information Accessing the BIOS Setup Utility on page 239 BIOS Setup Utility Menu Options on page 269 Trusted Execution Technology on page 245 Configure Trusted Execution Technology on page 265 Exit BIOS Setup Utility on page 267 266 Oracle Server X7 8 Service Manual October 2...

Page 267: ...ceed and exit the BIOS Setup Utility or select No to stop the exit process Note After modifying any BIOS settings the subsequent reboot might take longer than a typical reboot where no settings were modified The additional delay is required to ensure that changes to the BIOS settings are synchronized with Oracle ILOM Related Information Accessing the BIOS Setup Utility on page 239 BIOS Setup Utili...

Page 268: ...268 Oracle Server X7 8 Service Manual October 2017 ...

Page 269: ...ot Menu Selections on page 290 BIOS Save and Exit Menu Selections on page 292 Related Information Oracle X7 Series Servers Administration Guide at http www oracle com goto x86admindiag docs Setting Up BIOS Configuration Parameters on page 239 BIOS Main Menu Selections This section includes a screen of the BIOS Main Menu The options that are available from the Main Menu are described in the table t...

Page 270: ...sion is displayed This string is a unique identifier used to reference a specific BIOS release Format is XXYYZZPP which indicates XX Unique project platform code YY BIOS major release ZZ BIOS minor release PP Build number Example 42 01 04 01 System Date Current date is displayed You can change the date setting Example Thu 06 20 2017 270 Oracle Server X7 8 Service Manual October 2017 ...

Page 271: ...e Revision R O The service processor firmware version is displayed Example 4 0 0 0 r115197 PRODUCT INFORMATION R O Product information is displayed Product Name Product name is displayed Example Oracle Server X7 8 Product Serial Number Product serial number is displayed Example 1134FML00V Board Serial Number Board serial number is displayed Example 489089M 1637E2002E CPU INFORMATION R O Attributes...

Page 272: ...L1 Data Cache Example 32 KB x 28 L1 Code Cache Example 32 KB x 28 L2 Cache Example 1024 KB x 28 L3 Cache Example 39424 KB Socket 1 through Socket 7 CPU Information R O If populated the same options as Socket 0 CPU Information are displayed Otherwise displays Not Present DIMM INFORMATION R O Memory module DIMM presence and size information are displayed Processor 0 DIMMs R O For D0 D11 if a DIMM is...

Page 273: ...oll Efi Image Enrolls an EFI image to run in Secure Boot mode Save all Secure Boot variables Saves all Secure Boot variables to the root folder in the chosen file system Platform Key PK Save to File Set New Erase Enroll factory defaults or load certificates from a file Key Exchange Keys Save to File Set New Append Erase Enroll factory defaults or load certificates from a file Authorized Signatures...

Page 274: ...e changed The following sections describe the BIOS Advanced Menu options BIOS Advanced Menu iSCSI Configuration Options on page 275 BIOS Advanced Menu Gigabit Network Connection Options on page 277 BIOS Advanced Menu Driver Health Options on page 278 BIOS Advanced Menu Serial Port Console Redirection Options on page 278 BIOS Advanced Menu Network Stack Configuration Options on page 280 BIOS Advanc...

Page 275: ... unique name of the iSCSI Initiator Only IQN format is accepted Add an Attempt iSCSI Attempt Name NA must be specified None The human readable name that you assigned to this attempt iSCSI Mode Disabled Enabled Enabled for MPIO Disabled Set to Enabled for multipath I O MPIO MPIO can boost the performance of an application by load balancing traffic across multiple ports Internet Protocol IP4 IP6 Aut...

Page 276: ...on Target Name NA NA The worldwide unique name of the target Only IQN format is accepted Target IP address 0 0 0 0 None Use to set target IP address in dotted decimal notation Target Port 3260 Use to change target port number Boot LUN 0 Use to set the hexadecimal representation of the boot logical unit number LUN Example 4752 3A4F 6b7e 2F99 Authentication Type CHAP None CHAP Define the Challenge H...

Page 277: ...ed for the selected boot protocol Wake on LAN Disable Enabled NA Use this option to enable or disable wake on LAN Blink LEDs 0 1 2 3 0 Use to identify the physical network port by blinking the associated LED UEFI Driver R O NA NA Identifies the UEFI driver Adapter PBA R O NA NA Product board adapter PBA number You can use the Intel Network Adapter PBA number to search for the adapter s model numbe...

Page 278: ...es that are populating your PCIe slots you will see different entries if the devices are publishing their driver health status Setup Options Options Defaults Description Intel PRO 1000 PCI E R O Healthy Lists the health status of drivers controllers Apache Pass Driver R O Healthy Lists the health status of drivers controllers Intel 40GbE Healthy Lists the health status of drivers controllers Contr...

Page 279: ...ters onto one or more bytes ANSI Extended ASCII character set Bits per Second 9600 19200 38400 57600 115200 9600 Select the serial port transmission speed The speed must be matched on the connecting serial device Long or noisy lines require lower speeds Data Bits 7 8 8 Select the data bits Parity None Even Odd Mark Space None A parity bit can be sent with the data bits to detect some transmission ...

Page 280: ...Advanced Menu Network Stack Configuration Options The following table describes the BIOS Advanced Menu network stack options Setup Options Options Defaults Description Network Stack Disabled Enabled Enabled Enable or disable the UEFI network stack Ipv4 PXE Support Disabled Enabled Enabled Enable or disable IPv4 PXE Boot support If disable the IPv4 PXE Boot Option will not be created Ipv4 HTTP Supp...

Page 281: ...unction for the NVMe controller Nvme Size R O N A Displays the size of the NVMe device BIOS Advanced Menu Primary Video Selection Options The following table describes the BIOS Advanced Menu primary video selection options Setup Options Options Defaults Description Add in Video Card support Disabled Enabled Enabled Use this option to enable or disable video card support BIOS Advanced Menu Trusted ...

Page 282: ...urity device Note Your computer will reboot during restart in order to change the state of a security device Platform Hierarchy Disabled Enabled Use this option to enable or disable platform hierarchy Storage Hierarchy Disabled Enabled Use this option to enable or disable storage hierarchy Endorsement Hierarchy Disabled Enabled Use this option to enable or disable endorsement hierarchy TPM 2 0 UEF...

Page 283: ... streamer prefetcher MSR 1A4h bit 1 DCU Streamer Prefetcher Disabled Enabled Enabled Enable DCU streamer prefetcher which is a L1 data cache prefetcher MSR 1A4h 2 DCP IP Prefetcher Disabled Enabled Enabled Enable DCU IP prefetcher which is a L1 data cache prefetcher MSR 1A4h 3 Intel Virtualization Technology Disabled Enabled Enabled When enabled a Virtual Machine Manager VMM can utilize the additi...

Page 284: ...ble or disable Enhanced Intel SpeedStep Technology EIST Turbo Mode Enabled Disabled Enabled Enabled mode is supported only if Turbo Mode is supported in the CPU Enabled mode also requires that Enhanced Multi Threaded Thermal Monitoring EMTTM be enabled on the CPU CPU C3 report Enabled Disabled Disabled Enable disable the CPU C3 ACPI C3 report to the operating system CPU C6 report Enabled Disabled ...

Page 285: ...upport Enable this setting for the complete USB keyboard legacy support for non USB aware operating systems Rear Port Disabled Enabled Enabled Enable or disable USB Rear Port Internal Port 0 Disabled Enabled Enabled Enable or disable USB Internal Port 0 BIOS Advanced Menu Error Injection Settings Option The following table describes the BIOS Advanced Menu error injection settings options Setup Opt...

Page 286: ...include NVMe and M 2 Related Information BIOS Main Menu Selections on page 269 BIOS IO Menu Selections on page 286 BIOS Boot Menu Selections on page 290 BIOS Save and Exit Menu Selections on page 292 BIOS IO Menu Selections This section includes a screen of the BIOS IO Menu The options that are available from the IO Menu are described in the sections that follow 286 Oracle Server X7 8 Service Manu...

Page 287: ...S IO Menu Internal Devices Options on page 289 BIOS IO Menu Add in Cards Options on page 290 BIOS IO Menu PCI Subsystem Settings Options The following table describes the BIOS IO Menu PCI subsystem settings options Setup Options Options Defaults Description PCI 64 Bit Resources Allocation Disabled Enabled Enabled Enable or disable 64 bit capable devices to be decoded in above 4G address space This...

Page 288: ...enu IO virtualization options Setup Options Options Defaults Description VT d Disabled Enabled Enabled Enable or disable Intel Virtualization Technology for directed I O VT d by reporting the I O device assignment to VMM through DMA remapping reporting DMAR Advance Configuration Power Interface ACPI tables ACS Disabled Enabled Disabled If disabled programs ACS only to Chipset PCIe Root Port Bridge...

Page 289: ...nable or disable direct cache access DCA support BIOS IO Menu Internal Devices Options The following table describes the BIOS IO Menu internal devices options Setup Options Options Defaults Description NET 0 Displays and provides options to change the internal device settings PCI E UEFI Driver Enable Disabled Enabled Enabled Enable or disable PCI E UEFI Driver If set to enabled UEFI Driver for the...

Page 290: ...If set to disabled UEFI Driver for the card is not copied into memory and the execution of the UEFI Driver is inhibited Hot Plug Capable Disabled Enabled Enabled Specifies if the link is Hot Plug capable Slot 2 through Slot 16 Same description as Slot 1 Related Information BIOS Main Menu Selections on page 269 BIOS Advanced Menu Selections on page 274 BIOS Boot Menu Selections on page 290 BIOS Sav...

Page 291: ...tries the PXE list present in the system when all PXE attempts have failed If set to disabled the system halts and displays the error message Network Boot Failed when all PXE boots failed If set to Boot List fail over to the main Boot Options Priority list UEFI Boot Option Priority Displays and sets the system boot order Related Information BIOS Main Menu Selections on page 269 BIOS Advanced Menu ...

Page 292: ...he BIOS Exit Menu The options that are available from the Exit Menu are described in the table that follows Setup Options Description Save Changes and Exit Save changes and exit the BIOS Setup Utility Discard Changes and Exit Exit the BIOS Setup Utility without saving changes Discard Changes Discard any changes made to the setup options 292 Oracle Server X7 8 Service Manual October 2017 ...

Page 293: ... Restore load the optimal default values for all of the setup options Related Information BIOS Main Menu Selections on page 269 BIOS Advanced Menu Selections on page 274 BIOS IO Menu Selections on page 286 BIOS Boot Menu Selections on page 290 BIOS Setup Utility Menu Options 293 ...

Page 294: ...294 Oracle Server X7 8 Service Manual October 2017 ...

Page 295: ... health status of system components From the Oracle ILOM web interface or in the Oracle ILOM command line interface CLI you can collect system specific information about the server determine the health state of discrete components and view any open problems on the server Oracle ILOM automatically detects system hardware faults and environmental conditions on the server If a problem occurs on the s...

Page 296: ...cated by the boldface portion of the component name IPMI Type Indicates the type of sensor indicator or FRU represented Description Describes the particular component name reference Values Defines the states of the sensor indicator or FRU entity and any specific units or values that are expected if applicable Note Some component names are hidden in the Oracle ILOM user interfaces These names are m...

Page 297: ...SYS SMOD 0 1 SYS SMOD0 SYS SMOD1 System Modules SYS SMOD 0 1 DBP SYS SMOD0 DBP SYS SMOD1 DBP Disk Backplanes Dynamic FRUID SYS SMOD 0 1 MB SYS SMOD0 MB SYS SMOD1 MB System Module Dynamic FRUID SYS SMOD 0 1 MB NET 0 3 SYS SMOD0 MB NET 0 3 SYS SMOD1 MB NET 0 3 System Host Network Interfaces Static FRUID SYS SMOD 0 1 MB BIOS SYS SMOD0 MB BIOS SYS SMOD1 MB BIOS System BIOS SYS SMOD 0 1 MB CPLD SYS SMO...

Page 298: ...1x8 Name 2x4 A Side Name 2x4 B Side Description SYS OK A Side B side disabled SYS OK SYS OK System OK Color Green Location FIM Front Panel and SMOD Rear Panel Standby Blink power is off Slow Blink BIOS post On Host OS booting or booted SYS SERVICE A Side B side disabled SYS SERVICE SYS SERVICE Service Summary Color Amber Location FIM Front Panel and SMOD Rear Panel On System has fault Off System h...

Page 299: ... name CMODx P 0 3 Dxx SVC SYS CMOD 4 7 P 4 7 D 0 11 SERVICE IPMI short name CMODx P 4 7 Dxx SVC Memory Service Color Amber Location CMOD board On DIMM has fault Off DIMM has no fault SYS SMOD 0 1 SERVICE SYS SMOD0 SERVICE SYS SMOD1 SERVICE SMOD Fault Color Amber Location SMOD Back Panel On SMOD has fault Off SMOD has no fault SYS SMOD 0 1 OK SYS SMOD0 OK SYS SMOD1 OK SMOD OK Color Green Location S...

Page 300: ...System Sensors Network Access Control NAC Names This section includes information for system sensors Name 1x8 Name 2x4 A Side Name 2x4 B Side Description SYS ACPI SYS ACPI SYS ACPI Discrete Host power state hidden 01h host is on 20h host is off SYS PS_REDUNDANCY SYS PS_REDUNDANCY SYS PS_REDUNDANCY Discrete PS Redundancy status 00h fully redundant 02h degraded redundancy 03h non redundant 05h insuf...

Page 301: ...DPCC SYS CMOD 4 7 T_IN_DPCC Threshold Inlet air temperature to the DPCC connector Degree in C SYS CMOD 0 7 T_IN_HDD SYS CMOD 0 3 T_IN_HDD SYS CMOD 4 7 T_IN_HDD Threshold Inlet air temperature to the HDD Disk Riser Degree in C SYS CMOD 0 7 T_OUT_CPU SYS CMOD 0 3 T_OUT_CPU SYS CMOD 4 7 T_OUT_CPU Threshold CMOD temperature behind CPU Degree in C SYS SMOD 0 1 MB T_IN SYS SMOD0 MB T_IN SYS SMOD1 MB T_I...

Page 302: ...old PS inlet temperature Volts SYS PS 0 3 V_12V SYS PS 2 3 V_12V SYS PS 0 1 V_12V Threshold PS main output voltage Volts SYS PS 0 3 V_12V_STBY SYS PS 2 3 V_12V_STBY SYS PS 0 1 V_12V_STBY Threshold PS standby output voltage Volts SYS PS 0 3 V_IN SYS PS 2 3 V_IN SYS PS 0 1 V_IN Threshold PS input voltage Volts 302 Oracle Server X7 8 Service Manual October 2017 ...

Page 303: ... function keys 240 IO screen 286 Main screen 269 menus accessing 241 navigating menu options 242 Save and Exit screen 292 setup screens summary 240 shortcut key sequences 240 TPM support 248 UEFI BIOS 244 boot device selecting 247 buttons Fault Remind 172 Power 114 116 C Charge Status indicator 55 clearing faults 53 CLI controlling the Locate Button LED indicator 120 121 cold service preparing the...

Page 304: ...removing 189 supported configurations 185 disk drive backplanes description 27 dual PCIe card carrier DPCC installing 158 location 89 overview 42 43 reference 149 removing 151 slot designations 149 E electrostatic discharge ESD prevention measures 98 equipment and tools servicing 100 Ethernet connecting cables 90 port device naming 93 Ethernet ports booting priority 93 device and driver naming 93 ...

Page 305: ...LED 120 121 121 back panel 45 front panel 60 Over Temperature 60 Power OK back panel 45 front panel 60 Service Action Required back panel 45 front panel 60 SMOD 45 65 SP back panel 45 front panel 60 troubleshooting 59 installing CMOD 167 CMOD cover 166 DIMM 192 DPCC 158 fan frame 137 fan module 133 FIM 221 HBA 203 PCIe card 155 PS 144 SMOD 197 storage drive 127 USB flash drive internal 214 install...

Page 306: ... slot numbering 149 power button 114 116 modes shutdowns and resets 118 removal 111 subsystem 83 power down server emergency 116 gracefully 112 with Power button 114 power off the system 111 111 power supply description 26 LEDs 139 141 power supply PS installing 144 removing 141 slot designations 140 powering off graceful 111 immediate 111 power removal 119 server OS 117 powering on server 238 pro...

Page 307: ...acefully using Oracle ILOM CLI 112 gracefully using Oracle ILOM web interface 113 gracefully using the Power button 114 immediately using Oracle ILOM CLI 115 immediately using Oracle ILOM web interface 116 immediately using the Power button 116 SMOD indicators and switches 65 Standby power 117 118 static prevention anti static mat 98 anti static wrist strap 98 stop command 112 storage drive backpl...

Page 308: ...9 Trusted Execution Technology TXT description 245 enabling and disabling 265 Trusted Platform Module TPM enabling and disabling 248 U UEFI driver enabling and disabling 250 UEFI Secure Boot description 245 enabling and disabling 256 upgrading the server 223 USB flash drive internal installing 214 removing 213 USB ports internal 38 W warm service preparing the server Oracle ILOM CLI 105 Oracle ILO...

Search results

Summary of Contents for X7-8

Reviews:

Brands by name

Popular brands

Oracle X7-8, Service Manual

Search results

Summary of Contents for X7-8

Reviews:

Brands by name

Popular brands