background image

R281-T91

R281-T94

Dual ThunderX2 Processors ARM Server

Service Guide

Rev. 1.0

Summary of Contents for R281-T91

Page 1: ...R281 T91 R281 T94 Dual ThunderX2 Processors ARM Server Service Guide Rev 1 0 ...

Page 2: ...cations Inordertoassistintheuseofthisproduct GIGABYTEprovidesthefollowingtypesofdocumentations For detailed product information carefully read the User s Manual For More Information For related product specifications the latest firmware and software and related information please visit ourwebsiteat http www gigabyte com For GIGABYTE distributors and resellers additional sales marketing materials a...

Page 3: ...guide NOTE Gives bits and pieces of additional information related to the current topic CAUTION Gives precautionary measures to avoid possible hardware or software problems WARNING Alerts you to any damage that might result from doing or not doing specific actions ...

Page 4: ...ticular attention to the plug electrical outlet and the point where the cord extends from the server WARNING To reduce the risk of personal injury from hot surfaces allow the drives and the internal system components to cool before touching them WARNING This server is equipped with high speed fans Keep away from hazardous moving fan blades during servicing CAUTION Do not operate the server for lon...

Page 5: ...scharge ESD and ESD protection ESD can damage drives boards and other parts We recommend that you perform all procedures in this chapter only at an ESD workstation If one is not available provide some ESD protection by wearing an antistatic wrist strap attached to chassis ground any unpainted metal surface on the server when handling parts ESD and handling boards Always handle boards carefully The...

Page 6: ...on if battery is replaced incorrectly or with an incorrect type Replace the battery only with the same or equivalent type recommended by the manufacturer Dispose of used bat teries according to the manufacturer s instructions ...

Page 7: ...oving and Installing Memory 24 3 3 1 Eight Channel Memory Configuration 24 3 3 2 Removing and Installing a Memory Module 25 3 3 3 DIMM Population Table 25 3 4 Removing and Installing the PCI Expansion Card 26 3 5 Removing and Installing the Hard Disk Drive 28 3 6 Replacing the Fan Assembly 29 3 7 Removing and Installing the Power Supply 30 3 8 Cable Routing 31 Chapter 4 Motherboard Components 35 4...

Page 8: ...on 54 5 2 11 MAC IPv6 Network Configuration 55 5 3 Chipset Setup Menu 56 5 4 Security Menu 57 5 5 Boot Menu 58 5 5 1 UEFI Application Boot Priorities 60 5 5 2 UEFI NETWORK Drive BBS Priorities 61 5 6 Save Exit Menu 62 5 7 Server Management Menu 64 5 7 1 System Event Log 65 5 7 2 View Self Test Log 66 5 7 3 View FRU Information 67 5 7 4 BMC Network Configuration 68 ...

Page 9: ...s dry and first touch a metal object to eliminate static electricity Prior to installing the motherboard please have it on top of an antistatic pad or within an electrostatic shielding container Before unplugging the power supply cable from the motherboard make sure the power supply has been turned off Before turning on the power make sure the power supply voltage has been set according to the loc...

Page 10: ... with 1DPC DDR4 2400 with 2DPC LAN 2 x 10Gb s SFP LAN ports QLogic QL41102 1 x 10 100 1000 management LAN port Expansion Slot Riser Card CRS2131 1 x PCIe x16 slot Gen3 x16 or x8 Full height half length 1 x PCIe x8 slots Gen3 x0 or x8 Full height half length 1 x PCIe x8 slots Gen3 x8 Full height half length Riser Card CRS2132 1 x PCIe x16 slot Gen3 x16 or x8 Full height half length 1 x PCIe x8 slot...

Page 11: ...r supply connectors 2 x SlimSAS connectors 2 x SATA 7 pin connectors 1 x USB 3 0 header 1 x Front panel header 1 x HDD back plane board header 1 x PMBus connector 1 x IPMB connector 1 x Clear CMOS switch 1 x BIOS recovery switch Front Panel LED Buttons 2 x USB 3 0 1 x Power button with LED 1 x ID button with LED 1 x Reset button 1 x System status LED 1 x HDD activity LED 2 x LAN activity LEDs Rear...

Page 12: ...rial Over LAN vKVM vMedia HTML5 Power Supply 2 x 1200W redundant PSUs 80 PLUS Platinum AC Input 100 240V 12 7A 50 60Hz DC Input 240Vdc 6A DC Output Max 1000W 100 240V 12V 80 5A 12Vsb 3A Max 1200W 200 240V or 240Vdc input 12V 97A 12Vsb 3A Environment Ambient Temperature Relative Humidity Operating temperature 10 C to 35 C Non operating temperature 40 C to 60 C Operating humidity 8 80 non condensing...

Page 13: ...X16 USB3 0 X2 USB3 0 X2 PCIe3 0 x8 PCIe3 0 x16 8 Channels DDR4 2666 2400 2133 MHz 2666 2400 2133 MHz CCPI2 x 24 25G s OCP1 PCIe x16 OCP2 PCIe x16 RTL8211E PHY PCIe3 0 x16 PCIe3 0 x8 PCIe3 0 x16 Switch PCIe x16 PCIe x8 PCIe x8 CRS2131 Switch PCIe x16 PCIe x8 PCIe x8 CRS2132 Switch PCIe x8 PCIe x16 CRS2124 CN9975 DDR 8 IMC CPU_1 2 x SATAIII 2 x SlimLine SAS3008 SAS Expander CN9975 DDR 8 IMC CPU_0 Re...

Page 14: ...Hardware Installation 14 This page intentionally left blank ...

Page 15: ... Server management LAN port Refer to Chapter 2 4 Rear System LAN LEDs for a detailed description of the function of the LEDs 1 2 3 HDD 0 HDD 1 HDD 2 HDD 3 HDD 4 HDD 5 HDD 6 HDD 7 HDD 8 HDD 9 HDD 10 HDD 11 HDD 12 HDD 13 HDD 14 HDD 15 HDD 16 HDD 17 HDD 18 HDD 19 HDD 20 HDD 21 HDD 22 HDD 23 1 2 3 HDD 0 HDD 1 HDD 2 HDD 3 HDD 4 HDD 5 HDD 6 HDD 7 HDD 8 HDD 9 HDD 10 HDD 11 HDD 12 HDD 13 HDD 14 HDD 15 HDD...

Page 16: ...ernate mode 4 ID Button with LED Blue On Indicates the system identification is active N A Off Indicates the system identification is disabled 5 HDD Status LED Green On Indicates locating the HDD Blink Indicates accessing the HDD Amber On Indicates HDD error Green Amber Blink Indicates HDD rebuilding N A Off Indicates no HDD access or no HDD error 6 System Status LED Green On Indicates system is o...

Page 17: ...cates data trasmission or receiving is occuring N A Off Indicates no data transmission or receiving is occuring 8 LAN2 Active Link LED Green On Indicates a link between the system and the network or no access Green Blink Indicates data trasmission or receiving is occuring N A Off Indicates no data transmission or receiving is occuring ...

Page 18: ...ystem and network or no access Blink Data transmission or receiving is occurring N A Off No data transmission or receiving is occurring 3 1GbE Speed LED Yellow On 1 Gbps data rate Green On 100 Mbps data rate N A Off 10 Mbps data rate 4 1GbE Link Activity LED Green On Link between system and network or no access Blink Data transmission or receiving is occurring N A Off No data transmission or recei...

Page 19: ...Amber OFF OFF Amber OFF Removed HDD Slot LED on Back Panel Green ON 1 OFF Green Amber OFF OFF Amber RAID configuration via HW RAID Card or SW RAID Card Disk LED Green ON OFF Alternately OFF Amber OFF ON Low Speed 2 Hz OFF Removed HDD Slot Green ON 1 OFF 3 Amber OFF ON 3 NOTE 1 Depends on HBA Utility Spec 2 Blink cycle depends on HDD s activity signal 3 If HDD is pulled out during rebuilding the di...

Page 20: ...C power to all power supplies Green BLINKING 1 Sec On 1 Sec Off 0 5Hz Standby Mode normal Green BLINKING 0 25 Sec On 0 25 Sec Off 2Hz PSU Sleep Mode cold Redundant Offline mode Amber Standby Mode with OTP range 12V Fault OVP UVP OCP SCP and OTP Power Supply fan lock 15 seconds including Standby mode Amber 3 ...

Page 21: ...ver you are working inside the computer case If possible wear a grounded wrist strap when you are working inside the computer case Alternatively discharge any static electricity by touching the bare metal system of the computer case or the bare metal body of any other grounded appliance Hold electronic circuit boards by the edges only Do not touch the components on the board unless it is necessary...

Page 22: ... power Follow these instructions to remove the chassis covers 1 Loosen and remove the thumbscrew securing the chassis cover 2 Push down on the indentations located on the side of the chassis cover 3 Slide the chassis cover to the rear of the system and then remove the cover in the direction of the arrow 4 To reinstall the chassis cover follow steps 1 3 in reverse order 2 1 3 2 2 ...

Page 23: ...and Installing the Fan Duct Follow these instructions to remove the fan duct 1 Lift up to remove the fan duct 2 To reinstall the fan duct align the fan duct with the guiding groove Push down the fan duct until it is firmly seated on the system 1 2 ...

Page 24: ... that memory of the same capacity brand speed and chips be used Always turn off the computer and unplug the power cord from the power outlet before installing the memory to prevent hardware damage Memory modules have a foolproof design A memory module can be installed in only one direction If you are unable to insert the memory switch the direction 21 DIMM_P1_I0 DIMM_P1_I1 DIMM_P1_K0 DIMM_P1_K1 DI...

Page 25: ...nsert the DIMM memory module vertically into the DIMM slot and push it down 2 Close the plastic clip at both edges of the DIMM slots to lock the DIMM module 3 Reverse the installation steps when you want to remove the DIMM module 1 2 2 3 3 3 DIMM Population Table DIMM Capacity GB 1 Slot per Channel 2 Slots per Channel DIMM Density Speed MT s Voltage V Slot Per Channel SPC DIMM Per Channel DPC 1DPC...

Page 26: ... include a riser card or any cabling as standard To install a PCIe card a riser card must be installed Follow these instructions to PCI Expansion card 1 Loosen and remove the thumbscrew on the riser bracket 2 Remove the screw securing the riser bracket 3 Lift up the riser bracket out of system 4 Loosen and remove the screw securing the slot cover from riser bracket 5 Orient the PCIe card with the ...

Page 27: ... 27 System Hardware Installation 6 6 7 7 5 5 5 6 7 4 4 3 3 3 ...

Page 28: ...it is inserted incorrectly Make sure that the HDD is connected to the HDD connector on the backplane Follow these instructions to install a hard disk drive 1 Press the release button 2 Extend the locking lever 3 Pull the locking lever in the direction of the arrow to remove the HDD tray 4 Slide the hard disk into the HDD tray 5 Install 4 screws to secure the hard drive to the HDD tray 6 Reinsert t...

Page 29: ...e Fan Assembly Follow these instructions to replace a fan assembly 1 Flip the latches on the top of the fan outwards 2 Using the latches lift up the fan assembly from the chassis 3 Reverse the previous steps to install the replacement fan assembly 1 2 ...

Page 30: ...direction of the arrow 2 Pull the power supply handle at the same time and pull out the power supply unit 3 Insert the replacement power supply unit firmly into the chassis Connect the AC power cord to the replacement power supply 4 Repeat steps 1 3 for replacement of the second power supply 1 2 3 Before you remove or install the power supply unit Make sure the system is not turned on or connected...

Page 31: ... 31 System Hardware Installation 3 8 Cable Routing Front Panel Board Cable Front Panel USB 3 0 Cable Rear HDD Back Panel Board Power Cable Rear HDD Back Panel Board Signal Cable ...

Page 32: ...re Installation 32 SAS Expansion Card to Back Plane Board Cable 0 1 2 SAS Expansion Card Power Cable SAS Expansion Card to Back Plane Board Cable 3 4 5 0 1 2 3 4 5 On Board SATA to HDD Back Plane Board Cable 0 1 0 1 ...

Page 33: ... 33 System Hardware Installation HDD Back Panel Board Power Cable HDD Back Panel Board Signal Cable System Fan Cable ...

Page 34: ...System Hardware Installation 34 This page intentionally left blank ...

Page 35: ..._A1 DIMM_P0_C0 DIMM_P0_C1 DIMM_P0_E0 DIMM_P0_G0 DIMM_P0_H0 DIMM_P0_F0 DIMM_P0_D1 DIMM_P0_D0 DIMM_P0_B1 DIMM_P0_B0 3 4 5 6 7 8 8 9 10 14 14 15 16 17 18 19 20 21 22 23 11 12 13 1 2 ON OFF Item Description 1 2 x 4 Pin GPGPU Power Connector 2 2 x 4 Pin GPGPU Power Connector 3 Front Panel Header 4 Front Panel USB 3 0 Connector 5 BMC Firmware Readiness LED 6 HDD Back Plane Board Connector 7 IPMB Connect...

Page 36: ...tor 4 17 TPM Module Connector 18 Power Supply Connector 1 Primary 19 Power Supply Connector 2 Secondary 20 HDD Back Plane Board Power Connector Rear HDD 21 HDD Back Plane Board Power Connector Front HDD 22 SATA3 6Gb s Connector 0 23 SATA3 6Gb s Connector 1 From CPU0 24 Power supply connector 2 secondary 25 2 x 2 Pin extention card power connectors 26 2 x 7 Pin system main power connector NOTE Set ...

Page 37: ...M_P0_B1 DIMM_P0_D0 DIMM_P0_D1 DIMM_P0_F0 DIMM_P0_H0 NCSI Switch 21 6 6B 3 21 3 Clear supervisor password Reserved No Function Reserved No Function Reserved No Function Reserved No Function Reserved No Function RVSD RVSD RVSD CLR_PASSWD ON Normal Default Reserved No Function OFF 1 2 3 4 OCP Connector 1 Onboard LAN 21 3 2 3B6 7 ON and ON ON and ON ON and OFF ON and OFF Switch 4 and 3 PCIe Bandwidth ...

Page 38: ...Motherboard Components 38 This page intentionally left blank ...

Page 39: ...ith caution Inadequate BIOS flashing may result in system malfunction It is recommended that you not alter the default settings unless you need to to prevent system instability or other unexpected results Inadequately altering the settings may result in system s failure to boot If this occurs try to clear the CMOS values and reset the board to default values Refer to the Exit section in this chapt...

Page 40: ...iguration supervisor password allows you to restrict access to the system and BIOS Setup A supervisor password allows you to make changes in BIOS Setup A user password only allows you to view the BIOS settings but not to make changes Boot This setup page provides items for configuration of boot sequence Save Exit Save all the changes made in the BIOS Setup program to the CMOS and exit BIOS Setup P...

Page 41: ... displayed on the bottom line of the Main Menu Submenu Help While in a submenu press F1 to display a help screen General Help of function keys available for the menu Press Esc to exit the help screen Help for each item is in the Item Help block on the right side of the submenu When the system is not stable as usual select the Restore Defaults item to set your system to its defaults The BIOS Setup ...

Page 42: ...ed BMC Information Note BMC Firmware Version Note Displays BMC firmware version information Processor Information Displays the technical specifications for the installed processor s Memory Information Total Memory Note Displays the total memory size of the installed memory Memory Frequency Note Displays the frequency information of the installed memory Memory Slot Information Press Enter to view t...

Page 43: ... 43 BIOS Setup Parameter Description System Date Sets the date following the weekday month day year format System Time Sets the system time following the hour minute second format ...

Page 44: ... Setup 44 5 2 Advanced Menu The Advanced menu display submenu options for configuring the function of various hardware components Select a submenu item then press Enter to access the related submenu screen ...

Page 45: ...mputing Parameter Description Configuration Security Device Support Enable Disable the TPM support feature Options available Enable Disable Default setting is Enable Current Status Information Displays current TPM status information ...

Page 46: ...t setting is Disabled Wake up year Press and to define the wake up year Wake up month Press and to define the wake up month Wake up Date Press and to define the wake up date Wake up hour Press and to define the wake up hour Wake up minute Press and to define the wake up minute Wake up second Press and to define the wake up second Note This item appears when Wake system from S5 is set to Enabled ...

Page 47: ...Ipv4 HTTP feature Options available Enabled Disabled Default setting is Disabled Ipv6 PXE Support Note Enable Disable the Ipv6 PXE feature Options available Enabled Disabled Default setting is Disabled Ipv6 HTTP Support Note Enable Disable the Ipv6 HTTP feature Options available Enabled Disabled Default setting is Disabled PXE boot wait time Note Press the keys to increase or decrease the desired ...

Page 48: ... the POST Report support Options available Enabled Disabled Default setting is Enabled Delay Time Post Report wait time 0 10 seconds Options available 0 1 2 3 4 5 6 7 8 9 Until Press ESC Error Message Report Post Error Message Enable Disable the POST Error Message support Options available Enabled Disabled Default setting is Enabled ...

Page 49: ... 49 BIOS Setup 5 2 5 NMVe Configuration Parameter Description NVMe Configuration Displays the NVMe devices connected to the system ...

Page 50: ...BIOS Setup 50 5 2 6 SATA Configuration Parameter Description SATA Configuration SATA Controller Displays the SATA device connected to the system ...

Page 51: ...tion USB Controller Displays the USB controller information USB Devices Displays the USB devices connected to the system XHCI Hand off Enable Disable the XHCI USB 3 0 Hand off support Options available Enabled Disabled Default setting is Enabled USB Mass Storage Driver Support Note Enable Disable the USB Mass Storage Driver Support Options available Enabled Disabled Default setting is Enabled ...

Page 52: ...he default setting depends on the BMC setting Skip Above 4G Decoding for VGA Enable Disable 64bit capable devices to be decoded in Skip Above 4G Address VGA Space Options available Enabled Disabled Default setting is Disabled P2P Bridge IO Size Sets P2P Bridge IO aligned to the size Options available 0x100 0x150 0x1000 Default setting is 0x1000 Chassis Opened Warning Enable Disable the chassis int...

Page 53: ...erface Controller Chipset Type Displays the technical specifications for the Network Interface Controller PCI Device ID Displays the technical specifications for the Network Interface Controller PCI Address Displays the technical specifications for the Network Interface Controller Link Status Displays the technical specifications for the Network Interface Controller Link Speed Displays the technic...

Page 54: ...ed Disabled Default setting is Enabled Local IP Address Press Enter to congigure Local IP address Local NetMask Press Enter to congigure Local NetMask Local Gateway Press Enter to congigure Local Gateway Local DNS Servers Press Enter to congigure Local DNS Server Save Changes and Exit When you finish the configuration in this page press enter to save and to exit the configuration ...

Page 55: ... 55 BIOS Setup 5 2 11 MAC IPv6 Network Configuration Parameter Description Enter Configuration Menu Press Enter to access the related submenu screen ...

Page 56: ...n Turbo options Default will run cores ar a nomimal supported frequency Option avaiable Default Autonomous CPPC off Autonomous CPPC On OSPM Turbo OSPM Non Turbo Default setting is Default Symmertic Multi Treading Option avaiable 4 2 1 Default setting is 4 DDR Speed Option avaiable Auto 1600 1866 2133 2400 2666 Default setting is Auto ...

Page 57: ...ser to access and change all settings in the Setup Utility User Password Entering this password will restrict a user s access to the Setup menus To enable or disable this field a Administrator Password must first be set A user can only access and modify the System Time System Date and Set User Password fields Parameter Description Administrator Password Press Enter to configure the administrator p...

Page 58: ...BIOS Setup 58 5 5 Boot Menu The Boot menu allows you to set the drive priority during system boot up BIOS setup will display an error message if the legacy drive s specified is not bootable ...

Page 59: ...etting is On Quiet Boot Enable Disable showing the logo during POST Options available Enabled Disabled Default setting is Enabled FIXED BOOT ORDER Priorities Boot Option 1 2 3 4 5 Press Enter to configure the boot priority By default the server searches for boot devices in the following sequence 1 Hard drive 2 CD COM DVD drive 3 USB device 4 Network 5 UEFI UEFI sUEFI Application Boot Priorities Pr...

Page 60: ...orities The UEFI application boot priorities submenu allows you to specify the boot device priority from the available UEFI applications during system boot up BIOS setup will display an error message if the legacy drive s specified is not bootable ...

Page 61: ...rities The UEFI network drive BBS priorities submenu allows you to specify the boot device priority from the available UEFI network drives during system boot up BIOS setup will display an error message if the legacy drive s specified is not bootable ...

Page 62: ...BIOS Setup 62 5 6 Save Exit Menu The Exit menu displays the various options to quit from the BIOS setup Highlight any of the exit options then press Enter ...

Page 63: ...iscard Changes Discards changes made and closes the BIOS setup Options available Yes No Default Options Restore Defaults Loads the default settings for all BIOS setup parameters Setup Defaults are quite demanding in terms of resources consumption If you are using low speed memory chips or other kinds of low performance components and you choose to load these settings the system might not function ...

Page 64: ...ision Displays BMC device revision information BMC Firmware Revision Displays BMC firmware revision information IPMI Version Displays IPMI version information BMC Interface s Displays BMC interface information System Event Log Press Enter to configure advanced items BMC Self Test Log Press Enter to configure advanced items View FRU Information Press Enter to view the advanced items BMC network con...

Page 65: ...sing SEL Choose options for erasing SEL Options available No Yes On next reset Yes On every reset Default setting is No When SEL is Full Choose options for reactions to a full SEL Options available Do Nothing Erase Immediately Default setting is Do Nothing Custom EFI Logging Options Log EFI Status Codes Enable Disable the logging of EFI Status Codes if not already converted to legacy Options avail...

Page 66: ...usage 00 out of 20 logs Erase Log Choose options for erasing log Options available No Yes On next reset Yes On every reset Default setting is No When log is full Choose options for reactions to a full log Options available Do Nothing Clear Log Default setting is Clear Log ...

Page 67: ... Information The FRU page is a simple display page for basic system ID information as well as System product information Items on this window are non configurable Note Corresponds to the model name of GIGABYTE server you are using ...

Page 68: ...ically DHCP Do nothing option will not modify any BMC network parameters during BIOS phase Options available Unspecified Static DynamicBmcDhcp Default setting is DynamicBmcDhcp Station IP address Displays IP Address information Subnet mask Displays Subnet Mask information Please note that the IP address must be in three digitals for example 192 168 000 001 Router IP address Displays the Router IP ...

Reviews: