background image

SKY-642 User Manual

4

PCI-express

11 x PCI-E x16 slot (Gen3 x16 link)

Slot 1~ Slot 5 from U1_PLX8796 from CPU0

Slot 6 from CPU1

Slot 8~ Slot 12 from U2_PLX8796 from CPU0

1 x PCI-E x16 slot (Gen3 x8 link)

Slot 7 from CPU0

System BIOS

BIOS type

128 Mb SPI Flash EEPROM with AMI BIOS

PC Health Monitoring

Voltage

Monitors for CPU Cores, +3.3 V, +5 V, +12 V, +5 V Standby, VBAT

Fan

Six 120X38 fan for CPU/GPU cooling.

Four 80X38 fan for expansion card cooling (optional at rear win-
dow).

SYSFAN0-SYSFAN7 with tachometer status monitoring

Temperature

Monitoring for CPU0 & CPU1 (PECI)
Monitoring for System (HWM)

Other Features
(Case Open)

Chassis intrusion detection

Chassis Intrusion header

Operating Environment / Compliance

RoHS

RoHS Compliant 

Environmental Spec.

Operating Temperature: 0 to 35° C 

Non-operating Temperature: -40 to 60° C

Operating Relative Humidity: 95% @ 40° C (non-condensing)

Non-operating Relative Humidity: 95% @ 60° C (non-condens-
ing)

Summary of Contents for SKY-642

Page 1: ...User Manual SKY 642 4U Rackmount Intel Xeon Scalable Series GPU Server Supporting 10 x PCIe x16 Double Deck Cards Plus 1 x PCIe x16 and 1 x PCIe x8 Single Deck Cards...

Page 2: ...ion Advantech assumes no liability under the terms of this warranty as a consequence of such events Because of Advantech s high quality control standards and rigorous testing most of our customers nev...

Page 3: ...find the answer gather all the information or questions that apply to your problem and with the product close at hand call your dealer Our dealers are well trained and ready to give you the support yo...

Page 4: ...a short circuit and cause fire electric shock or damage to your equipment Lift equipment using both hands and with your knees bent Rack Mount Instructions The following or similar rack mount instructi...

Page 5: ...f Advantech equipment that has been mod ified Equipment Repairs and Servicing The installation of internal options and routine maintenance and service of this product should be performed by individual...

Page 6: ...108 1 80GHz 11M 8Cores 85W 96MPXE 2 0 11M36 Intel Xeon Silver 4109T 2 0GHz 11M 8Cores 70W 96MPXE 2 1 11M36 Intel Xeon Silver 4110 2 1GHz 11M 8Cores 85W TBD Intel Xeon Silver 4112 2 6GHz 8 25M 4Cores 8...

Page 7: ...B4BNTDSE ATP 32G DDR4 2666 RDIMM REG ECC SATA HDD 96HD4TB ST SG7KE1 Seagate 3 5 SATA HDD 4TB ST4000N M0035 96HD8TB ST SG7KE Seagate 3 5 SATA HDD 8TB ST8000N M0055 96HD2TB ST WD7KE2 WD 3 5 SATA HDD 2TB...

Page 8: ...sla P40 24GB PCI E x16 HS SKY TESL P100 PE NVidia Tesla P100 12GB PCI E x16 HS RAID Card TBD LSI MR SAS 9361 4i PCIe x8 TBD LSI MR SAS 9380 4i4e PCIe x8 TBD LSI MR SAS 9340 8i PCIe x8 96RC SAS 8P PE A...

Page 9: ...the SKY 642 mechanically and electri cally before shipment It should be free of marks and scratches and in perfect working order upon receipt When unpacking the SKY 642 check it for signs of ship ping...

Page 10: ...SKY 642 User Manual x...

Page 11: ...2 2 Installing Motherboard Components 13 2 2 1 Removing the Chassis Cover and CPU Duct 13 2 2 2 Installing the CPU and Heatsink 14 2 2 3 Installing the Memory 17 2 2 4 Installing Hard Drives 19 2 2 5...

Page 12: ...2 2 Windows Series Driver Setup 77 6 3 USB3 0 78 6 3 1 Introduction 78 6 3 2 Windows Series Driver Setup 78 Appendix A Programming the Watchdog Timer 79 A 1 Watchdog Timer Overview 80 A 2 Programming...

Page 13: ...Chapter 1 1 Overview...

Page 14: ...Connector and 2 x at front These powerful I O capabilities ensure reliable data storage capabilities and high speed I O peripheral connectivity 1 2 Features General Intel Xeon Scalable Family process...

Page 15: ...n2 lanes Network Controllers Intel X557 T for LAN1 2 10 GbE Above network Supports1 10 GbE Base T with RJ 45 output VGA ASPEED AST2500 controller with 64 MB VGA memory provides basic 2D VGA function E...

Page 16: ...VBAT Fan Six 120X38 fan for CPU GPU cooling Four 80X38 fan for expansion card cooling optional at rear win dow SYSFAN0 SYSFAN7 with tachometer status monitoring Temperature Monitoring for CPU0 CPU1 PE...

Page 17: ...d connector Later sections in this chapter give instructions for setting jumpers Chapter 2 gives instructions for connecting external devices to SKY 642 System top view Front IO view 6 x Internal Syst...

Page 18: ...edundant Power module 10 x PCIe x16 for double deck GPU cards 1 x PCIe x16 from CPU1 LED State Color Description Power LED On Green System is turned on Blinking Green System is under S4 state Off Off...

Page 19: ...ber Amber Green Blinking green 10G Mbps Link Active Green Green Green Blinking green No Link Off Off Power module LED Blinking Amber No AC power to this module while other PSU with AC input 1Hz Blinki...

Page 20: ...4 SATA7 sSATA_CON1 SFF 8643 connector for sSATA0 sSATA3 M 2_2280_1 M 2 2280 connector B M key for SATA and PCIEX2 RISER_SLOT1 RISER_SLOT4 High density connector for riser card to expansion board PCIEX...

Page 21: ...x16 RISER_SLOT 3 4 RISER SLOT 2 DDR4 DRAM SPI SPI Flash 32MB CPLD Intel LGA 3647 0 Skylake Server Processors CPU0 1 USB3 0 1 type A BMC AST2500 Intel Lewisburg Platform Control Hub VGA Conn SPI BIOS...

Page 22: ...v v v v v v DIMMH1 DIMMB2 v v DIMMH2 DIMMC1 v v v DIMM I1 DIMMC2 v DIMM I2 DIMMD1 v v v v DIMMJ1 DIMMD2 v v DIMMJ2 DIMME1 v v v v DIMMK1 DIMME2 v v DIMMK2 DIMMF1 v v DIMML1 DIMMF2 v DIMML2 Note 5 7 9...

Page 23: ...Chapter 2 2 Setting up...

Page 24: ...c electricity Working on a system that is connected to a power supply can be extremely dangerous Follow the guidelines below to avoid damage to SKY 642 or injury to yourself Ground yourself properly b...

Page 25: ...This section describes how to install components on to the mainboard including CPUs memory modules and add on cards 2 2 1 Removing the Chassis Cover and CPU Duct Follow these instructions to remove SK...

Page 26: ...ser Manual 14 3 Remove CPU air duct 2 2 2 Installing the CPU and Heatsink Follow the steps below to install CPUs and CPU heatsinks 1 Locate the CPU sockets you must install in the CPU0 socket first CP...

Page 27: ...hapter 2 Setting up 2 Remove CPU dust cover from the CPU socket 3 Assemble the CPU with CPU clip and align the triangle mark on both CPU and the clip make sure both notch A and B on the CPU is careful...

Page 28: ...as in the previous step 5 Carefully align the triangle mark on the CPU against the triangle mark on the CPU socket then place the CPU with heatsink into the CPU socket 6 Use a T30 Torx screwdriver fo...

Page 29: ...ews in the order of 4 3 2 1 then lift the CPU and heatsink up 2 2 3 Installing the Memory Follow these instructions to install the memory modules onto the motherboard 1 Locate the memory slots on the...

Page 30: ...memory module with the slot When inserted properly the memory slot locking levers lock automatically onto the indentations at the ends of the mod ule Follow the recommended memory population table to...

Page 31: ...w these instructions to install a hard drive 1 Press the locking lever latch and pull the locking lever open and Slide the HDD tray out 2 Place a hard drive into the drive tray then use the screws to...

Page 32: ...T screw and pull the handle bar to release the expansion board Below pictures give you instructions to install Expansion Board 1 Make sure the guide pins are well inserted 2 Push down the Expansion Bo...

Page 33: ...llow below instructions to install 98R16420300 1 Remove the semi punch at the left side of chassis 2 Follow below instructions to screw the fan module Follow below instructions to install 98R16420400...

Page 34: ...mm Rack mounting kit Sliding Rails x 2 Screws Kit x 1 2 3 1 Installing the Server in a Rack Before mounting the SKY 642 in a rack ensure that all internal components have been installed and that the...

Page 35: ...ng shall include one piece of left hand one piece of right hand 4 pieces of H 370 screws for ear plate fastening and 2 pieces of H 315 screws for chassis fastening After installation or maintenance is...

Page 36: ...e the chassis inner member Pull the slide open then press the trig ger down as shown on the drawing and pull the chassis inner member out EXT 260MM Extendable front bracket only applies to some tool l...

Page 37: ...o the rack mount chassis Bayonet on chassis shall be pre formed as per the recommended dimension and location Step 3 Attach the cabinet outer member to the rail Insert the stag into the upper and lowe...

Page 38: ...s in fully open position before installing the chassis Caution It might cause damage to the chassis if ball retainer is not in fully open position while mounting the chassis While you are pushing chas...

Page 39: ...ions to the branch circuit e g use of power strips Instructions de montage en rack Le rack en suivant ou similaire monter instructions sont incluses avec les instructions d installation Temp rature de...

Page 40: ...SKY 642 User Manual 28...

Page 41: ...Chapter 3 3 AMI BIOS...

Page 42: ...or off This chapter describes the basic navigation of the SKY 642 setup screens AMI s BIOS ROM has a built in setup program that allows users to modify the basic system configuration This type of info...

Page 43: ...t options cannot be configured options in blue can be The right frame displays the key legend Above the key legend is an area reserved for a text message When an option is selected in the left frame i...

Page 44: ...lect any of the items in the left frame of the screen such as CPU configuration to go to the sub menu for that item You can display an Advanced BIOS Setup option by highlighting it using the Arrow key...

Page 45: ...ser Manual Chapter 3 AMI BIOS 3 2 2 1 Trusted Computing Security Device Support Enables or disables BIOS support for security devices Note Purchase Advantech LPC TPM module to enable TPM function P N...

Page 46: ...42 User Manual 34 3 2 2 2 ACPI Settings Enable Hibernation Enable or Disable Hibernation Lock Legacy Resources Enable or Disable Lock Legacy Resources Power on by Modem Enable or Disable Power On by M...

Page 47: ...35 SKY 642 User Manual Chapter 3 AMI BIOS 3 2 2 3 ITE8528 Super IO Configuration Serial Port 1 Configuration Serial Port Enable or Disable Serial Port 1...

Page 48: ...er Manual 36 Change Settings To select an optimal setting for serial port 1 Serial Port 2 Configuration Serial Port Enable or Disable Serial Port 2 Change Settings To select an optimal setting for Ser...

Page 49: ...hutdown Temperature Set the CPU ACPI shutdown temperature threshold When the system reaches the shutdown temperature it will be automatically shutdown by ACPI OS to pro tect the system from overheat d...

Page 50: ...ystem Fan Zone 0 controls SYSFAN 0 1 System Fan Zone 1 controls SYSFAN 2 3 System Fan Zone 2 controls SYSFAN 4 5 System Fan Zone 3 controls SYSFAN 6 8 System Fan Zone 4 controls SYSFAN 7 9 Zone0 SYSFA...

Page 51: ...39 SKY 642 User Manual Chapter 3 AMI BIOS 3 2 2 5 Serial Port Console Redirection Console Redirection To Enable or disable console redirection feature Console Redirection Settings...

Page 52: ...SKY 642 User Manual 40...

Page 53: ...Parity bit is always 0 Mark and Space Parity do not allow for error detection Options available None Even Odd Mark Space Stop Bits Stop bits indicate the end of a serial data packet A start bit indic...

Page 54: ...n Resolution On Legacy OS the number of Rows and Columns supported redirection Options available 80x24 80X25 Putty Keypad Select function key and keypad on putty 3 2 2 6 PCI Subsystem Settings Above 4...

Page 55: ...using BIOS services Do not allow disabling of GA20 this option is useful when any RT code is exe cuted above 1MB Option ROM Message Set display mode for Option ROM HDD Connection Order Boot option fi...

Page 56: ...B legacy mode when no USB device is attached XHCI Hand off This is a workaround for OS without XHCI hand off support The XHCI ownership change should be claimed by XHCI driver USB Mass Storage Driver...

Page 57: ...45 SKY 642 User Manual Chapter 3 AMI BIOS 3 2 3 Platform Configuration 3 2 3 1 PCH Configuration...

Page 58: ...Case Open Warning Enable Disable the chassis Intrusion monitoring function When enabled and he case is opened the warning message will show in POST screen VGA Priority Select active video type as on...

Page 59: ...47 SKY 642 User Manual Chapter 3 AMI BIOS PCIe M 2 Slot Configuration PCIe M 2 Slot Enable Disable PCIe M 2 Slot PCIe Speed Configure PCIe M 2 speed default is auto...

Page 60: ...SKY 642 User Manual 48 PCH SATA sSATA M 2 Configuration SATA sSATA M 2 Controller Enables Disables sSATA controller Configure SATA sSATA as Configured as AHCI RAID mode Supports ALPM...

Page 61: ...pear when AHCI or RAID is selected Networking LAN1 LAN2 Controller Enable Disable on board LAN1 LAN2 from Intel X557AT2 Controller support LAN1 PXE OpROM Enable Disable Legacy Boot option for LAN1 fro...

Page 62: ...SKY 642 User Manual 50 3 2 3 2 Server ME Configuration This page show the operating ME firmware version and state 3 2 4 Socket Configuration...

Page 63: ...etcher Hardware Prefetcher is a technique that fetches instructions and or data from memory into the CPU cache memory well before the CPU needs it so that it can improve the load to use latency Set to...

Page 64: ...SKY 642 User Manual 52 DCU Mode MSR 31h Bit 0 A write of 1 selects the DCU mode as 16KB 4 way with ECC AES NI Enable disable AES NI support...

Page 65: ...53 SKY 642 User Manual Chapter 3 AMI BIOS Core Disable Bitmap Hex Hex value for CPU Core disable default value 0 is enable all cores 3 2 4 2 UPI Configuration...

Page 66: ...nk Speed Mode Select the QPI link speed as either the POR speed Fast or default speed Slow Link Frequency Select Allows for selecting the QPI Link frequency Link L0p Enable Enable Disable QPI Link0p L...

Page 67: ...55 SKY 642 User Manual Chapter 3 AMI BIOS 3 2 4 3 Memory Configuration NUMA Enable Disable Non uniform Memory Access NUMA Memory Topology...

Page 68: ...SKY 642 User Manual 56 3 2 4 4 IIO Configuration PCI E ASPM Support Global Enable or disable the Active State Power Management for all PCI Express slots...

Page 69: ...57 SKY 642 User Manual Chapter 3 AMI BIOS Socket 0 Configuration...

Page 70: ...SKY 642 User Manual 58 IOU0 PCIE X8 Slot7 IOU1 PCIE X16 Slot8 12 IOU2 PCIE X16 Slot1 5 Link Speed Select target link speed as Gen1 Gen2 Gen3 Socket 1 Configuration...

Page 71: ...ot6 Link Speed Select target link speed as Gen1 Gen2 Gen3 Intel VT for Direct I O VT d Intel VT for Direct I O VT d Enable or disable Intel Virtualization Technology for directed I O VT d by reporting...

Page 72: ...SKY 642 User Manual 60 3 2 4 5 Advanced Power Management Configuration...

Page 73: ...U frequency is set at max non turbo Default is disable Config TDP Config TDP level selection Boot performance mode Select the performance state that BIOS will set before OS hand off Turbo Mode Turbo m...

Page 74: ...State Enable or disable autonomous C State control for CPU cores Default is disable CPU C6 report Enable or disable CPU C6 report Default is disable Enhanced Halt State C1E Enable or disable C1E for l...

Page 75: ...ces to communicate with BMC Wait for BMC If enabled motherboard will wait 30 60 seconds until BMC module boots up completely After that the normal BIOS post screen will be displayed If disabled the mo...

Page 76: ...e all features of system event logging during boot Erase SEL Choose options for erasing SEL When SEL is Full Choose options for reactions to a full SEL Log EFI Status Codes Disable the logging of EFI...

Page 77: ...65 SKY 642 User Manual Chapter 3 AMI BIOS BMC Self Test Log Erase Log Erase log options When Log is Full Select the action to be taken when the log is full...

Page 78: ...al 66 BMC Network Configuration Configuration Address Source Select to configure LAN channel parameters statically or dynamically by BMC Unspecified option will not modify any BMC network parameters d...

Page 79: ...67 SKY 642 User Manual Chapter 3 AMI BIOS 3 2 6 Security 3 2 7 Boot Setup Prompt Timeout Number of seconds to wait for setup activation key 16 0x10 means indefinite waiting...

Page 80: ...ving any changes Save Changes and Reset Reset the system after saving changes Discard Changes and Reset Reset system setup without saving any changes Save Changes Save changes done so far to any of th...

Page 81: ...Chapter 4 4 Chipset Software Installation Utility...

Page 82: ...t operating system commands and the pertinent sections of your application software s user manual before performing the installa tion 4 2 Introduction Select the corresponding operating system running...

Page 83: ...hipset Software Installation Utility 4 3 Windows OS Driver Setup 1 Download the Chipset driver as below picture shown the file downloaded is compressed unzip the folder then install the Chipset driver...

Page 84: ...SKY 642 User Manual 72...

Page 85: ...Chapter 5 5 VGA Setup...

Page 86: ...al graphic card as major output under the Display properties of OS 2 The WDDM driver can support for the following OS versions Windows 8 x86 x64 version Windows 8 1 x86 x64 version Windows Server 2012...

Page 87: ...Chapter 6 6 LAN Configuration SATA RAID AHCI USB 3 0 Setup...

Page 88: ...duplex at 10 1Gbps or 10 Gbps Wake on LAN WOL support 6 1 3 Installation The integrated Intel gigabit Ethernet controller supports all major network operating systems However the installation procedur...

Page 89: ...ng system 6 2 2 Windows Series Driver Setup Download the RSTe driver as shown below the file downloaded is compressed unzip the folder then install the RSTe driver Note 1 Please visit the Intel downlo...

Page 90: ...side two at front side and one via internal type A connector The USB 3 0 provides bandwidth up to 500MB s to shorter the time for data transmis sion 6 3 2 Windows Series Driver Setup Download the USB...

Page 91: ...Appendix A A Programming the Watchdog Timer...

Page 92: ...e time out A 2 Programming the Watchdog Timer The I O port address of the watchdog timer is as below Here is an example to step by step program the Watchdog Timer Address Description 0x57 Event Warm R...

Page 93: ...99 port Watchdog Event Wait IBF clear 0x29A BIT1 0 09 Write 0x04 to 0x299 port Warm Reset event Wait IBF clear 0x29A BIT1 0 10 Write 0x28 to 0x29A Start watchdog Wait 1 9 sec Wait IBF clear 0x29A BIT1...

Page 94: ...SKY 642 User Manual 82...

Page 95: ...Appendix B B On Board DIP Switch Setting for PCI Express Driving...

Page 96: ...bit is set to high 1 on the contrary the bit is set to low 0 Below Picture is an example of the high 1 and low 0 status of a DIP switch B 1 U1 PEX8796 B 2 U2 PEX8796 B 3 PCIE SLOT6 bit1 bit2 bit3 bit4...

Page 97: ...2 User Manual Appendix B On Board DIP Switch Setting for PCI Express Driving B 4 PCIE SLOT7 bit1 bit2 bit3 bit4 bit5 bit6 RPT13_SW1 0 1 0 0 0 1 RPT13_SW2 0 0 1 0 1 0 RPT14_SW1 0 0 1 0 1 0 RPT14_SW2 0...

Page 98: ...SKY 642 User Manual 86...

Page 99: ...Appendix C C OEM Command for BMC IPMI tool...

Page 100: ...x06 0x04 Byte Data Field Request Data 1 Customer OEM NetFn 0x38 2 Customer OEM Sub Command ID 0x01 3 Advantech NetFn 0x00 4 Advantech Sub Command 0x01 5 Operation Selection 00h Read BMC lock unlock st...

Page 101: ...Data Field Request Data 1 Customer OEM NetFn 0x38 2 Customer OEM Sub Command ID 0x01 3 Advantech NetFn 0x06 4 Advantech Sub Command 0x04 5 Operation Selection 00h Get the condition 01h Set the condit...

Page 102: ...tions are subject to change without notice No part of this publication may be reproduced in any form or by any means electronic photocopying recording or otherwise without prior written permis sion of...

Reviews: