FusionServer XH321C V6 Liquid-cooled Server Node Technical White Paper
Contents
2022-09-10
iii
About This Document ..................................................................................................................... v
1 Overview ......................................................................................................................................... 7
2 Product Features ............................................................................................................................ 8
3 Physical Structure ....................................................................................................................... 11
4 Logical Structure ......................................................................................................................... 13
5 Hardware Description ................................................................................................................ 15
5.1 Front Panel .................................................................................................................................................................. 15
5.1.1 Appearance .............................................................................................................................................................. 15
5.1.2 Indicators and Buttons ............................................................................................................................................. 16
5.1.3 Ports ......................................................................................................................................................................... 19
5.1.4 Installation Positions ................................................................................................................................................ 20
5.2 Processors ................................................................................................................................................................... 21
5.3 Memory ...................................................................................................................................................................... 22
5.3.1 DDR4 Memory ........................................................................................................................................................ 22
5.3.1.1 Memory Identifier ................................................................................................................................................. 22
5.3.1.2 Memory Subsystem Architecture .......................................................................................................................... 23
5.3.1.3 Memory Compatibility ......................................................................................................................................... 23
5.3.1.4 DIMM Installation Rules ...................................................................................................................................... 25
5.3.1.5 Memory Installation Positions .............................................................................................................................. 25
5.3.1.6 Memory Protection Technologies ......................................................................................................................... 27
5.3.1.7 Memory Protection Technologies ......................................................................................................................... 28
5.4 Storage ........................................................................................................................................................................ 28
5.4.1 Drive Configurations ............................................................................................................................................... 28
5.4.2 Drive Numbering ..................................................................................................................................................... 29
5.4.3 RAID Controller Card ............................................................................................................................................. 29
5.5 Network ...................................................................................................................................................................... 29
5.5.1 OCP 3.0 Network Adapter ....................................................................................................................................... 29
5.6 I/O Expansion ............................................................................................................................................................. 30
5.6.1 PCIe Cards ............................................................................................................................................................... 30
5.6.2 PCIe Slots ................................................................................................................................................................ 30
5.6.3 PCIe Slot Description .............................................................................................................................................. 31
Page 1: ...FusionServer XH321C V6 Liquid cooled Server Node Technical White Paper Issue 03 Date 2022 09 10 xFusion Digital Technologies Co Ltd...
Page 2: ...bear any liability resulting from the use of xFusion The purchased products services and features are stipulated by the contract made between xFusion and the customer All or part of the products serv...
Page 3: ...2 Processors 21 5 3 Memory 22 5 3 1 DDR4 Memory 22 5 3 1 1 Memory Identifier 22 5 3 1 2 Memory Subsystem Architecture 23 5 3 1 3 Memory Compatibility 23 5 3 1 4 DIMM Installation Rules 25 5 3 1 5 Memo...
Page 4: ...roduct Specifications 35 6 1 Technical Specifications 35 6 2 Environmental Specifications 38 6 3 Physical Specifications 39 7 Software and Hardware Compatibility 41 8 Safety Instructions 42 8 1 Securi...
Page 5: ...a high level of risk which if not avoided will result in death or serious injury Indicates a hazard with a medium level of risk which if not avoided could result in death or serious injury Indicates...
Page 6: ...te Paper About This Document 2022 09 10 vi Change History Issue Date Description 03 2022 09 10 Updated 6 2 Environmental Specifications 02 2022 03 18 Updated 6 1 Technical Specifications and A 4 Senso...
Page 7: ...to manage and maintain XH321C V6 supports two SATA M 2 SSDs a maximum of 16 DDR4 DIMMs one PCIe card one RAID controller card and one OCP card XH321C V6 is ideal for data center cloud computing Big Da...
Page 8: ...ation Technology Intel VT allows operating system OS to better use hardware to address virtualization workloads Intel DL Boost VNNI is supported to improve the performance of deep learning application...
Page 9: ...ute Disable Bit EDB function prevents certain types of malicious buffer overflow attacks when working with a supported OS The Intel Converged Boot Guard Trusted Execution Technology Intel CBnT prevent...
Page 10: ...boards minimize the energy loss from DC DC power conversion Intel Intelligent Power Capability allows the processor logic unit to be powered on or off based on requirements Staggered spin up of drives...
Page 11: ...3 Physical Structure 2022 09 10 11 3 Physical Structure Figure 3 1 XH321C V6 physical structure 1 Screw in RAID controller card 2 Cable management arm 3 Liquid cold plate 4 TPM TCM 5 Memory modules 6...
Page 12: ...r XH321C V6 Liquid cooled Server Node Technical White Paper 3 Physical Structure 2022 09 10 12 11 OCP 3 0 network adapter 12 Management network port board 13 PCIe riser module 14 PSU 15 M 2 SSD 16 M 2...
Page 13: ...re 2022 09 10 13 4 Logical Structure Figure 4 1 XH321C V6 logical structure Scenario 1 CPU 1 and CPU 2 are connected to the pass through PCIe riser card through PCIe x8 connectors respectively Scenari...
Page 14: ...nboard through a high speed connector and the mainboard is connected to drives through the middle module to support different local storage configurations The LBG R Platform Controller Hub PCH is inte...
Page 15: ...cription 2022 09 10 15 5 Hardware Description 5 1 Front Panel 5 2 Processors 5 3 Memory 5 4 Storage 5 5 Network 5 6 I O Expansion 5 7 PSUs 5 8 Boards 5 1 Front Panel 5 1 1 Appearance Figure 5 1 Front...
Page 16: ...ment port indicator 5 Management network port data transmission status indicator 6 Connection status indicator of the management network port 7 PSU indicator Indicator and Button Description Table 5 1...
Page 17: ...eady green The device is operating properly UID button indicator The UID button indicator helps identify and locate a device UID indicator Off The device is not being located Blinking or steady blue T...
Page 18: ...The possible causes of no power output are as follows Power supply overtemperature protection Power output overcurrent or short circuit Output overvoltage Short circuit protection Device failure excl...
Page 19: ...Description Table 5 2 Ports on the front panel Port Type Quantity Description Water inlet 1 Connects to a water pipe to supply cold water Water outlet 1 Connects to a water pipe to discharge hot water...
Page 20: ...mobile phone you need to use the mobile application FusionMobile to access the iBMC For details see the FusionMobile User Guide Connects to a Type C to serial port RJ45 to implement the debugging func...
Page 21: ...the front of the server node do not collide with the chassis or other objects 5 2 Processors The server supports one or two processors If only one processor is required install it in socket CPU1 Proc...
Page 22: ...on the label attached to the memory module Figure 5 6 Memory identifier Callout Description Example 1 Capacity 16 GB 32 GB 64 GB 128 GB 2 rank s 1R Single rank 2R Dual rank 4R Quad rank 3 Data width...
Page 23: ...ssor integrates eight memory channels Table 5 3 Memory channels CPU Memory Channel Memory Slot CPU1 A DIMM000 A B DIMM010 B C DIMM020 C D DIMM030 D E DIMM040 E F DIMM050 F G DIMM060 G H DIMM070 H CPU2...
Page 24: ...For details about the capacity type of a single memory module see Search Parts in the Compatibility Checker The maximum number of memory modules supported depends on the memory type and rank quantity...
Page 25: ...llation guidelines Each memory channel must have a valid online spare configuration The channels can have different online spare configurations Each populated channel must have a spare rank Memory mir...
Page 26: ...FusionServer XH321C V6 Liquid cooled Server Node Technical White Paper 5 Hardware Description 2022 09 10 26 Figure 5 7 Memory slots Figure 5 8 DDR4 memory module installation guidelines 1 processor...
Page 27: ...ure 5 9 DDR4 memory module installation guidelines 2 processors 5 3 1 6 Memory Protection Technologies The following memory protection technologies are supported ECC Memory Mirroring Memory Single Dev...
Page 28: ...solation Memory Thermal Throttling Command Address Parity Check and Retry Memory Demand Patrol Scrubbing Memory Data Scrambling Memory Multi Rank Sparing Post Package Repair PPR Write Data CRC Protect...
Page 29: ...arts in the Compatibility Checker to determine the components to be used For details about the RAID controller card see V6 Server RAID Controller Card User Guide A pass through card provides a channel...
Page 30: ...dability and connection Three PCIe 4 0 slots are supported including one dedicated PCIe slot for a RAID controller card one dedicated FLEX I O slot for an OCP 3 0 NIC and one standard PCIe slots Conta...
Page 31: ...rk adapter CPU1 PCIe 4 0 x16 x16 Port 0A 17 0 0 Slot1 CPU2 PCIe 4 0 x16 x16 Port 3A 31 0 0 HHHL The B D F Bus Device Function Number is the default value when the server is fully configured with PCIe...
Page 32: ...al to 2 the PSU on a single node supports hot swap The server supports two PSUs in 1 1 redundancy or four PSUs in 2 2 redundancy If the server requires two PSUs install them on the first and third nod...
Page 33: ...6 CPU2 Slimline3 x8 high speed connector SLIMLINE3 CPU2 J4 7 M 2 riser card connector M 2 RISER x8 J14 8 Slimline2 x8 high speed connector SLIMLINE2 J84 9 4 pair x8 high speed connector J18 10 6 pair...
Page 34: ...Paper 5 Hardware Description 2022 09 10 34 CPU1 J11 21 GE management network port board connector GE CONN J27 22 VROC key connector SOFT RAID KEY J3 a 23 OCP 3 0 network adapter connector OCP CONN J10...
Page 35: ...21A Processors Supports one or two processors Third generation Intel Xeon Scalable Ice Lake processors Built in memory controller and eight memory channels per processor Built in PCIe controller suppo...
Page 36: ...ratch For details see https kb vmware com s article 1033696 Configure syslog For details see https kb vmware com s article 2003322 The M 2 SSD cannot be used to store data due to poor endurance In wri...
Page 37: ...a variety of ports Ports on the front panel One USB 3 0 Type C port One USB 2 0 Type C iBMC direct connect management port debugging serial port One RJ45 management network port One PSU socket One wat...
Page 38: ...10006 44 ft When the server configuration complies with ASHRAE Classes A1 and A2 and the altitude is above 900 m 2952 76 ft the highest operating temperature decreases by 1 C 1 8 F for every increase...
Page 39: ...ation When drives are preserved under the storage temperature and humidity specified in the preceding table the following preservation time is recommended Maximum preservation duration of SSDs 12 mont...
Page 40: ...how to measure the physical dimensions of a server node Weight in full configuration Net weight 7 5 kg 16 53 lb Packing material weight 3 2 kg 7 05 lb Power consumption The power consumption paramete...
Page 41: ...ware basic middleware software and hardware The slight differences of the application software middleware basic software and hardware may cause performance inconsistency between the application layer...
Page 42: ...re allowed to perform special tasks such as performing high voltage operations and driving a forklift If this device works in a residential environment the wireless interference may be generated Perso...
Page 43: ...such as watches and jewelry Figure 8 2 shows conductive objects that must be removed before you touch a device Figure 8 2 Removing conductive objects Figure 8 3 shows how to wear an ESD wrist strap a...
Page 44: ...les only for dedicated servers Do not use them for other devices Before operating equipment wear ESD clothes and gloves to prevent electrostatic sensitive devices from being damaged by ESD When moving...
Page 45: ...n Comply with local regulations for the maximum load per person Table 8 1 lists the maximum weight one person is permitted to carry as stipulated by a number of organizations Table 8 1 Maximum weight...
Page 46: ...re 24 7 stable running of the device The iBMC allows screenshots and videos to be created when the system breaks down facilitating cause analysis of the system breakdown The iBMC offers screen snapsho...
Page 47: ...The NTP synchronizes network time to optimize time configuration The iBMC supports domain name system DNS and Lightweight Directory Application Protocol LDAP to implement domain management and directo...
Page 48: ...5032 2015 A11 2020 CISPR 32 2015 A1 2019 EN IEC 61000 3 2 2019 A1 2021 EN 61000 3 3 2013 A1 2019 EN 55035 2017 A11 2020 CISPR 35 2016 EN 55024 2010 A1 2015 CISPR 24 2010 A1 2015 ETSI EN 300 386 V1 6 1...
Page 49: ...SPR 24 2010 A1 2015 ETSI EN 300 386 V1 6 1 2012 ETSI EN 300 386 V2 1 1 2016 RoHS BS EN IEC 63000 2018 ErP Commission Regulation EU 424 2019 China CCC GB 17625 1 2012 GB 4943 1 2011 GB T 9254 1 2021 Ch...
Page 50: ...10 50 A Appendix A 1 Node Label Information The label information and location are for reference only For details see the actual product A 1 1 Node Label Figure A 1 Label position Table A 1 Label desc...
Page 51: ...years 2010 to 2017 respectively Letters J to N indicate years 2018 to 2022 respectively Letters P to Y indicate years 2023 to 2032 respectively NOTE The years from 2010 are represented by upper case...
Page 52: ...ature and the core CPU temperature threshold CPUN N indicates the CPU number The value is 1 or 2 CPUN Margin Difference between the real time CPU temperature and the CPU Tcontrol threshold CPUN N indi...
Page 53: ...omponent in position U102 on the mainboard SYS_1V8_CPUN Mainboard CPU1 1 8 V voltage CPU1 Component in position U2 on the mainboard CPU2 Component in position U39 on the mainboard N indicates the CPU...
Page 54: ...PSU status PSU N N indicates the PSU number The value is 1 or 4 PSN Fan Status PSU fan fault status PSU N N indicates the PSU number The value is 1 or 4 PSN VIN Input voltage PSU N N indicates the PSU...
Page 55: ...mber PCIe Status PCIe status error PCIe device PwrOn TimeOut Power on timeout Mainboard PwrCap Status Power capping status Mainboard RAID PCIe ERR Health status of the RAID controller card in fault di...
Page 56: ...e value is 1 or 2 GPU Temp GPU temperature GPU cards PCIe OP Temp PCIe card optical module temperature PCIe card PCIe NIC Temp PCIe card chip temperature PCIe card OCP1 Temp OCP card chip temperature...
Page 57: ...tem can manage the objects E ejector lever A part on the panel of a device used to facilitate installation or removal of the device Ethernet A baseband local area network LAN architecture developed by...
Page 58: ...the existing PCI programming concepts and communication standards but builds a faster serial communication system Intel is the main sponsor for PCIe PCIe is used only for internal interconnection A PC...
Page 59: ...records stored in the system used for subsequent fault diagnosis and system recovery B 5 U Z U U A unit defined in International Electrotechnical Commission IEC 60297 1 to measure the height of a cab...
Page 60: ...ernating current AES Advanced Encryption Standard New Instruction Set ARP Address Resolution Protocol AVX Advanced Vector Extensions B BBU backup battery unit BIOS Basic Input Output System BMC basebo...
Page 61: ...dom access memory DVD digital video disc E ECC error checking and correcting ECMA European Computer Manufacturer Association EDB Execute Disable Bit EN European Efficiency ERP enterprise resource plan...
Page 62: ...rd management controller IC Industry Canada ICMP Internet Control Message Protocol IDC Internet Data Center IEC International Electrotechnical Commission IEEE Institute of Electrical and Electronics E...
Page 63: ...rd M MAC media access control MMC module management controller N NBD next business day NC SI Network Controller Sideband Interface O OCP Open Compute Project C 4 P T P PCIe Peripheral Component Interc...
Page 64: ...SATA Serial Advanced Technology Attachment SCM supply chain management SDDC single device data correction SERDES serializer deserializer SGMII serial gigabit media independent interface SMI serial ma...
Page 65: ...5 U Z U UDIMM unbuffered dual in line memory module UEFI Unified Extensible Firmware Interface UID unit identification light UL Underwriter Laboratories Inc UPI UltraPath Interconnect USB Universal S...