Supermicro SuperServer SSG-640P-E1CR36H User Manual Download Page 15

Page: 15 / 112

Chapter 1: Introduction

1.3 System Architecture

This section shows the locations of the system electronic components.

Figure 1-4. Main Component Locations

Storage Backplane

BPN-SAS3-846EL1-N8

Motherboard

X12DPi-N(T)6

System Fans

Power Supply

Modules

Processor,

Heatsink

DIMM Slots

Summary of Contents for SuperServer SSG-640P-E1CR36H

Page 1: ...USER S MANUAL Revision 1 0 SuperServer SSG 640P E1CR36H SSG 640P E1CR36L Super Micro Computer Inc Information in this document is subject to change without notice Front View System...

Page 2: ...ass A device or in residential environment for Class B device This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the manufacturer s i...

Page 3: ...ivers and utilities https www supermicro com wdl Product safety info http www supermicro com about policies safety_information cfm If you have any questions please contact our support team at support...

Page 4: ...er Installation 2 1 Overview 21 2 2 Unpacking the System 21 2 3 Preparing for Setup 21 Choosing a Setup Location 21 Rack Precautions 22 Server Precautions 22 Rack Mounting Considerations 22 Ambient Op...

Page 5: ...Processor from the Carrier Assembly 41 3 4 Memory 42 Memory Support 42 Optane PMem Population 44 PMem Notes 44 Memory Population Guidelines 45 Guidelines Regarding Mixing DIMMs 45 DIMM Construction 4...

Page 6: ...dditional Information 74 Hardware Key 74 Configuring NVMe RAID Manually 75 Status Indications 80 Hot Swap Drives 80 Hot unplug 80 Hot plug 80 Related Information Links 80 Chapter 7 Troubleshooting and...

Page 7: ...omponents 88 7 8 Reporting an Issue 88 Technical Support Procedures 88 Returning Merchandise for Service 88 Vendor Support Filing System 89 7 9 Feedback 89 7 10 Contacting Supermicro 90 Appendix A Sta...

Page 8: ...Super Micro Computer B V Het Sterrenbeeld 28 5215 ML s Hertogenbosch The Netherlands Tel 31 0 73 6400390 Fax 31 0 73 6416525 Email sales supermicro nl General Information support supermicro nl Technic...

Page 9: ...e see Section 3 9 for details I O Ports LAN Two RJ45 10G BASE T one RJ45 dedicated BMC LAN port USB Four USB 3 0 ports Rear One VGA port Rear One COM port Rear Two Super DOM Disk on Module ports Syste...

Page 10: ...the table below For OS RAID or non RAID configurations some LED indications are not supported such as hot spare For VROC configurations refer to the VROC section in this manual Super Micro Computer In...

Page 11: ...Status LED Red Solid On Failure of drive with RSTe support Red Blinking at 1 Hz Rebuild drive with RSTe support Red Blinking with two blinks and one stop at 1 Hz Hot spare for drive with RSTe support...

Page 12: ...tivity on LANs when flashing Power Fail LED Indicates a power supply module has failed Information LED Alerts operator to several states as noted in the table below Information LED Color Status Descri...

Page 13: ...for BMC for indicator details see BMC LAN LEDs USB Four USB 3 0 ports LAN Two 10G BASE T ports VGA One video port UID Switch LED The unit identification UID button turns on or off the blue light func...

Page 14: ...vents where the power supply continues to operate high temperature over voltage under voltage etc Green blinking AC present only 12vsb on module off Green solid Output on functioning normally Expansio...

Page 15: ...ure This section shows the locations of the system electronic components Figure 1 4 Main Component Locations Storage Backplane BPN SAS3 846EL1 N8 Motherboard X12DPi N T 6 System Fans System Fans Power...

Page 16: ...ption Power Supply Dual redundant modules DIMM Slots 16 DIMM memory slots Processors 3rd Gen Intel Xeon Scalable with heatsinks System Fans Seven 8 cm fans with Optimal Fan Speed Control FAN 0166L4 Mo...

Page 17: ...MF1 P2 DIMMH1 CPU2 CPU1 CPU1 SLOT1 PCIe 4 0 X8 CPU1 SLOT2 PCIe 4 0 X16 CPU1 SLOT3 PCIe 4 0 X16 CPU2 SLOT4 PCIe 4 0 X16 CPU2 SLOT5 PCIe 4 0 X16 CPU2 SLOT6 PCIe 4 0 X8 P1 DIMMB1 P1 DIMMA1 P1 DIMMD1 P1 D...

Page 18: ...ce connector see Note below JNVI2 C NVMe I2 C header JPI2 C1 Power System Management Bus SMB I2 C header JPWR2 JPWR4 8 pin power connectors JPWR3 24 pin ATX power connector JSTBY1 Standby power header...

Page 19: ...header with support for two USB 2 0 ports USB2 3 USB7 8 3 0 Rear I O USB 3 0 ports USB4 5 3 0 Front accessible USB header with support for two USB 3 0 ports USB6 Internal Type A USB 3 0 port UID LED...

Page 20: ...SLOT 6 PECI 31 12 1 LAN3 To CMM W83773G 2 RT1 RT2 2666 2933 3200 2666 2933 3200 PCIe X16 DDR4 CPU2 C1 BMC PCIe X8 G4 CPU2 F1 SPI CPU1 CPU2 A1 UPI SPI 2666 2933 3200 PCIe GEN4 X16 0 5 PCIe X16 G4 CPU2...

Page 21: ...be situated in a clean dust free area that is well ventilated Avoid areas where heat electrical noise and electromagnetic fields are generated It will also require a grounded AC power outlet nearby Be...

Page 22: ...or larger servers Server Precautions Review the electrical and general safety precautions in Appendix A Determine the placement of each component in the rack before you install the rails Install the h...

Page 23: ...cern Reliable Ground A reliable ground must be maintained at all times To ensure this the rack itself should be grounded Particular attention should be given to power supply connections other than the...

Page 24: ...installation instructions that came with the specific rack you are using Identifying the Rails The chassis package includes two rail assemblies Each assembly consists of three sections An inner rail t...

Page 25: ...tely out of the rack when when the chassis is pulled out for servicing To mount the rail onto the chassis first release the inner rail from the outer rails 1 Pull the inner rail out of the outer rail...

Page 26: ...labeled 2 Place the inner rail firmly against the side of the chassis aligning the hooks on the side of the chassis with the holes in the inner rail 3 Slide the inner rail forward toward the front of...

Page 27: ...il adjusting the length until it just fits within the posts of the rack 5 Hang the hooks of the rear section of the outer rail onto the square holes on the rear of the rack Take care that the proper h...

Page 28: ...lustrated 2 Align the inner rails of the chassis with the outer rails on the rack 3 Slide the inner rails into the outer rails keeping the pressure even on both sides When the chassis has been pushed...

Page 29: ...e sufficient assistance supporting the chassis when removing it from the rack Use a lift 1 If necessary loosen the thumb screws on the front of the chassis that hold it in the rack 2 Pull the chassis...

Page 30: ...Removing Power Use the following procedure to ensure that power has been removed from the system This step is necessary when removing or installing non hot swap components or when replacing a non red...

Page 31: ...er from the system as described in Section 3 1 2 Remove the screws securing the cover to the chassis 3 Lift the cover off the chassis Check that all ventilation openings on the top cover and the top o...

Page 32: ...hat the plastic protective cover is on the CPU socket and that none of the socket pins are bent If they are contact your retailer When handling the processor avoid touching or placing direct pressure...

Page 33: ...down Locate the gold triangle at the corner of the processor and the corresponding hollowed triangle on the processor carrier as shown below These triangles indicate the location of pin 1 Latch Latch...

Page 34: ...of the processor under latch 1 on the carrier and then press the other end down until it snaps into latch 2 and is properly seated on the carrier Processor Carrier Assembly Top View Processor Carrier...

Page 35: ...derside of the heatsink 1 Turn the heatsink over with the thermal grease facing up Note the two triangle cutouts A B located at the diagonal corners of the heatsink as shown in the drawing below 2 On...

Page 36: ...nd Component Installation Installing the PHM into the CPU Socket 1 Remove the plastic protective cover from the CPU socket Gently squeeze the grip tabs then pull the cover off CPU Socket with Plastic...

Page 37: ...ting Wire 4 Threaded Fastener Heatsink CPU Socket Peek Nut Rotating Wire Side View Top View Unlatched State a b c d a b c d Threaded Fasteners CPU Socket Pin1 Threaded Fastener CPU Socket 2 Locate fou...

Page 38: ...B C D on the heatsink with threaded fasteners b c d on the CPU socket 6 Gently place the heatsink on the CPU socket making sure that each nut is properly aligned with its corresponding threaded fasten...

Page 39: ...CPU Socket Be sure the system is shut down and all AC power cords are unplugged 1 Use a t30 bit screwdriver to loosen the four PEEK nuts on the heatsink in the sequence of A B C and D A B C D Peek Nut...

Page 40: ...or Carrier Assembly from the PHM Detach the four plastic clips a b c d on the processor carrier assembly from the four corners of the heatsink A B C D as shown below and lift off the processor carrier...

Page 41: ...the Carrier Assembly Unlock the lever from its locked position and push it upwards to disengage the processor from the carrier as shown below right Carefully remove the processor from the carrier Proc...

Page 42: ...r Product Resources page DDR4 Memory Support for 3rd Gen Intel Xeon Scalable Processors Type Ranks Per DIMM and Data Width DIMM Capacity GB Speed MT s DRAM Density One DIMM per Channel Two DIMMs per C...

Page 43: ...MMs A1 B1 C1 D1 E1 F1 G1 H1 and PMem in B2 2 CPUs 2 DIMMs CPU1 A1 CPU2 A1 2 CPUs 4 DIMMs CPU1 A1 E1 CPU2 A1 E1 2 CPUs 6 DIMMs CPU1 A1 C1 E1 G1 CPU2 A1 E1 2 CPUs 8 DIMMs CPU1 A1 C1 E1 G1 CPU2 A1 C1 E1...

Page 44: ...MM Memory Mode Validation Matrix DDR4 DIMMs Validated with PMem 200 Series DIMM Type up to 3200 Ranks Per DIMM Data Width Stack DIMM Capacity GB DRAM Density 8Gb 16Gb RDIMM 1Rx8 N A N A 1Rx4 16GB 32G...

Page 45: ...Regarding Mixing DIMMs Populating slots with a pair of DIMM modules of the same type and size results in inter leaved memory which improves memory performance Use memory modules of the same type and s...

Page 46: ...power from the system as described in Section 3 1 Follow the memory population sequence in the table above 1 Push the release tabs outwards on both ends of the DIMM slot to unlock it Notches Release T...

Page 47: ...the motherboard Replacing the Battery Begin by removing power from the system 1 Push aside the small clamp that covers the edge of the battery When the battery is released lift it out of the holder 2...

Page 48: ...The drives are mounted in toolless drive carriers that simplify their removal from the chassis These carriers also help promote proper airflow Note Enterprise level hard disk drives are recommended fo...

Page 49: ...y removing the screws securing the dummy drive to the carrier These screws are not used to mount the actual drive Dummy Drive Hard Drive Carrier Removing a Hot Swap Drive Carrier from the Chassis 1 Pr...

Page 50: ...2 Insert a drive into the carrier with the connector end toward the rear of the carrier Align the drive in the carrier so that the screw holes line up Note that there are holes in the carrier marked...

Page 51: ...r shrouds concentrate airflow to maximize fan efficiency They do not require screws to install Installing the Standard Air Shrouds Position the air shrouds as illustrated in the figure below sliding t...

Page 52: ...LED displays the status Solid Green When illuminated indicates that the power supply is on Blinking Green When blinking indicates that the power supply is plugged in and turned off by the system Blin...

Page 53: ...53 Chapter 3 Maintenance and Component Installation Figure 3 9 Replacing the Power Supply Release Tab...

Page 54: ...nsert the expansion card into a slot on the motherboard while aligning the expansion card backplate with the open slot in the rear of the chassis Secure with a screw 4 Replace the cover and power 4 3...

Page 55: ...his section to route or reroute cables Proper routing is important to maintain airflow through the system Cable part numbers and descriptions are available at the Online Cable Matrix Backplane Power C...

Page 56: ...AN port 4 and two 10G BASE T ports 7 and 8 Unit Identifier SwitchW UID LED Indicator A Unit Identifier UID switch 10 and a UID LED indicator are located on the rear of the system When you press the UI...

Page 57: ...tion 1 4 Ground 5 8 12 Vdc 4 pin Power Pin Definitions Pin Definition 1 2 Ground 3 4 12Vdc 4 3 Headers and Connectors Fan Headers There are seven fan headers FAN1 FAN5 FANA FANB on the motherboard The...

Page 58: ...Header Pin Definitions Pin Definition Pin Definition 1 P3V3 2 SPI_TPM_CS_N 3 PCI E_RESET_N 4 SPI_PCH_MISO 5 SPI_PCH_CLK 6 Ground 7 SPI_PCH_MOSI 8 N A 9 JTPM1_P3V3A 10 IRQ_TPM_SPIN_N Disk On Module Pow...

Page 59: ...ct the appropriate cable here to use the IPMB I2 C connection on your system External I2 C Header Pin Definitions Pin Definition 1 Data 2 Ground 3 Clock 4 3V3_STBY NVMe I2 C Header Connector JNVI2 C1...

Page 60: ...Baseboard Management Controller BMC and a Network Interface Controller NIC Use a NIC add on card that supports NC SI and a special cable Please contact Supermicro at www supermicro com to purchase th...

Page 61: ...locations and definitions of the control panel buttons and LED indicators All JF1 wires have been bundled into a single cable to simplify this connection Make sure the red wire plugs into pin 1 as ma...

Page 62: ...On Overheat Flashing Fan Fail Overheat OH Fan Fail Connect an LED cable to pins 7 and 8 of JF1 to use the Overheat Fan Fail LED connections The LED on pin 8 provides warnings of overheat or fan failu...

Page 63: ...o pin 13 to use UID switch HDD LED Pin Definitions JF1 Pin Definition 13 3 3V Standby UID Switch 14 HDD Active Power LED The Power LED connection is located on pins 15 and 16 of JF1 Power LED Pin Defi...

Page 64: ...e the motherboard layout page for jumper locations Note On a two pin jumper Closed means the jumper is on both pins and Open indicates the jumper is either on only one pin or has been completely remov...

Page 65: ...beat indicator When the LED is blinking green BMC is functioning normally 4 5 LED Indicators Network LAN LEDs The Ethernet ports each have two LEDs One LED indicates activity when flashing green The o...

Page 66: ...dows OS and the RAID driver Refer to the RAID Configuration User Guides posted on our website at www supermicro com support manuals Installing the OS 1 Create a method to access the MS Windows install...

Page 67: ...iver browse the USB flash drive for the proper driver files For RAID choose the SATA sSATA RAID driver indicated then choose the storage drive on which you want to install it For non RAID choose the S...

Page 68: ...Another option is to go to the Supermicro website at www supermicro com Products Find the product page for your motherboard and Download the Latest Drivers and Utilities Insert the flash drive or disk...

Page 69: ...Network Management Protocol SNMP SuperDoctor 5 comes in local and remote management versions and can be used with Nagios to maximize your system monitoring needs With SuperDoctor 5 Management Server...

Page 70: ...related to BMC For general documentation and information on BMC visit our website at www supermicro com en solutions management software bmc resources BMC ADMIN User Password For security each system...

Page 71: ...age Control Card and Cable s TPM security module Intel VROC RAID Key 6 1 Additional Storage Drives The system supports two hot swap 2 5 SATA drives accessible from the chassis rear 6 2 Storage Control...

Page 72: ...d to connect a Trusted Platform Module TPM A TPM is a security device that supports encryption and authentication in hard drives It enables the motherboard to deny access if the TPM associated with th...

Page 73: ...Storage Technology enterprise Intel RSTe Driver for Linux Windows https downloadcenter intel com download 28108 Intel Virtual RAID on CPU Intel VROC and Intel Rapid Storage Technology enterprise Intel...

Page 74: ...he key options are Intel VROC Keys VROC Package Description Part Number Intel MM Number Standard RAID 0 1 10 Supports 3rd party SSDs AOC VROCSTNMOD 951605 Premium RAID 0 1 5 10 Supports 3rd party SSDs...

Page 75: ...s 2 Switch to Advanced Chipset Configuration North Bridge IIO Configuration Intel VMD Technology Figure 6 2 BIOS Selecting VMD Mode You can select a mode The default is Auto The VMD switch enables VMD...

Page 76: ...ptional Components Figure 6 3 BIOS Manual Mode Example your server may look different 3 Select the desired PStack to Enable or Disable the corresponding Intel VMD controller Figure 6 4 BIOS Enabling V...

Page 77: ...Capability can also be Enabled or Disabled Figure 6 5 BIOS Enabling VMD Functionality per Slot 5 Repeat steps 3 and 4 for each PStack on each CPU to be enabled or disabled In this example we enabled C...

Page 78: ...without first deleting the associated existing RAID volume can lead to unexpected behavior This action is strongly not recommended Note The effects of physically changing or swapping a CPU on the VMD...

Page 79: ...4 disks RAID1 Select only two disks RAID5 Select at least three 3 24 disks RAID10 Select only four disks 12 Select Strip Size Default 64KB 13 Select Create Volume 14 If another RAID is needed start ag...

Page 80: ...evice Hot plug Physically install the device ESXi will automatically discover NVMe SSDs but a manual scan may be required in some cases Related Information Links 1 https kb vmware com s article 215140...

Page 81: ...nsions Direct Links for the SSG 640P E1CR36 H L System Web SSG 640P E1CR36H and SSG 640P E1CR36L specifications page X12DPi N T 6 motherboard page for links to the Quick Reference Guide User Manual va...

Page 82: ...BMC For general documentation and information on BMC please visit our website at https www supermicro com en solutions management software bmc resources Figure 7 2 BMC Sample For validated memory use...

Page 83: ...it does not replace it with a new one Warning To avoid possible explosion do not install the battery upside down 8 Verify that all jumpers are set to their default positions C MAC CODE BIOS LICENSE B...

Page 84: ...les are properly and fully installed 2 Confirm that you are using the correct memory Also it is recommended that you use the same memory type and speed for all DIMMs in the system See section 3 4 for...

Page 85: ...e correct drivers are used If the system becomes unstable before or during OS installation check the following 1 Source of installation Make sure that the devices used for installation are working pro...

Page 86: ...to provide information to support staff You can download a crash dump of status information using BMC Check the BMC Error Log 1 Access the BMC web interface 2 Click the Server Health tab then Event L...

Page 87: ...e system Notes Clearing CMOS will also clear all passwords Do not use the PW_ON connector to clear CMOS JBT1 contact pads 7 6 BMC Reset The BMC can be reset using the UID button Reset Press and hold t...

Page 88: ...ou still cannot resolve the problem include the following information when contacting us for technical support System motherboard and chassis model numbers and PCB revision number BIOS release date ve...

Page 89: ...lure due to the alteration misuse abuse or improper maintenance of products During the warranty period contact your distributor first for any product problems Vendor Support Filing System For issues r...

Page 90: ...om Europe Address Super Micro Computer B V Het Sterrenbeeld 28 5215 ML s Hertogenbosch The Netherlands Tel 31 0 73 6400390 Fax 31 0 73 6416525 Email sales supermicro nl General Information support sup...

Page 91: ...ertified technicians should attempt to install or configure components Read this appendix in its entirety before installing or configuring components in the Supermicro chassis T h e s e w a r n i n g...

Page 92: ...idere los riesgos de la corriente el ctrica y familiar cese con los procedimientos est ndar de prevenci n de accidentes Al final de cada advertencia encontrar el n mero que le ayudar a encontrar el te...

Page 93: ...ient u zich bewust te zijn van de bij een elektrische installatie betrokken risico s en dient u op de hoogte te zijn van de standaard procedures om ongelukken te voorkomen Gebruik de nummers aan het e...

Page 94: ...n Attention Avant de brancher le syst me sur la source d alimentation consulter les directives d installation Circuit Breaker Waarschuwing Raadpleeg de installatie instructies voordat u het systeem o...

Page 95: ...el edificio Aseg rese de que el dispositivo de protecci n no sea superior a 250 V 20 A Attention Pour ce qui est de la protection contre les courts circuits surtension ce produit d pend de l installat...

Page 96: ...a y del cable el ctrico quitado de los m dulos de fuente de alimentaci n antes de tener acceso el interior del chasis para instalar o para quitar componentes de sistema Attention Le syst me doit tre...

Page 97: ...chuwing Voordat u toegang neemt tot het binnenwerk van de behuizing voor het installeren of verwijderen van systeem onderdelen dient u alle spanningsbronnen en alle stroomkabels aangesloten op de voed...

Page 98: ...lte nur geschultem qualifiziertem Personal gestattet werden Advertencia Solamente el personal calificado debe instalar reemplazar o utilizar este equipo Attention Il est vivement recommand de confier...

Page 99: ...de estas reas mediante la utilizaci n de una herramienta especial cerradura con llave u otro medio de seguridad Attention Cet appareil doit tre install e dans des zones d acc s r serv s L acc s une zo...

Page 100: ...verkregen worden door gebruik te maken van speciaal gereedschap slot en sleutel of andere veiligheidsmaatregelen Battery Handling Warning There is the danger of explosion if the battery is replaced in...

Page 101: ...eichen oder vom Hersteller empfohlenen Batterietyp Entsorgen Sie die benutzten Batterien nach den Anweisungen des Herstellers Attention Danger d explosion si la pile n est pas remplac e correctement N...

Page 102: ...n dass der Einheit kein trom zugef hrt wird m ssen alle Verbindungen entfernt werden Advertencia Puede que esta unidad tenga m s de una conexi n para fuentes de alimentaci n Para cortar por completo e...

Page 103: ...dous voltage or energy is present on the backplane when the system is operating Use caution when servicing Waarschuwing Deze eenheid kan meer dan n stroomtoevoeraansluiting bevatten Alle aansluitingen...

Page 104: ...ng Wenn das System in Betrieb ist treten auf der R ckwandplatine gef hrliche Spannungen oder Energien auf Vorsicht bei der Wartung Advertencia Cuando el sistema est en funcionamiento el voltaje del pl...

Page 105: ...Electrical Codes Warnung Die Installation der Ger te muss den Sicherheitsstandards entsprechen Advertencia La instalacion del equipo debe cumplir con las normas de electricidad locales y nacionales A...

Page 106: ...regulations Advertencia Al deshacerse por completo de este producto debe seguir todas las leyes y reglamentos nacionales Attention La mise au rebut ou le recyclage de ce produit sont g n ralement sou...

Page 107: ...chasis Mandtenga los dedos los destornilladores y todos los objetos lejos de las aberturas del ventilador Attention Pieces mobiles dangereuses Se tenir a l ecart des lames du ventilateur Il est possib...

Page 108: ...al Safety Law prohibits the use of UL or CSA certified cables that have UL CSA shown on the cord for any other electrical devices than products designated by Supermicro only Waarschuwing Gevaarlijk be...

Page 109: ...eln und oder Adapater die Ihre rtlichen Sicherheitsstandards einhalten Der Gebrauch von anderen Kabeln und Adapter k nnen Fehlfunktionen oder Feuer verursachen Die Richtlinien untersagen das Nutzen vo...

Page 110: ...voldoen aan de lokale voorschriften en veiligheidsnormen inclusief de juiste kabeldikte en stekker Het gebruik van niet geschikte Kabels en of Adapters kan een storing of brand veroorzaken Wetgeving v...

Page 111: ...uper DOMs disk on module ports PCI Expansion Slots Four PCIe 4 0 x16 low profile Two PCIe 4 0 x8 low profile see Section 3 9 for details Input Output LAN Two RJ45 10G BASE T one RJ45 dedicated BMC LAN...

Page 112: ...EN 61000 4 2 BS EN 61000 4 3 BS EN 61000 4 4 BS EN 61000 4 5 BS EN 61000 4 6 BS EN 61000 4 8 BS EN 61000 4 11 Product Safety 2014 35 EU LVD Directive UL CSA 62368 1 USA and Canada Electrical Equipmen...

Search results

Summary of Contents for SuperServer SSG-640P-E1CR36H

Reviews:

Related manuals for SuperServer SSG-640P-E1CR36H

Brands by name

Popular brands

Supermicro SuperServer SSG-640P-E1CR36H, User Manual

Search results

Summary of Contents for SuperServer SSG-640P-E1CR36H

Reviews:

Related manuals for SuperServer SSG-640P-E1CR36H

Brands by name

Popular brands