background image

Relion 1800GT

Technical Guide

Rev. 1.0

PENGUIN

 COMPUTING

www.penguincomputing.com | 1-888-PENGUIN (736-4846) | twitter:@PenguinHPC

Versatile Enterprise and HPC Server featuring the latest Intel Technology

Summary of Contents for SUPERSERVER 1027GR-TRF

Page 1: ...Relion 1800GT Technical Guide Rev 1 0 PENGUIN COMPUTING www penguincomputing com 1 888 PENGUIN 736 4846 twitter PenguinHPC Versatile Enterprise and HPC Server featuring the latest Intel Technology...

Page 2: ...SUPER SUPERSERVER 1027GR TRF 1027GR TRFT USER S MANUAL Revision 1 0a...

Page 3: ...any such disputes Super Micro s total liability for all claims will not exceed the price paid for the hardware product FCC Statement This equipment has been tested and found to comply with the limits...

Page 4: ...the server system and describes the main features of the Super X9DRG HF X9DRG HTF serverboard and the SC118GQ R1800B chassis Chapter 2 Server Installation This chapter describes the steps necessary t...

Page 5: ...ng the serverboard Chapter 6 Advanced Chassis Setup Refer to Chapter 6 for detailed information on the SC118GQ R1800B 1U rackmount server chassis You should follow the procedures given in this chapter...

Page 6: ...v Preface Notes...

Page 7: ...e System 2 1 2 3 Preparing for Setup 2 1 Choosing a Setup Location 2 1 Rack Precautions 2 2 Server Precautions 2 2 Rack Mounting Considerations 2 3 Ambient Operating Temperature 2 3 Reduced Airflow 2...

Page 8: ...d Serverboard Setup 5 1 Handling the Serverboard 5 1 Precautions 5 1 Unpacking 5 2 5 2 Serverboard Installation 5 2 5 3 Connecting Cables 5 3 Connecting Data Cables 5 3 Connecting Power Cables 5 3 Con...

Page 9: ...Bay Installation Removal 6 7 Accessing the Drive Bays 6 7 Hard Drive Installation 6 7 6 5 Power Supply 6 8 Chapter 7 BIOS 7 1 Introduction 7 1 Starting BIOS Setup Utility 7 1 How To Change the Configu...

Page 10: ...CP 240 00117 0N Two passive CPU heatsinks one each of SNK P0047PS and SNK P0047PSC Riser Cards One RSC R1UG E16A X9 for PCI Express 3 0 x16 card left front side One RSC R1UG E16B X9 for PCI Express 3...

Page 11: ...details Serial ATA A SATA controller is integrated into the chipset to provide a 4 port SATA subsystem which is RAID 0 1 5 and 10 supported Two of these are SATA 3 0 ports and two are SATA 2 0 ports...

Page 12: ...Q R1800B chassis includes four 2 5 drive bays which may be used to house hot swappable SATA drives RAID 0 1 5 and 10 are supported Front Control Panel The control panel provides a system monitoring an...

Page 13: ...s which place this system at the forefront of today s GPU computing solutions Please refer to the NVIDIA web site www nvidia com for details on Fermi GPUs Notes The GPUs can be bundled with the system...

Page 14: ...3 4 SPI VGA Port Dedicated LAN DMI2 BMC WPCM450 PCI E X16 PCI E X16 G3 PCI USB 2 0 SATA2 SAS1 E5 2600 Series 8 SNB CORE DDR3 8 SNB CORE DDR3 DMI2 DMI2 2 3 1 1 2 3 QPI 8G 4GB s PCI E X16 VGA PCI E X8 G...

Page 15: ...pe Address Super Micro Computer B V Het Sterrenbeeld 28 5215 ML s Hertogenbosch The Netherlands Tel 31 0 73 6400390 Fax 31 0 73 6416525 Email sales supermicro nl General Information support supermicro...

Page 16: ...r It should be situated in a clean dust free area that is well ventilated Avoid areas where heat electrical noise and electromagnetic fields are generated You will also need it placed near a grounded...

Page 17: ...is stable before extending a component from the rack You should extend only one component at a time extending two or more si multaneously may cause the rack to become unstable Rack mounted equipment...

Page 18: ...hat the amount of airflow required for safe operation is not compromised Mechanical Loading Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanica...

Page 19: ...g Note This rail will fit a rack between 26 and 33 5 deep Identifying the Sections of the Rack Rails The chassis package includes two rack rail assemblies in the rack mounting kit Each assembly consis...

Page 20: ...a server rack Attaching the inner rail extensions to to the inner rails stabilizes the chassis within the rack Installing the Inner Rail Extensions 1 Place the inner rail extensions B over the preatt...

Page 21: ...mounting on to the rack Assembling the Outer Rails 1 Identify the left and right outer rails by examining the ends which bend outward 2 Slide the front section of the outer rail A into the rear sectio...

Page 22: ...o the proper length so that the outer rail fits snugly within the rack 2 Align the holes on the front of the outer rail with the holes on the front of the rack C and secure with the screws provided 3...

Page 23: ...into the front of the outer rails 2 Push the chassis backward into the rack until it clicks into the locked postion Removing the Chassis From a Rack 1 Press the outer rail latch to release the chassi...

Page 24: ...r follow the server will extend out the front of the rack Larger chassis should be positioned to balance the weight between front and back If a bezel is included on your server remove it Then at tach...

Page 25: ...2 10 SUPERSERVER 1027GR TRF 1027GR TRFT User s Manual Notes...

Page 26: ...ntrol panel as well as others on the drive carri ers to keep you constantly informed of the overall status of the system as well as the activity and health of specific components There are also two bu...

Page 27: ...continuously on not flash ing it indicates an overheat condition which may be caused by cables obstructing the airflow in the system or the ambient room temperature being too warm Check the routing o...

Page 28: ...ing accessed Please refer to Chapter 6 for instructions on replacing failed SATA drives Red The red LED to indicate a SATA drive failure If one of the SATA drives fail you should be notified by your s...

Page 29: ...3 4 SUPERSERVER 1027GR TRF 1027GR TRFT User s Manual Notes...

Page 30: ...e operating system first and then unplug the power cords of all the power supply units in the system When working around exposed electrical circuits another person who is familiar with the power off c...

Page 31: ...s product may be connected to an IT power system In all cases make sure that the unit is also reliably connected to Earth ground Serverboard Battery CAUTION There is a danger of explosion if the onboa...

Page 32: ...PCBs come into contact with your clothing which may retain a charge even if you are wearing a wrist strap Handle a board by its edges only do not touch its components peripheral chips memory modules o...

Page 33: ...this practice is not strictly followed Figure 4 1 Installing the Onboard Battery T UM TTER TTER O ER Please handle used batteries carefully Do not damage the battery in any way a damaged battery may...

Page 34: ...tant to handle them very carefully see previous chapter To prevent the serverboard from bending keep one hand under the center of the board to support it when handling The following measures are gener...

Page 35: ...then pull the cover off 2 Make sure that the I O ports on the serverboard align properly with their respective holes in the I O shield at the back of the chassis 3 Carefully mount the serverboard to...

Page 36: ...for connector locations SATA drive data cables I SATA0 3 SATA sideband cable T SGPIO 1 Control Panel cable JF1 GPU power cables JPW3 JPW7 and JPW11 SATA backplane power cable JPW5 Important Make sure...

Page 37: ...in conformance with the PC 99 specification See Figure 5 2 below for the colors and locations of the various I O ports Figure 5 1 Control Panel Header Pins Figure 5 2 I O Ports NMI x Key 3 3V FP UID...

Page 38: ...e to install the serverboard into the chassis before you install the CPU heatsinks When receiving a serverboard without a processor pre installed make sure that the plastic CPU socket cap is in place...

Page 39: ...the WARNING plastic cap from the socket 5 Use your thumb and index finger to hold the CPU by its edges Align the CPU keys which are semi circle cutouts against the socket keys 6 Once they are aligned...

Page 40: ...make sure that they are flush with the socket 8 Close the load plate Lock the lever labeled Close 1st then lock the lever labeled Open 1st Use your thumb to gently push the load levers down until the...

Page 41: ...two remaining screws then finish the installation by fully tightening all four screws Installing a CPU Heatsink Removing the Heatsink 1 Unscrew and remove the heatsink screws from the serverboard in t...

Page 42: ...le vertically into its slot Pay attention to the notch along the bottom of the module to avoid installing incorrectly see Figure 5 4 3 Gently press down on the DIMM module until it snaps into place in...

Page 43: ...s in pairs 1 CPU 2 DIMMs CPU1 P1 A1 P1 B1 1 CPU 4 DIMMs CPU1 P1 A1 P1 B1 P1 C1 P1 D1 2 CPUs 4 DIMMs CPU1 CPU2 P1 A1 P1 B1 P2 E1 P2 F1 2 CPUs 6 DIMMs CPU1 CPU2 P1 A1 P1 B1 P1 C1 P1 D1 P2 E1 P2 F1 2 CPU...

Page 44: ...to offering support for three GPU cards the 1027GR TRF 1027GR TRFT supports one low profile PCI Express 3 0 x8 expansion card in x16 slot A riser card is required to support expansion cards Refer to...

Page 45: ...I SATA0 S SATA0 S SATA1 S SATA2 S SATA3 DM1 LE1 DM2 JPL1 JWD1 J30 JPB1 J29 JPBR1 JPME1 JWP1 JPG1 FAN2 FAN1 FANF FAND FANH FANC FANG FANE FAN4 FAN3 FANA FANB T SGPIO5 T SGPIO1T SGPIO2 I SATA3 I SATA4...

Page 46: ...Battery Onboard Battery FAN1 FAN4 CPU Fans FANA FANH GPU Fans JCOM1 COM Header for Front Chassis Access JF1 Control Panel Header JL1 Chassis Intrusion Header JOH1 Overheat LED Indicator JI2 C1 JI2 C2...

Page 47: ...when CPU2 is populated SW1 UID Switch T SGPIO 1 2 S Serial Link General Purpose I O Headers USB 0 1 Back Panel USB Ports LED Description State Status DM1 BMC Heartbeat LED Green BMC Normal LE1 Standby...

Page 48: ...finition 1 Power Button 2 Ground Power Connectors Three SMC proprietary power connectors are located at JPW1 JPW2 and JPW9 to provide main power to the serverboard Seven 12V 8 pin power connectors lo...

Page 49: ...failure The blue LED pin 7 works as the UID LED indicator for the front panel UID button located on pins 13 14 of JF1 When Jumper J_UID_OW is set to off default the red LED takes precedence over the b...

Page 50: ...m See the table on the right for pin definitions Power LED Pin Definitions JF1 Pin Definition 15 3 3V 16 Control HDD UID LED Pin Definitions JF1 Pin Definition 13 UID Signal 3 3V 14 HDD Activity Fan H...

Page 51: ...e Input Output headers are provided on the serverboard These headers sup port serial link interfaces for the onboard SATA ports See the table on the right for pin definitions T SGPIO Pin Definitions P...

Page 52: ...are located on the I O backplane Connect USB devices to these ports Ethernet Ports Two Ethernet ports are located next to the USB 0 1 on the IO backplane In addition an IPMI Dedicated LAN is located...

Page 53: ...posted on our Website UID Switch Pin Definition 1 Button In 2 Ground 3 Ground 4 Ground UID LED LE4 Status Color State OS Status Blue On Windows OS Unit Identified Blue Blinking Linux OS Unit Identifi...

Page 54: ...2 1 CMOS Clear JBT1 is used to clear CMOS which will also clear any passwords Instead of pins this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS To clear CMOS...

Page 55: ...mper settings Watch Dog must also be enabled in BIOS Note When enabled the user needs to write their own application software in order to disable the Watch Dog Timer Watch Dog Jumper Settings Jumper S...

Page 56: ...cted Green System On Green Flashing Quickly ACPI S1 State BMC Enable Disable Jumper Settings Both Jumpers Definition Pins 1 2 Enabled Pins 2 3 Disabled BMC Enable Disable Use jumper JPB1 to enable or...

Page 57: ...ht for more information BMC Heatbeat LED Indicator LED Status Green Blinking BMC Normal Rear UID LED The rear UID LED is located at LE4 on the backplane This LED is used in conjunc tion with the rear...

Page 58: ...aged with your system Driver Tool Installation Display Screen Note Click the icons showing a hand writing on paper to view the readme files for each item Click the computer icons to the right of these...

Page 59: ...ys crucial system information such as CPU temperature system voltages and fan status See the Figure below for a display of the Supero Doctor III interface Note The default User Name and Password for S...

Page 60: ...ded from our Web Site at ftp ftp supermicro com utility Supero_Doctor_III You can also download the SDIII User s Guide at http www supermicro com manuals other SDIII_User_Guide pdf For Linux we will r...

Page 61: ...5 28 SUPERSERVER 1027GR TRF 1027GR TRFT User s Manual Notes...

Page 62: ...t damage to any printed circuit boards PCBs it is important to handle them very carefully The following measures are generally sufficient to protect your equipment from ESD damage Precautions Use a gr...

Page 63: ...See Chapter 3 System In terface for details on the LEDs and the control panel buttons Details on JF1 can be found in Chapter 5 Advanced Serverboard Installation 6 3 System Cooling Ten 4 cm counter ro...

Page 64: ...e the position of the failed fan Never run the server for an extended period of time with the top cover open 2 Turn off the power to the system and unplug the AC power cord 3 Remove the failed fan s w...

Page 65: ...the Air Shroud Installing the Air Shroud Air shrouds concentrate airflow to maximize fan efficiency The SC118GQ chassis air shroud does not require screws to set up Note that each GPU card has its ow...

Page 66: ...ets Kepler cards require a different bracket than Fermi cards MCP 240 00117 0N The system comes with Fermi brackets al ready installed by default If replacing Fermi GPUs with Kepler GPUs remove the Fe...

Page 67: ...ards 1 2 Airflow Important Note for Kepler GPUs note the airflow arrows on top of the GPU card The card with the arrow pointing toward the Tesla logo should go on the left side of the chassis and the...

Page 68: ...andle 2 Use the handle to pull the drive carrier out of the chassis Installing a Hard Drive into a Drive Carrier 1 Remove the dummy drive which comes pre installed in the drive carrier by removing the...

Page 69: ...n 1800 watt redundant power supply consisting of two power modules Each power supply module has an auto switching capability which enables it to automatically sense and operate at a 100V 240V input vo...

Page 70: ...ule 3 Use the handle to pull it straight out with the rounded handle Installing a New Power Supply 1 Replace the failed hot swap unit with another identical power supply unit 2 Push the new power supp...

Page 71: ...6 10 SUPERSERVER 1027GR TRF 1027GR TRFT Series User s Manual Notes...

Page 72: ...plays all the options that can be configured Grayed out options cannot be configured Options in blue can be configured by the user The right frame displays the key legend Above the key legend is an ar...

Page 73: ...utility From the main menu you can access the other setup screens An AMI BIOS identification string is displayed at the left bottom corner of the screen below the copyright message Warning Do not upg...

Page 74: ...Tab key to move between fields The date must be entered in Day MM DD YY format The time is entered in HH MM SS format Note The time is in the 24 hour format For example 5 30 P M appears as 17 30 00 S...

Page 75: ...ormal POST messages The op tions are Enabled and Disabled AddOn ROM Display Mode Use this item to set the display mode for the Option ROM Select Keep Current to use the current AddOn ROM Display setti...

Page 76: ...the system will power off immediately as soon as the user presses the power button If this feature is set to 4 Seconds Override the system will power off when the user presses the power button for 4...

Page 77: ...ket 1 or Socket 2 supports 64 bit technology Clock Spread Spectrum Select Enable to enable Clock Spectrum support which will allow the BIOS to moni tor and attempt to reduce the level of Electromagnet...

Page 78: ...o use the Intel Advanced Encryption Standard AES New Instruc tions NI to ensure data security The options are Enabled and Disabled MLC Streamer Prefetcher Available when supported by the CPU If set to...

Page 79: ...d Energy Efficient and Custom If the option is set to Custom the following items will display EIST Available when Power Technology is set to Custom EIST Enhanced Intel SpeedStep Technology allows the...

Page 80: ...nce Bias This setting allows the user to adjust the fan speed based on performance maxi mum cooling or energy efficiency maximum energy savings The options are Performance Balanced Performance Balance...

Page 81: ...g and data sharing The options are Enabled and Disabled Data Direct I O Select Enabled to enable Intel I OAT I O Acceleration Technology which sig nificantly reduces CPU overhead by leveraging CPU arc...

Page 82: ...for the slot specified above The options are Gen1 Generation 1 Gen2 and Gen3 CPU2 Slot 4 PCI E 3 0 x16 OPROM This feature allows the user to set the PCI Exp bus speed for the slot specified above The...

Page 83: ...ry modules detected by the BIOS will be displayed as detected by the BIOS Memory Mode When Independent is selected all DIMMs are available to the operating system When Mirroring is selected the mother...

Page 84: ...day The options are Enabled and Disabled Demand Scrub Demand Scrubbing is a process that allows the CPU to correct correctable memory errors found on a memory module When the CPU or I O issues a deman...

Page 85: ...when USB Functions is not Disabled Select Enabled to support legacy USB devices Select Auto to disable legacy sup port if USB devices are not present Select Disable to have USB devices available for E...

Page 86: ...e is selected Aggressive Link Power Management Select Enabled to enable Aggressive Link Power Management support for Cougar Point B0 stepping and beyond The options are Enabled and Disabled Port 0 5 H...

Page 87: ...gacy ROM PCI Latency Timer Use this feature to set the latency Timer of each PCI device installed on a PCI bus Select 64 to set the PCI latency to 64 PCI clock cycles The options are 32 64 96 128 160...

Page 88: ...OPROM Select Enabled to enable Option ROM support to boot the computer using a network interface from the slots specified above The options are Enabled and Disabled Onboard LAN Option ROM Select Selec...

Page 89: ...he AMI BIOS to automatically select the best PECI setting Device Mode Use this feature to select the desired mode for a serial port specified The options are Normal and High Speed XSOL Configuration S...

Page 90: ...e Redirection Select VT100 to use the ASCII Character set Select VT100 to add color and function key support Select ANSI to use the Extended ASCII Char acter Set Select VT UTF8 to use UTF8 encoding to...

Page 91: ...mpty The options are None and Hardware RTS CTS VT UTF8 Combo Key Support Select Enabled to enable VT UTF8 Combination Key support for ANSI VT100 terminals The options are Enabled and Disabled Recorder...

Page 92: ...ect VT UTF8 to use UTF8 encoding to map Unicode characters into one or more bytes The options are ANSI VT100 VT100 and VT UTF8 Bits Per Second This item sets the transmission speed for a serial port u...

Page 93: ...ck RTC does in synchronizing multimedia streams providing smooth playback reducing the de pendency on other timestamp calculation devices such as an x86 RDTSC Instruc tion embedded in the CPU The High...

Page 94: ...eature Intel TXT LT SX Configuration This feature displays the following TXT configuration setting TXT LT SX Support This item indicates if the Intel TXT support is enabled or disabled Intel TXT LT SX...

Page 95: ...Exit Intel I350 Gigabit Network Connections These items display the following information on the Intel I350 LAN connections XNIC Configuration Link Speed Use this feature to change the link speed and...

Page 96: ...gs Select the Event Logs tab to access the following submenu items XChange SMBIOS Event Log Settings This feature allows the user to configure SMBIOS Event settings Enabling Disabling Options SMBIOS E...

Page 97: ...IOS error event logs that ex ceed the limit when the SMBIOS event log is full Select Do Nothing for the system to do nothing when the SMBIOS event log is full The options are Do Nothing and Erase Imme...

Page 98: ...ect the IPMI Intelligent Platform Management Interface tab to access the fol lowing submenu items IPMI Firmware Revision This item indicates the IPMI firmware revision used in your system IPMI Status...

Page 99: ...Network Configuration LAN Channel 1 This feature allows the user to configure the settings for LAN1 Port Update IPMI LAN Configuration This feature allows the user to decide if the BIOS should config...

Page 100: ...teway IP Address This item displays the Gateway IP address for this computer This should be in decimal and in dotted quad form i e 192 168 10 253 7 6 Boot This submenu allows the user to configure the...

Page 101: ...to configure the following security settings for the system Administrator Password Use this feature to set the Administrator Password which is required to enter the BIOS setup utility The length of t...

Page 102: ...Reset When you have completed the system configuration changes select this option to save the changes and reboot the computer so that the new system configuration settings can take effect Select Save...

Page 103: ...lts Save as User Defaults Select this feature and press Enter to save the current settings as the user s defaults When the dialog box appears asking you if you want to save values as user s defaults c...

Page 104: ...ors will not allow the system to continue the boot up procedure If a fatal error occurs you should consult with your system manufacturer for possible repairs BIOS POST Error Codes Beep Code Error Mess...

Page 105: ...A 2 SUPERSERVER 1027GR TRF 1027GR TRFT User s Manual Notes...

Page 106: ...emory section in Chapter 5 for details GPUs Graphics Processing Units A total of three GPUs are supported true PCI E 3 0 x16 signal SATA Controller Intel on chip controller for 10 SATA ports RAID 0 1...

Page 107: ...C 40 to 140 F Operating Relative Humidity 8 to 90 non condensing Non Operating Relative Humidity 5 to 95 non condensing Regulatory Compliance Electromagnetic Emissions FCC Class A EN 55022 Class A EN...

Page 108: ...orm be reasonably expected to result in significant injury or loss of life or catastrophic property damage Accordingly Supermicro dis claims any and all liability and should buyer use or sell such pro...

Page 109: ...B 4 SUPERSERVER 1027GR TRF 1027GR TRFT Series User s Manual Notes...

Reviews: