manualshive.com logo in svg

Supermicro SuperServer 510P-WT/WTR, Руководство пользователя

Поделиться
Скачать
Supermicro SuperServer 510P-WT/WTR Скачать руководство пользователя страница 80

80

Chapter 7: Troubleshooting and Support

7.1 Information Resources

Website

A great deal of information is available on the Supermicro website, 

supermicro.com

.

• 

Specifications for servers and other hardware are available by clicking the menu icon, then 

selecting the 

Products

 option.

• 

The 

Support

  option  offers  downloads  (manuals,  BIOS/IPMI,  drivers,  etc.),  FAQs,  RMA, 

warranty, and other service extensions.

Direct Links for the 510P-WT/WTR System

Web 

SYS-510P-WT/WTR

 specifications page

X12SPW-TF motherboard page

 for links to the Quick Reference Guide, User Manual, 

validated storage drives, etc.

BPN-SAS3-815TQ-N4 Backplane Manual

Figure 7-1. Supermicro Website

Chapter 7  

 

Troubleshooting and Support

Menu Icon

Содержание SuperServer 510P-WT/WTR

Страница 1: ...TR Проконсультироваться и купить данное оборудование вы можете в компании АНД Системс адрес 125480 г Москва ул Туристская д 33 1 site https andpro ru тел 7 495 545 4870 email info andpro ru При обращении используйте промокод AND PDF и получите скидку ...

Страница 2: ... Class A device or in residential environment for Class B device This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the manufacturer s instruction manual may cause harmful interference with radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case you will be requir...

Страница 3: ...and utilities https www supermicro com wdl driver Product safety info http www supermicro com about policies safety_information cfm If you have any questions please contact our support team at support supermicro com This manual may be periodically updated without notice Please check the Supermicro website for possible updates to the manual revision level Secure Data Deletion A secure data deletion...

Страница 4: ...Table 17 Chipset Block Diagram 19 Chapter 2 Server Installation 2 1 Overview 20 2 2 Unpacking the System 20 2 3 Preparing for Setup 20 Choosing a Setup Location 20 Rack Precautions 21 Server Precautions 21 Rack Mounting Considerations 21 Ambient Operating Temperature 21 Airflow 22 Mechanical Loading 22 Circuit Overloading 22 Reliable Ground 22 2 4 Installing the Rails 23 Identifying the Sections o...

Страница 5: ...n 33 Installing the Processor Heatsink Module 34 Removing the Processor Heatsink Module 36 3 4 Memory 37 Memory Support 37 General Guidelines for Optimizing Memory Performance 38 DIMM Installation 39 DIMM Removal 39 3 5 Motherboard Battery 40 3 6 Storage Drives 41 Front Bezel 41 Hard Drives 41 Installing Drives 41 Checking the Temperature of an NVMe Drive 44 DVD ROM Drive Installation 44 Hard Driv...

Страница 6: ...71 6 2 DC Power Supply 72 6 3 Inlet Thermal Sensor 72 6 4 3 5 to 2 5 Converter Trays 72 6 5 2 5 NVMe Drive Trays 72 6 6 NVMe Cables 72 6 7 Storage Control Cards and Cable s 72 6 8 CacheVault s 73 Installing the SuperCap Kit via Fan Tray 73 Installing the SuperCap Kit via the PCIe Bracket 73 6 9 TPM Security Module 74 6 10 Intel Virtual RAID on CPU VROC 75 Requirements and Restrictions 75 Supported...

Страница 7: ... Power 83 No Video 83 System Boot Failure 84 Memory Errors 84 Losing the System s Setup Configuration 85 When the System Becomes Unstable 85 7 4 Crash Dump Using IPMI 87 7 5 CMOS Clear 88 7 6 Where to Get Replacement Components 89 7 7 Reporting an Issue 89 Technical Support Procedures 89 Returning Merchandise for Service 89 Vendor Support Filing System 90 7 8 Feedback 90 7 9 Contacting Supermicro ...

Страница 8: ... V Het Sterrenbeeld 28 5215 ML s Hertogenbosch The Netherlands Tel 31 0 73 6400390 Fax 31 0 73 6416525 Email sales supermicro nl General Information support supermicro nl Technical Support rma supermicro nl Customer Support Website www supermicro nl Asia Pacific Address Super Micro Computer Inc 3F No 150 Jian 1st Rd Zhonghe Dist New Taipei City 235 Taiwan R O C Tel 886 2 8226 3990 Fax 886 2 8226 3...

Страница 9: ...USB 2 0 ports System Cooling 5 4cm counter rotating fans Passive heatsink for 1U system Power Redundant 500W 510P WTR or single 600W 510P WT power supply Platinum Level Certified Form Factor 1U WxHxD 17 2 x 1 7 x 25 6in 437 x 43 x 650mm Note The Quick Reference Guide can be found on the product page for 510P WT WTR Note The following safety agency or regulatory models associated with the 510P WT W...

Страница 10: ... of the status indicator is described in the table below For OS RAID or non RAID configurations some LED indications are not supported such as hot spare For VROC configurations refer to the VROC appendix in this manual Drive Carrier LED Indicators Color Blinking Pattern Behavior for Device Activity LED Blue Solid On Idle SAS NVMe drive installed Blue Blinking I O activity Off Idle SATA drive Statu...

Страница 11: ...nated when the system is operating Reset Button The reset button is used to reboot the system Power Button The main power button is used to apply or remove power from the power supply to the server Turning off system power with this button removes the main power but maintains standby power To perform many maintenance tasks you must also unplug system before servicing Information LED Status Descrip...

Страница 12: ... Feature Description Power Supplies Two redundant power supply modules PWS1 on the right PWS2 on the left COM Serial port IPMI LAN IPMI LAN port when speed indicator is green connection is 100 Mb s USB Two USB 3 2 Gen 1 ports two USB 2 0 ports LAN Two LAN ports VGA Video port UID Switch LED UID button see Control panel description Power Supply 2 COM Port IPMI LAN Port USB Ports LAN Ports VGA Port ...

Страница 13: ...ower supply critical events causing a shutdown failure OCP OVP fan failure OTP UVP Off On Power supply warning events when the power supply continues to operate high temperature over voltage under voltage etc Off Blinking at 1Hz AC present and only 12VSB on PS off Blinking at 1Hz Off Output ON and OK On Off AC cord unplugged and in redundant mode Off On ...

Страница 14: ... Single PCIe 3 0 x4 SATA3 M 2 SuperDOM ports Disk on Module port allows for flash cards to be mounted directly on the motherboard DIMM slots Dual in line memory module DIMM slots Processor Intel Xeon Scalable Processor System fans 4cm counter rotating fans used to provide cooling for the system 8 DIMM Slots 2 SuperDOM Ports 5 System Fans Processor Power Supply Module s 1 M 2 Slot ...

Страница 15: ...on covers the locations of the system electrical components a cable routing diagram and block diagrams of the motherboard and the overall system Main Components Figure 1 5 Main Component Locations RSC W 66G4 RSC WR 6 X12SPW TF Storage Backplane BPN SAS3 815TQ N4 ...

Страница 16: ...E2 3 MH16 MH15 JPI2C1 JIPMB1 JNVI2C JI2C_EXP1 MH4 MH6 MH1 MH9 MH5 MH3 MH2 JPME1 JPL2 JMP2 JMP1 JPL1 JPL3 SXB2 PCI E 4 0 X16 SXB1A SXB1B PCI E 4 0 X16 X16 SXB1C COM2 I SATA4 7 M 2 H COM1 DIMMG1 DIMMH1 DIMME1 DIMMF1 DIMMA1 DIMMB1 DIMMD1 DIMMC1 CPU USB6 7 3 0 USB4 5 3 0 USB2 3 LAN2 LAN1 CMOS CLEAR I SATA0 3 TPM PORT80 UID SW UID LED VGA USB0 1 IPMI_LAN USB8 3 0 LE3 LEDBMC LE4 FAN2 DIMMC1 DIMMD1 DIMMA...

Страница 17: ...agement Bus SMBus I2 C JIPMB1 4 pin BMC External I2 C Header for an BMC card JL1 Chassis Intrusion Header JNCSI1 NC SI Header for IPMI Support NVME0 1 NVME2 3 PCIe 4 0 x8 Slimline SAS Connector JNVI2 C NVMe I2 C Header JPI2 C1 Power System Management Bus SMB I2 C Header JPWR1 8 pin Power Connector JPWR2 4 pin Power Connector JPWR3 24 pin ATX Power Connector JRK1 Intel RAID Key Header JSD1 JSD2 SAT...

Страница 18: ...SB0 1 Back Panel Universal Serial Bus USB 2 0 Ports USB2 3 Front Accessible USB 2 0 Headers USB4 5 3 2 Gen 1 Back Panel USB 3 2 Gen 1 Ports USB6 7 3 2 Gen 1 Front Accessible USB 3 2 Gen 1 Header USB8 3 2 Gen 1 USB 3 2 Gen 1 Type A Header VGA VGA Port ...

Страница 19: ...G4 2666 2933 3200 2666 2933 3200 2666 2933 3200 PCI E GEN4 X16 PCI E GEN3 X8 CPLD PFR SPI SPI NAND FLASH 1 G 1 U P C 1 F 1 U P C CPU1 H1 DDR4 DDR4 DDR4 DDR4 2666 2933 3200 2666 2933 3200 2666 2933 3200 2666 2933 3200 CPU1 E1 PCI E X16 WIOR 3A PCI E GEN4 X8 PCI E GEN4 X8 PCI E TWO X4 G4 WIOL PCI E X32 PCI E TWO X4 G4 6 0 Gb S 1 0 sSATA SATA DOM Mini SAS HD SATA 0 7 SSATA0 PCI E X4 G3 0 3 PCI E X4 G...

Страница 20: ...the server It should be situated in a clean dust free area that is well ventilated Avoid areas where heat electrical noise and electromagnetic fields are generated It will also require a grounded AC power outlet nearby Be sure to read the precautions and considerations noted in Appendix A 2 3 Preparing for Setup The box in which the system was shipped should include the rackmount hardware needed t...

Страница 21: ...ty precautions in Appendix A Determine the placement of each component in the rack before you install the rails Install the heaviest server components at the bottom of the rack first and then work your way up Use a regulating uninterruptible power supply UPS to protect the server from power surges and voltage spikes and to keep your system operating in case of a power failure Allow any drives and ...

Страница 22: ... be maintained at all times To ensure this the rack itself should be grounded Particular attention should be given to power supply connections other than the direct connections to the branch circuit i e the use of power strips etc To prevent bodily injury when mounting or servicing this unit in a rack you must take special precautions to ensure that the system remains stable The following guidelin...

Страница 23: ...Identifying the Sections of the Rack Rails You should have received two rack rail assemblies in the rack mounting kit Each assembly consists of two sections an inner fixed chassis rail that secures directly to the server chassis and an outer fixed rack rail that secures directly to the rack itself see Figure 2 1 Two pairs of short brackets to be used on the front side of the outer rails are also i...

Страница 24: ...e of the outer rail with three screws Repeat these steps for the left outer rail Locking Tabs Both chassis rails have a locking tab which serves two functions The first is to lock the server into place when installed and pushed fully into the rack which is its normal position Secondly these tabs lock the server in place when fully extended from the rack This prevents the server from coming complet...

Страница 25: ...ils into the rack rails keeping the pressure even on both sides you may have to press the locking tabs when inserting See Figure 2 3 3 When the server has been pushed completely into the rack you should hear the locking tabs click Figure 2 3 Installing the Server into a Rack Note Figure is for illustrative purposes only Always install servers to the bottom of a rack first Slide rail mounted equipm...

Страница 26: ... chassis should be positioned so that the weight is balanced between front and back 2 Attach the two front brackets to each side of the chassis then the two rear brackets positioned with just enough space to accommodate the width of the rack 3 Finish by sliding the chassis into the rack and tightening the brackets to the rack Figure 2 4 Installing the Server into a Telco Rack Note The figure above...

Страница 27: ... Please follow the procedures given in each section 3 1 Removing Power Use the following procedure to ensure that power has been removed from the system This step is necessary when removing or installing non hot swap components or when replacing a non redundant power supply 1 Use the operating system to power down the system 2 After the system has completely shut down disconnect the AC power cord ...

Страница 28: ...d pull the unit straight out until it locks you will hear a click 3 Depress the two buttons on the top of the chassis to release the top cover and at the same time push the cover away from you until it stops 4 Lift the top cover from the chassis to gain full access to the inside of the server Check that all ventilation openings on the top cover and the top of the chassis are clear and unobstructed...

Страница 29: ...plastic protective cover is on the CPU socket and none of the socket pins are bent If they are contact your retailer When handling the processor avoid touching or placing direct pressure on the LGA lands gold contacts Improper installation or socket misalignment can cause serious damage to the processor or CPU socket which may require manufacturer repairs Thermal grease is pre applied on a new hea...

Страница 30: ...rocessor Carrier Assembly The processor carrier assembly contains the Intel Xeon processor and a processor carrier 1 Plastic Protective Cover 2 CPU Socket 1 Processor 2 Processor Carrier Overview of the CPU Socket The CPU socket is protected by a plastic protective cover ...

Страница 31: ...cessor carrier These triangles indicate pin 1 The triangles can be found on the top and bottom of the processor See the images below 2 Using the triangles as a guide carefully align and place Point A of the processor into the carrier Then gently snap in the other side of the carrier for the processor to fasten into Point B 3 Examine all corners to ensure that the processor is firmly attached to th...

Страница 32: ...h the thermal grease facing up Note the two triangle cutouts A B located at the diagonal corners of the heatsink as shown in the drawing below 2 On the processor carrier assembly find pin 1 as noted by the triangles Hold the processor carrier assembly over so that the gold LGA is facing up 3 Align clip a pin 1 on the carrier assembly with the triangular cutout A on the heatsink and b c d on the ca...

Страница 33: ...stic protective cover installed on the CPU socket Remove it from the socket to install the Processor Heatsink Module PHM Gently squeeze the grip tabs then pull the cover off Remove the plastic protective cover from the CPU socket Do not touch or bend the socket pins Socket Pins CPU Socket with Plastic Protective Cover Grip Tabs ...

Страница 34: ...ur rotating wires 1 2 3 4 on the heatsink as shown below a b c d a b c d Threaded Fasteners CPU Socket Pin1 Threaded Fastener CPU Socket Heatsink A B C D Peek Nut 1 2 3 4 Rotating Wire a b c d Threaded Fastener Peek Nut Unlatched latched Rotating Wire B D Rotating Wire2 Rotating Wire 4 Rotating Wire 3 Peek Nut A C Rotating Wire 1 CPU Socket 3 Check that the rotating wires 1 2 3 4 are in the unlatc...

Страница 35: ...tsink on the CPU socket making sure that each nut is properly aligned with its corresponding threaded fastener 6 Press all four rotating wires outward to latch the PHM onto the CPU socket 7 With a t30 bit screwdriver tighten all PEEK nuts in the sequence of A B C and D with even pressure not greater than 12 lbf in Latched State Top View a b c d Threaded Fastener on the CPU socket A B C D a b c d A...

Страница 36: ...n unplug the AC power cord from all power supplies Then follow the steps below 1 Use a t30 bit screwdriver to loosen the four PEEK nuts on the heatsink in the sequence of A B C and D Peek Nut Rotating Wire Side View Top View Unlatched State A B C D Peek Nut 2 Press the four rotating wires inward to unlatch the PHM as shown below 3 Gently lift the PHM upward to remove it from the CPU socket ...

Страница 37: ... DIMMA1 DIMME1 DIMMC1 DIMMG1 6 DIMMA1 DIMME1 DIMMC1 DIMMG1 DIMMB1 DIMMF1 8 DIMMA1 DIMME1 DIMMC1 DIMMG1 DIMMB1 DIMMF1 DIMMD1 DIMMH1 Type Ranks Per DIMM and Data Width DIMM Capacity GB Speed MT s Voltage V Slot Per Channel SPC and DIMM Per Channel DPC Data below assumes 2 SPC unless otherwise noted 1DPC 8 Gb 16 Gb 1 2V RDIMM SRx8 8 GB 16 GB 3200 SRx4 16 GB 32 GB DRx8 16 GB 32 GB DRx4 32GB 64 GB RDIM...

Страница 38: ...ormance use DDR4 memory of the same type size and speed Mixed DIMM speeds can be installed However all DIMMs will run at the speed of the slowest DIMM The motherboard will support odd numbered modules one or three modules installed However to achieve the best memory performance a balanced memory population is recommended ...

Страница 39: ...ID LED VGA USB0 1 IPMI_LAN USB8 3 0 FAN2 DIMM Installation 1 Insert the desired number of DIMMs into the memory slots based on the recommended DIMM population table on page 37 2 Push the release tabs outwards on both ends of the DIMM slot to unlock it 3 Align the key of the DIMM module with the receptive point on the memory slot 4 Align the notches on both ends of the module against the receptive ...

Страница 40: ...he motherboard Replacing the Battery Begin by removing power from the system 1 Push aside the small clamp that covers the edge of the battery When the battery is released lift it out of the holder 2 To insert a new battery slide one edge under the lip of the holder with the positive side facing up Then push the other side down until the clamp snaps over it Note Handle used batteries carefully Do n...

Страница 41: ...Unlock the front of the chassis and then press the release knob 2 Carefully remove the bezel with both hands A filter located within the bezel can be removed for replacement cleaning It is recommended that you keep a maintenance log to list filter cleaning replacement dates since its condition affects the airflow throughout the whole system Hard Drives Your server may or may not have come with har...

Страница 42: ...rives are installed all drive carriers must remain in the drive bays to maintain proper airflow Note Enterprise level hard disk drives are recommended for use in Supermicro chassis and servers For information on recommended HDDs visit the Supermicro website 1 2 Removing a Hot Swap Drive Carrier from the Chassis 1 Press the release button on the drive carrier which will extend the drive carrier han...

Страница 43: ...ndicates that the carrier has been fully seated and connected to the midplane which automatically makes the power and logic connections to the hard drive Figure 3 6 Mounting a Drive in a Carrier Removing a Drive from a Drive Carrier 1 Remove the screws that secure the hard drive to the carrier and separate the hard drive from the carrier 2 Replace the carrier back into the drive bay Note Your oper...

Страница 44: ... Checking the Temperature of an NVMe Drive There are two ways to check using IPMI Checking a Drive IPMI Server Health NVMe SSD Shows the temperatures of all NVMe drives IPMI Server Health Sensor Reading NVME_SSD Shows the single highest tem perature among all the NVMe drives Hard Drive Carrier Indicators Each hard drive carrier has two LED indicators an activity indicator and a status indicator In...

Страница 45: ... includes five pre installed fans One additional open slot is available so that one more fan may be added if additional cooling is required These fans are NOT redundant hot plug and so must be replaced when they fail Fan speed is controlled by system temperature via IPMI If a fan fails the remaining fans will ramp up to full speed Replace any failed fan at your earliest convenience with the same t...

Страница 46: ...the 510P WT WTR 5 5 Place the new fan into the vacant space in the housing while making sure the arrows on the top of the fan indicating air direction point in the same direction as the arrows on the other fans 6 Reconnect the fan wires to the same chassis fan header as the previous fan 7 Power up the system and check that the fan is working properly before replacing the chassis cover ...

Страница 47: ...10P WTR includes a redundant power supply which allows the server to continue running when one power supply has been removed Replacement units can be ordered directly from Supermicro Replacing the Power Supply 1 Unplug the AC power cord from the failed power supply module with the RED LED lit up 2 Push the release tab on the back of the power supply as illustrated then pull the power supply out us...

Страница 48: ...he front control panel or on the chassis rear Reset Press and hold the button After six seconds the LED blinks at 2Hz The BMC resets and the reset duration is 250ms Then the BMC starts to boot Restore factory default configuration Hold the button for 12 seconds The LED blinks at 4Hz while defaults are configured Firmware update When the BMC firmware is updated the UID LED blinks at 10Hz dur ing th...

Страница 49: ...necting cables to add or replace components refer to this diagram when adding or replacing components so you can reroute them in the same manner Proper cable routing is important in maintaining proper airflow through the system Online Cable Matrix NVMe Cable Optional CBL SAST 1154 85 SATA Cable CBL SAST 0699 SAS Cable for 3808 3908 Optional CBL SAST 1275A 100 Figure 3 10 Cable Routing Diagram ...

Страница 50: ...ions in Appendix A before installing or removing components 4 1 Power Connections Two power connections supply the motherboard and several more supply for onboard devices ATX Power Supply Connector The 24 pin power supply connector JPWR3 meets the ATX SSI EPS 12V specification You must also connect the 8 pin JPWR1 and 4 pin JPWR2 processor power connector to the power supply Required Connection AT...

Страница 51: ...rtant To provide adequate power supply to the motherboard be sure to connect the 24 pin ATX PWR the 8 pin PWR and 4 pin PWR connectors to the power supply Failure to do so may void the manufacturer warranty on your power supply and motherboard Required Connection 4 pin Power Pin Definitions Pin Definition 1 2 Ground 3 4 P12V 12V Power 4 Pin Power Connector JPWR2 is an 4 pin 12V DC power input for ...

Страница 52: ...lack 2 2 5A 12V Red 3 Tachometer 4 PWM_Control SGPIO Headers There is one Serial Link General Purpose Input Output S SGPIO1 header located on the motherboard S SGPIO is for sSATA use Refer to the tables below for pin definitions SGPIO Header Pin Definitions Pin Definition Pin Definition 1 NC 2 NC 3 Ground 4 Data 5 Load 6 Ground 7 Clock 8 NC NC No Connection Disk On Module Power Connector Two power...

Страница 53: ...ated at JIPMB1 Connect the appropriate cable here to use the IPMB I2 C connection on your system Refer to the table below for pin definitions External I2 C Header Pin Definitions Pin Definition 1 Data 2 Ground 3 Clock 4 No Connection Standby Power The Standby Power header is located at JSTBY1 on the motherboard You must have a card with a Standby Power connector and a cable to use this feature Ref...

Страница 54: ...on card that supports NC SI and also need to have a special cable Please contact Supermicro at www supermicro com to purchase the cable for this header Refer to the table below for pin definitions NCSI Pin Definition Pin Definition Pin Definition 1 NCSI Clock 2 Ground 3 NCSI_CRS_DV 4 Ground 5 NCSI_RX_D0 6 Ground 7 NCSI_RX_D1 8 Ground 9 NCSI_TX_D0 10 Ground 11 NCSI_TX_D1 12 Ground 13 NCSI_TX_EN 14 ...

Страница 55: ...Definitions Pin Definition 1 Clock 2 Data 3 PMBUS_Alert 4 Ground 5 3 3V M 2 Slot The X12SPW TF F motherboard has one M 2 slot M 2 was formerly known as Next Generation Form Factor NGFF and serves to replace mini PCIe M 2 allows for a variety of card sizes increased functionality and spatial efficiency The M 2 socket on the motherboard supports PCIe 3 0 x4 SSD cards in the 2280 and 22110 form facto...

Страница 56: ...Ground Power Fail LED NIC2 Active LED NMI 3 3V OH Fan Fail LED 3 3V Stby Reset Button Pin Definitions JF1 Pins Definition 3 Reset 4 Ground Power Button Pin Definitions JF1 Pins Definition 1 Signal 2 Ground Power Button The Power Button connection is located on pins 1 and 2 of JF1 Momentarily contacting both pins will power on off the system This button can also be configured to function as a suspe...

Страница 57: ...JF1 Refer to the table below for pin definitions Power Fail LED Pin Definitions JF1 Pin Definition 5 3 3V 6 PWR Supply Fail NIC1 NIC2 LAN1 LAN2 The NIC Network Interface Controller LED connection for LAN port 1 is located on pins 11 and 12 of JF1 and LAN port 2 is on pins 9 and 10 Attach the NIC LED cables here to display network activity Refer to the table below for pin definitions LAN1 LAN2 LED ...

Страница 58: ...fer to the table below for pin definitions Power LED Pin Definitions JF1 Pins Definition 15 3 3V 16 PWR LED NMI Button The non maskable interrupt NMI button header is located on pins 19 and 20 of JF1 Refer to the table below for pin definitions NMI Button Pin Definitions JF1 Pins Definition 19 Control 20 Ground ...

Страница 59: ... 3 USB 0 4 USB 1 5 USB 4 3 2 Gen 1 6 USB 5 3 2 Gen 1 7 LAN1 8 LAN2 9 VGA 10 UID switch 1 4 6 VGA Port A video VGA port is located next to LAN2 on the I O back panel Refer to the board layout below for the location COM Ports There are two COM connection on this motherboard COM1 is located on the I O back panel COM2 is located next to MH1 COM Port Pin Definitions Pin Definition Pin Definition 1 DCD ...

Страница 60: ... 1000 LED Amber 13 TD1 23 SGND 14 TD2 24 SGND 15 TD2 25 SGND 16 TD3 26 SGND 17 TD3 18 GND Unit Identifier Switch UID LED Indicator A Unit Identifier UID switch and an LED Indicator are located on the motherboard The UID switch is located at UID SW which is next to the VGA port on the back panel The UID LED is located next to the switch When you press the UID switch the UID LED will be turned on Pr...

Страница 61: ...a_SSRX B5 USB3_RN A6 Stda_SSRX B6 USB3_RP A7 GND B7 GND A8 Stda_SSTX B8 USB3_TN A9 Stda_SSTX B9 USB3_TP Back Panel USB 0 1 2 0 Pin Definitions Pin Definition Pin Definition 1 5V 5 5V 2 USB_N 6 USB_N 3 USB_P 7 USB_P 4 Ground 8 Ground Front Panel USB 2 3 2 0 Pin Definitions Pin Definition Pin Definition 1 5V 2 5V 3 USB_N 4 USB_N 5 USB_P 6 USB_P 7 Ground 8 Ground 9 Key 10 NC Front Panel USB 6 7 3 2 G...

Страница 62: ...er or shorting device 6 Replace the cover reconnect the power cord s and power on the system Note Clearing CMOS will also clear all passwords Do not use the PW_ON connector to clear CMOS 4 4 Jumpers Explanation of Jumpers To modify the operation of the motherboard jumpers are used to choose between optional settings Jumpers create shorts between two pins to change the function associated with it P...

Страница 63: ... must also be enabled in the BIOS Watchdog Jumper Settings Jumper Setting Definition Pins 1 2 Reset Pins 2 3 NMI Open Disabled ME Manufacturing Mode Close pins 2 3 of jumper JPME1 to bypass SPI flash security and force the system to operate in the manufacturing mode which will allow the user to flash the system firmware from a host server for system setting modifications Refer to the table below f...

Страница 64: ...LED is located near the UID switch on the I O back panel This UID indicator provides easy identification of a system unit that may need service IPMI LAN LEDs In addition to LAN1 and LAN2 an IPMI LAN is also located on the I O back panel The amber LED on the right indicates activity while the LED on the left indicates the speed of the connection Refer to the table below for more information IPMI LA...

Страница 65: ...support manuals NVM Express Connections There are two Slimline SAS connectors located on the motherboard to support two PCIe 4 0 x4 NVMe connections This connector provides high speed and low latency connections directly from the CPU to NVMe Solid State SSD drives This greatly increases SSD data throughput performance and significantly reduces PCIe latency by simplifying driver software requiremen...

Страница 66: ...supermicro com support manuals Installing the OS 1 Create a method to access the MS Windows installation ISO file That might be a DVD perhaps using an external USB SATA DVD drive or a USB flash drive or the IPMI KVM console 2 Retrieve the proper RST RSTe driver Go to the Supermicro web page for your motherboard and click on Download the Latest Drivers and Utilities select the proper driver and cop...

Страница 67: ...river browse the USB flash drive for the proper driver files For RAID choose the SATA sSATA RAID driver indicated then choose the storage drive on which you want to install it For non RAID choose the SATA sSATA AHCI driver indicated then choose the storage drive on which you want to install it 5 Once all devices are specified continue with the installation 6 After the Windows OS installation has c...

Страница 68: ...nother option is to go to the Supermicro website at http www supermicro com products Find the product page for your motherboard and Download the Latest Drivers and Utilities Insert the flash drive or disk and the screenshot shown below should appear Figure 5 3 Driver Tool Installation Screen Note Click the icons showing a hand writing on paper to view the readme files for each item Click the compu...

Страница 69: ...vides alerts via email or Simple Network Management Protocol SNMP SuperDoctor 5 comes in local and remote management versions and can be used with Nagios to maximize your system monitoring needs With SuperDoctor 5 Management Server SSM Server you can remotely control power on off and reset chassis intrusion for multiple systems with SuperDoctor 5 or IPMI SD5 Management Server monitors HTTP FTP and...

Страница 70: ... The sticker also displays the BMC MAC address Figure 5 5 BMC Password Label See Chapter 1 for the locations of the labels BIOS LICENSE 1 BAR CODE IPMI CODE MAC CODE SAN MAC DESIGNED IN USA X12SPW TF F REV 2 00 JNCSI1 S SGPIO1 JBT1 JPWR2 JSD2 JSD1 S SATA1 S SATA0 JSTBY1 JRK1 JPWR3 JPWR1 JF1 JVRM2 JVRM1 JPFR3 JPFR2 JPFR1 JL1 JD1 JPRG1 JWD1 JP4 FAN6 FAN7 FAN4 FAN3 FAN5 FAN1 BT1 NVME0 1 NVME2 3 MH16 ...

Страница 71: ... 2 5 NVMe Drive Tray MCP 220 00138 0B NVMe Cable Drive Bays 0 1 CBL SAST 1149 85 1 NVMe Cable Drive Bays 2 3 CBL SAST 1154 85 1 Storage Control Card and Cable s AOC S3008L L8I 1 AOC S3008L L8E AOC S3108L H8iR 16DD AOC S3808L L8IT 1x CBL SAST 1275A 100 AOC S3908L H8iR 16DD 1x CBL SAST 1275A 100 CacheVault s BTR CV3108 1U1 for S3108 1 BTR TFM8G LSICVM02 BKT BBU BRACKET 05 for S3108 BTR CVPM05 BKT BB...

Страница 72: ...90cm AOC S3908L H8iR 16DD 1x CBL SAST 1275A 100 Std LP 8 internal ports 12Gb s per port Gen4 16HDD RAID 0 1 5 6 10 50 60 Slimline x8 STR to 4x SATA P1 75cm P2 75cm P3 90cm 6 5 2 5 NVMe Drive Trays The HDD bays can be used for up to four NVMe drives by installing tool less black hot swap 2 5 NVMe drive trays MCP 220 00138 0B orange tab with key lock and clip design 6 3 Inlet Thermal Sensor Universa...

Страница 73: ...h Supercap mounting in 1U 40x56mm fan tray CacheVault for Broadcom 3108 Supercap mounting bracket for PCIe location CacheVault for Broadcom 3908 3916 Supercap mounting bracket for PCIe location Installing the SuperCap Kit via Fan Tray Installing the SuperCap Kit via the PCIe Bracket ...

Страница 74: ...1 header is used to connect a Trusted Platform Module TPM A TPM is a security device that supports encryption and authentication in hard drives It enables the motherboard to deny access if the TPM associated with the hard drive is not installed in the system Details and installation procedures are at http www supermicro com manuals other TPM pdf ...

Страница 75: ...Storage Technology enterprise Intel RSTe Driver for Linux Windows https downloadcenter intel com download 28108 Intel Virtual RAID on CPU Intel VROC and Intel Rapid Storage Technology enterprise Intel RSTe Driver for Windows To enable Intel VROC a hardware key must be inserted on the motherboard and the ap propriate processor s Virtual Management Devices must be enabled in the BIOS setup It is pos...

Страница 76: ...The key options are Intel VROC Keys VROC Package Description Part Number Intel MM Number Standard RAID 0 1 10 Supports 3rd party SSDs AOC VROCSTNMOD 951605 Premium RAID 0 1 5 10 Supports 3rd party SSDs AOC VROCPREMOD 951606 Intel SSD only RAID 0 1 5 10 Supports Intel SSDs only AOC VROCINTMOD 956822 Additional Information Additional information is available on the product page for the Supermicro ad...

Страница 77: ...e For M 2 NVMe or NVMe AIC enable the VMD according to which add on card or slot it used Examples for some U 2 configurations follow 6 Press F4 to save the configuration and reboot the system 7 Press DEL to enter BIOS 8 Switch to Advanced Intel R Virtual RAID on CPU All Intel VMD Controllers Create RAID Volume 9 Set Name 10 Set RAID Level 11 If cross controller RAID is required select Enable RAID ...

Страница 78: ...ther manufacturers Under vSphere ESXi several steps are necessary to avoid potential stability issues See the information at link 1 below Hot unplug 1 Prevent devices from being re detected during rescan esxcli storage core claiming autoclaim enabled false 2 Unmount the VMFS volumes on the device Check 2 for details 3 Detach the device Check 3 for details 4 Physically remove the device Status Indi...

Страница 79: ...be required in some cases Related Information Links 1 https kb vmware com s article 2151404 2 https docs vmware com en VMware vSphere 6 5 com vmware vsphere storage doc GUID 1B56EF97 F60E 4F21 82A7 8F2A7294604D html 3 https docs vmware com en VMware vSphere 6 5 com vmware vsphere storage doc GUID F2E75F67 740B 4406 9F0C A2D99A698F2A html ...

Страница 80: ...hen selecting the Products option The Support option offers downloads manuals BIOS IPMI drivers etc FAQs RMA warranty and other service extensions Direct Links for the 510P WT WTR System Web SYS 510P WT WTR specifications page X12SPW TF motherboard page for links to the Quick Reference Guide User Manual validated storage drives etc BPN SAS3 815TQ N4 Backplane Manual Figure 7 1 Supermicro Website C...

Страница 81: ...Guide General Memory Configuration Guide X12 IPMI User Guide SuperDoctor5 Large Deployment Guide For validated memory use our Product Resources page Product Matrices page for links to tables summarizing specs for systems motherboards power supplies riser cards add on cards etc Security Center for recent security notices Supermicro Phone and Addresses ...

Страница 82: ...he Intelligent Platform Management Interface IPMI IPMI is used to provide remote access monitoring and management There are several BIOS settings that are related to IPMI For general documentation and information on IPMI please visit our website at https www supermicro com solutions IPMI cfm Figure 7 2 IPMI Sample ...

Страница 83: ...lly seated and connect the front panel connectors to the motherboard No Power 1 Make sure that there are no short circuits between the motherboard and the chassis 2 Make sure that the ATX power connectors are properly connected 3 Check that the 115V 230V switch if available on the power supply is properly set 4 Turn the power switch on and off to test the system if applicable 5 The battery on your...

Страница 84: ...m with only one DIMM module installed If the system boots check for bad DIMM modules or slots by following the Memory Errors Troubleshooting procedure in this chapter Memory Errors When a no memory beep code is issued by the system check the following 1 Make sure that the memory modules are compatible with the system and are properly installed See Chapter 2 for installation instructions For memory...

Страница 85: ...port Make sure that all hard disk drives HDDs work properly Replace the bad HDDs with good ones 4 System cooling Check the system cooling to make sure that all heatsink fans and CPU system fans etc work properly Check the hardware monitoring settings in the IPMI to make sure that the CPU and system temperatures are within the normal range Also check the front panel Overheat LED and make sure that ...

Страница 86: ...tion to make sure that it works properly Replace a bad component with a good one 5 Check and change one component at a time instead of changing several items at the same time This will help isolate and identify the problem 6 To find out if a component is good swap this component with a new one to see if the system will work properly If so then the old component is bad You can also install the comp...

Страница 87: ...u can download a crash dump of status information using IPMI The IPMI manual is available at https www supermicro com solutions IPMI cfm Check IPMI Error Log 1 Access the IPMI web interface 2 Click the Server Health tab then Event Log to verify an IERR error checked BOM Figure 7 1 IPMI Event Log In the event of an IERR the IPMI executes a crash dump You must download the crash dump and save it ...

Страница 88: ...wn the system completely 2 Remove the cover of the chassis to access the motherboard 3 Remove the onboard battery from the motherboard 4 Short the CMOS pads with a metal object such as a small screwdriver for at least four seconds 5 Remove the screwdriver or shorting device 6 Replace the cover reconnect the power cords and power on the system Notes Clearing CMOS will also clear all passwords Do no...

Страница 89: ... boot block code 3 If you still cannot resolve the problem include the following information when contacting us for technical support System motherboard and chassis model numbers and PCB revision number BIOS release date version this can be seen on the initial display when your system first boots up System configuration An example of a Technical Support form is posted on our website Distributors F...

Страница 90: ...lure due to the alteration misuse abuse or improper maintenance of products During the warranty period contact your distributor first for any product problems Vendor Support Filing System For issues related to Intel use the Intel IPS filing system https www intel com content www us en design support ips training welcome html For issues related to Red Hat Enterprise Linux since it is a subscription...

Страница 91: ...om Europe Address Super Micro Computer B V Het Sterrenbeeld 28 5215 ML s Hertogenbosch The Netherlands Tel 31 0 73 6400390 Fax 31 0 73 6416525 Email sales supermicro nl General Information support supermicro nl Technical Support rma supermicro nl Customer Support Website www supermicro nl Asia Pacific Address Super Micro Computer Inc 3F No 150 Jian 1st Rd Zhonghe Dist New Taipei City 235 Taiwan R ...

Страница 92: ...ring components in the Supermicro chassis These warnings may also be found on our website at http www supermicro com about policies safety_information cfm Warning Definition 警告の定義 この警告サインは危険を意味します 人身事故につながる可能性がありますので いずれの機器でも動作させる前に 電気回路に含まれる危険性に注意して 標準的な事故防止策に精通して下さい 此警告符号代表危险 您正处于可能受到严重伤害的工作环境中 在您使用设备开始工作之前 必须充分意识到触电 的危险 并熟练掌握防止事故发生的标准工作程序 请根据每项警告结尾的声明号码找到此设 备的安全性警告说明的翻译文本 此警告符號代表危險 您正處於可能身體可能會受...

Страница 93: ... número que le ayudará a encontrar el texto traducido en el apartado de traducciones que acompaña a este dispositivo GUARDE ESTAS INSTRUCCIONES IMPORTANTES INFORMATIONS DE SÉCURITÉ Ce symbole d avertissement indique un danger Vous vous trouvez dans une situation pouvant entraîner des blessures ou des dommages corporels Avant de travailler sur un équipement soyez conscient des dangers liés aux circ...

Страница 94: ...risico s en dient u op de hoogte te zijn van de standaard procedures om ongelukken te voorkomen Gebruik de nummers aan het eind van elke waarschuwing om deze te herleiden naar de desbetreffende locatie BEWAAR DEZE INSTRUCTIES Installation Instructions Warning Read the installation instructions before connecting the system to the power source 設置手順書 システムを電源に接続する前に 設置手順書をお読み下さい 警告 将此系统连接电源前 请先阅读安装说明 ...

Страница 95: ...를 읽어주십시오 Waarschuwing Raadpleeg de installatie instructies voordat u het systeem op de voedingsbron aansluit サーキッ ト ブレーカー この製品は 短絡 過電流 保護装置がある建物での設置を前提としています 保護装置の定格が250 V 20 Aを超えないこ とを確認下さい 警告 此产品的短路 过载电流 保护由建筑物的供电系统提供 确保短路保护设备的额定电流不大于 250V 20A 警告 此產品的短路 過載電流 保護由建築物的供電系統提供 確保短路保護設備的額定電流不大於 250V 20A Warning This product relies on the building s installation for short circuit overcurrent protection...

Страница 96: ...ension ce produit dépend de l installation électrique du local Vérifiez que le courant nominal du dispositif de protection n est pas supérieur à 250 V 20 A 경고 이 제품은 전원의 단락 과전류 방지에 대해서 전적으로 건물의 관련 설비에 의존합니다 보호장치의 정격이 반드시 250V 볼트 20A 암페어 를 초과하지 않도록 해야 합니다 Waarschuwing Dit product is afhankelijk van de kortsluitbeveiliging overspanning van uw electrische installatie Controleer of het beveiligde apara...

Страница 97: ... zu entfernen Advertencia El sistema debe ser disconnected de todas las fuentes de energía y del cable eléctrico quitado de los módulos de fuente de alimentación antes de tener acceso el interior del chasis para instalar o para quitar componentes de sistema Attention Le système doit être débranché de toutes les sources de puissance ainsi que de son cordon d alimentation secteur avant d accéder à l...

Страница 98: ...ied personnel should be allowed to install replace or service this equipment 機器の設置 トレーニングを受け認定された人だけがこの装置の設置 交換 またはサービスを許可されていま す 警告 只有经过培训且具有资格的人员才能进行此设备的安装 更换和维修 警告 只有經過受訓且具資格人員才可安裝 更換與維修此設備 Warnung Das Installieren Ersetzen oder Bedienen dieser Ausrüstung sollte nur geschultem qualifiziertem Personal gestattet werden امداد وحدة من انكهرباء سهك انت ز وإ انطاقت مصادر جميع من اننظاو فصم يجب قبم ان...

Страница 99: ...rtencia Solamente el personal calificado debe instalar reemplazar o utilizar este equipo Attention Il est vivement recommandé de confier l installation le remplacement et la maintenance de ces équipements à des personnels qualifiés et expérimentés Warning This unit is intended for installation in restricted access areas A restricted access area can be accessed only through the use of a special too...

Страница 100: ...ès réservés L accès à une zone d accès réservé n est possible qu en utilisant un outil spécial un mécanisme de verrouillage et une clé ou tout autre moyen de sécurité 경고 이 장치는 접근이 제한된 구역에 설치하도록 되어있습니다 특수도구 잠금 장치 및 키 또는 기타 보안 수단을 통해서만 접근 제한 구역에 들어갈 수 있습니다 Waarschuwing Dit apparaat is bedoeld voor installatie in gebieden met een beperkte toegang Toegang tot dergelijke gebieden kunnen alleen verkrege...

Страница 101: ... incorrecta Reemplazar la batería exclusivamente con el mismo tipo o el equivalente recomendado por el fabricante Desechar las baterías gastadas según las instrucciones del fabricante 電池の取り扱い 電池交換が正しく行われなかった場合 破裂の危険性があります 交換する電池はメーカーが推 奨する型 または同等のものを使用下さい 使用済電池は製造元の指示に従って処分して下さい 警告 电池更换不当会有爆炸危险 请只使用同类电池或制造商推荐的功能相当的电池更换原有电 池 请按制造商的说明处理废旧电池 警告 電池更換不當會有爆炸危險 請使用製造商建議之相同或功能相當的電池更換原有電池 請按 照製造商的說明指示處理廢棄舊...

Страница 102: ...upplies Warning This unit might have more than one power supply connection All connec tions must be removed to de energize the unit 冗長電源装置 このユニッ トは複数の電源装置が接続されている場合があります ユニッ トの電源を切るためには すべての接続を取り外さなければなりません 警告 此部件连接的电源可能不止一个 必须将所有电源断开才能停止给该部件供电 警告 此裝置連接的電源可能不只一個 必須切斷所有電源才能停止對該裝置的供電 Warnung Dieses Gerät kann mehr als eine Stromzufuhr haben Um sicherzustellen dass der Einheit kein trom zugeführt wir...

Страница 103: ...exión para fuentes de alimentación Para cortar por completo el suministro de energía deben desconectarse todas las conexiones Attention Cette unité peut avoir plus d une connexion d alimentation Pour supprimer toute tension et tout courant électrique de l unité toutes les connexions d alimentation doivent être débranchées אחד מספק יותר קיים אם אזהרה לרוקן מנת על החיבורים כל את להסיר יש ספק של אחד ...

Страница 104: ... bei der Wartung Advertencia Cuando el sistema está en funcionamiento el voltaje del plano trasero es peligroso Tenga cuidado cuando lo revise Attention Lorsque le système est en fonctionnement des tensions électriques circulent sur le fond de panier Prendre des précautions lors de la maintenance Warning Hazardous voltage or energy is present on the backplane when the system is operating Use cauti...

Страница 105: ...에는 위험한 전압이나 에너지가 발생 합니다 서비스 작업 시 주의하십시오 Waarschuwing Een gevaarlijke spanning of energie is aanwezig op de backplane wanneer het systeem in gebruik is Voorzichtigheid is geboden tijdens het onderhoud Attention L équipement doit être installé conformément aux normes électriques nationales et locales 警告 设备安装必须符合本地与本国电气法规 警告 設備安裝必須符合本地與本國電氣法規 Warning Installation of the equipment must comply with loc...

Страница 106: ...有國家的法律和規章進行 Warnung Die Entsorgung dieses Produkts sollte gemäß allen Bestimmungen und Gesetzen des Landes erfolgen Warning Ultimate disposal of this product should be handled according to all national laws and regulations Advertencia Al deshacerse por completo de este producto debe seguir todas las leyes y reglamentos nacionales הארצי החשמל חוקי תיאום אזהרה והארציים המקומיים החשמל לחוקי תואמת להי...

Страница 107: ...eep away from moving fan blades The fans might still be turning when you remove the fan assembly from the chassis Keep fingers screwdrivers and other objects away from the openings in the fan assembly s housing ファン ホッ トスワップの警告 警告 回転部品に注意 運転中は回転部 羽根 に触れないでく ださい シャーシから冷却ファン装 置を取り外した際 ファンがまだ回転している可能性があります ファンの開口部に 指 ドライバ ー およびその他のものを近づけないで下さい 警告 警告 危险的可移动性零件 请务必与转动的风扇叶片保持距离 当您从机架移除风扇装置 风扇可能仍在转动 小心不要将...

Страница 108: ...enez garde à ce que doigts tournevis et autres objets soient éloignés du logement du bloc ventilateur 경고 움직이는 위험한 부품 회전하는 송풍 날개에 접근하지 마세요 섀시로부터 팬 조립품을 제거할 때 팬은 여전히 회전하고 있을 수 있습니다 팬 조림품 외관의 열려있는 부분들로부터 손가락 및 스크류드라이버 다른 물체들이 가까이 하지 않도록 배치해 주십시오 Waarschuwing Gevaarlijk bewegende onderdelen Houd voldoende afstand tot de bewegende ventilatorbladen Het is mogelijk dat de ventilator nog draait tijdens he...

Страница 109: ...下さい 他のケー ブルやアダプタを使用すると故障や火災の原因になるこ とがあります 電気用品安全法は ULまたはCSA認定のケーブル UL CSAマークがコードに表記 を Supermicro が指定する製品以外に使用するこ とを禁止しています 警告 安装此产品时 请使用本身提供的或指定的或采购的连接线 电源线和电源适配器 包含遵照当 地法规和安全要求的合规的电源线尺寸和插头 使用其它线材或适配器可能会引起故障或火灾 除了Supermicro所指定的产品 电气用品和材料安全法律规定禁止 使用未经UL或CSA认证的线材 线材上会显示UL CSA符号 警告 安裝此產品時 請使用本身提供的或指定的或採購的連接線 電源線和電源適配器 包含遵照當 地法規和安全要求的合規的電源線尺寸和插頭 使用其它線材或適配器可能會引起故障或火災 除了Supermicro所指定的產品 電氣用品和材料安全法律規定禁止 ...

Страница 110: ... שמתשהל םילבכב םיכמסומה ב UL וא ב CSA רשאכ עיפומ םהילע דוק לש UL CSA רובע לכ רצומ ילמשח רחא אלא קר רצומב רשא םאתוה י ע Supermicro דבלב دنع بيكرت جتنملا مق مادختساب تاليصوتلا ةرفوتملا وأ ةددحملا وأ مق ءارشب تالباكلا ةيئابرهكلا تالوحمو رايتلا ددرتملا عم مازتلالا نيناوقب تابلطتمو ةمالسلا ةيلحملا امب يف كلذ مجح لصوملا سباقلاو ميلسلا مادختسا يأ تالباك تالوحمو ىرخأ دق ببستي يف لطع وأ قيرح رظحي نوناق ةما...

Страница 111: ...n van het Product uitsluitend gebruik maken van de geleverde Kabels of een andere geschikte aan te schaffen Aansluitmethode deze moet altijd voldoen aan de lokale voorschriften en veiligheidsnormen inclusief de juiste kabeldikte en stekker Het gebruik van niet geschikte Kabels en of Adapters kan een storing of brand veroorzaken Wetgeving voor Elektrische apparatuur en Materiaalveiligheid verbied h...

Страница 112: ...on Slots Two PCIe 4 0 x16 FHFL One PCIe 4 0 x16 LP One M 2 slot for PCIe 3 0 x4 or SATA 3 0 supports M Key 2280 22110 FF Input Output Network Two 10GbE LAN ports IPMI Dedicated LAN port USB Two USB 3 2 Gen 1 ports two USB 2 0 ports Video One VGA port Serial One serial port one serial header Motherboard X12SPW TF 8 W x 13 L 203 2mm x 330 2mm Chassis 815TQC 605WB R504WB 1U Rackmount 17 2 x 1 7 x 25 ...

Страница 113: ... 55035 CISPR 32 CISPR 24 CISPR 35 EN BS 61000 3 2 EN BS 61000 3 3 EN BS 61000 4 2 EN BS 61000 4 3 EN BS 61000 4 4 EN BS 61000 4 5 EN BS 61000 4 6 EN BS 61000 4 8 EN BS 61000 4 11 Product Safety 2014 35 EU LVD Directive UL CSA 62368 1 USA and Canada Electrical Equipment Safety Regulations 2016 IEC EN BS 62368 1 Environment 2011 65 EU RoHS Directive EC 1907 2006 REACH 2012 19 EU WEEE Directive Calif...

Отзывы:

Нет отзывов

Бренды по названию

Популярные бренды

Загрузить еще бренды