Huawei TaiShan 200 Series User Manual Download Page 101

Page: 101 / 132

Warranty and Safety

7.1 Maintenance and Warranty
7.2 Safety

7.1 Maintenance and Warranty

For details, see

Maintenance & Warranty

7.2 Safety

For details, see

Huawei Server Safety Information

TaiShan 200 Server

User Guide (Model 2280)

7 Warranty and Safety

Issue 04 (2020-01-16)

Summary of Contents for TaiShan 200 Series

Page 1: ...TaiShan 200 Server User Guide Model 2280 Issue 04 Date 2020 01 16 HUAWEI TECHNOLOGIES CO LTD ...

Page 2: ...s document may not be within the purchase scope or the usage scope Unless otherwise specified in the contract all statements information and recommendations in this document are provided AS IS without warranties guarantees or representations of any kind either express or implied The information in this document is subject to change without notice Every effort has been made in the preparation of th...

Page 3: ...s document are defined as follows Symbol Description Indicates a hazard with a high level of risk which if not avoided will result in death or serious injury Indicates a hazard with a medium level of risk which if not avoided could result in death or serious injury Indicates a hazard with a low level of risk which if not avoided could result in minor or moderate injury Indicates a potentially haza...

Page 4: ...t servers that use Kunpeng 920 5220 or 3210 processors Added information about the WebUI of iBMC V500 and later versions 03 2019 12 17 Added the server with 24 x 2 5 SAS SATA pass through drives 02 2019 11 14 The product name is changed Added the FlexIO card with four 25GE optical ports 01 2019 07 01 This issue is the first official release TaiShan 200 Server User Guide Model 2280 About This Docum...

Page 5: ... Slots 24 2 8 Fan Modules 30 3 Product Specifications 32 3 1 Technical Specifications 32 3 2 Environmental Specifications 35 3 3 Physical Specifications 37 3 4 PSU Specifications 38 4 Software and Hardware Compatibility 39 5 Install and Configure 40 5 1 Tool Preparations 40 5 2 Safety Symbols on Devices 41 5 3 ESD Protection 42 5 3 1 Operation Instructions 42 5 3 2 ESD Wrist Strap 43 5 4 Environme...

Page 6: ... 5 10 Initial Configuration 68 5 10 1 Default Data 68 5 10 2 Configuration Process 69 5 10 3 Querying the Management Network Port IP Address 70 5 10 4 Logging In to the iBMC WebUI 73 5 10 5 Checking the Server 76 5 10 6 Changing Initial Passwords 79 5 10 7 Configuring RAID 83 5 10 8 Configuring the BIOS 84 5 10 9 Installing an OS 91 5 10 10 Upgrading the System 92 6 Troubleshooting 93 7 Warranty a...

Page 7: ... Resources 117 9 1 Technical Support 117 9 2 Maintenance Tools 118 A Appendix 119 A 1 BIOS 119 A 2 iBMC 120 A 3 Glossary 121 A 4 Acronyms and Abbreviations 123 TaiShan 200 Server User Guide Model 2280 Contents Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd vi ...

Page 8: ...large capacity storage low power consumption easy management and easy deployment and is ideal for Internet distributed storage cloud computing Big Data and enterprise services Figure 1 1 shows the appearance of a server with 12 drives Figure 1 1 Appearance 1 1 Physical Structure 1 2 Logical Structure TaiShan 200 Server User Guide Model 2280 1 Overview Issue 04 2020 01 16 Copyright Huawei Technolog...

Page 9: ...ts server with Kunpeng 920 7260 5250 or 5230 processors 1 I O module 1 2 I O module 2 3 PSUs 4 Chassis 5 I O module 3 6 Supercapacitor bracket 7 Air duct 8 Front drive backplane 9 Fan module brackets 10 Fan modules 11 Front drives 12 Cable organizers 13 Heat sinks 14 DIMM 15 Mainboard 16 RAID controller card 17 FlexIO card 1 CPU 1 18 iBMC card 19 FlexIO card 2 CPU 2 When configured with Kunpeng 92...

Page 10: ...or bracket 7 Air duct 8 Front drive backplane 9 Fan module brackets 10 Fan modules 11 Front drives 12 Cable organizers 13 Heat sinks 14 DIMM 15 Mainboard 16 RAID controller card 17 FlexIO card 1 CPU 1 18 iBMC card 19 FlexIO card 2 CPU 2 TaiShan 200 Server User Guide Model 2280 1 Overview Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 3 ...

Page 11: ...s are integrated on the mainboard and cannot be replaced independently Use the Intelligent Computing Spare Parts Checker to obtain information about the spare parts 1 2 Logical Structure Figure 1 4 shows the logical structure of the 2280 server using a Kunpeng 920 7260 5250 or 5230 processor TaiShan 200 Server User Guide Model 2280 1 Overview Issue 04 2020 01 16 Copyright Huawei Technologies Co Lt...

Page 12: ...o Hydra buses The maximum transmission rate of a single bus is 30 Gbit s The server can come with an Ethernet FlexIO card with four GE or 25GE ports which are connected to the CPUs through the high speed SerDes interface The Ethernet FlexIO card provides four GE ports which are connected to the CPUs through the high speed SerDes interface TaiShan 200 Server User Guide Model 2280 1 Overview Issue 0...

Page 13: ...lanes used The iBMC uses the Huawei Hi1710 and provides a VGA port management network port and debugging serial port Figure 1 5 shows the logical structure of the 2280 server using a Kunpeng 920 5220 or 3210 processor Figure 1 5 Logical structure of the server Kunpeng 920 5220 or 3210 processor TaiShan 200 Server User Guide Model 2280 1 Overview Issue 04 2020 01 16 Copyright Huawei Technologies Co...

Page 14: ...rface The Ethernet FlexIO card provides four GE ports which are connected to the CPUs through the high speed SerDes interface The screw in RAID controller card connects to CPU 1 through PCIe buses and to the drive backplanes through SAS signal cables The server supports flexible drive configurations depending on the drive backplanes used The iBMC uses the Huawei Hi1710 and provides a VGA port mana...

Page 15: ...Fan Modules 2 1 Front Panel Components For details about the drive numbers and types of 2280 see 2 6 1 Drive Slot Numbers Figure 2 1 shows the components on the front panel of a server with 12 x 3 5 inch drives Figure 2 1 Components on the front panel of a server with 12 x 3 5 inch drives 1 Drive 2 VGA port TaiShan 200 Server User Guide Model 2280 2 Components Issue 04 2020 01 16 Copyright Huawei ...

Page 16: ...nch SAS SATA drives and 12 x 2 5 inch NVMe SSDs Figure 2 3 Components on the front panel of a server with 8 x 2 5 inch SAS SATA drives and 12 x 2 5 inch NVMe SSDs 1 Drive 2 Filler panel 3 VGA port 4 USB 3 0 port 5 Label plate with an SN label Figure 2 4 shows the components on the front panel of a server with 24 x 2 5 SAS SATA pass through drives Figure 2 4 Components on the front panel of a serve...

Page 17: ...mally if an abnormal USB device is connected If an external USB device is used the maximum length of the extension cable is 1 m VGA port DB15 The VGA port is connected to a terminal such as a monitor or physical KVM NOTE The VGA port on the front panel does not have cable screws The VGA cable is easy to fall off You are advised to use the VGA port on the rear panel SN The serial number SN on the l...

Page 18: ... the month Digits 1 to 9 indicate January to September and letters A to C indicate October to December 5 Serial number six characters 6 RoHS compliance one character Y indicates environment friendly processing 7 Board model that is product name 2 2 Front Panel Indicators and Buttons Figure 2 6 shows the indicators and buttons on the front panel of a server with 12 x 3 5 inch drives Figure 2 6 Indi...

Page 19: ... inch SAS SATA drives and 12 x 2 5 inch NVMe SSDs 1 UID button indicator 2 Health indicator 3 Power button indicator 4 Fault diagnostic LED 5 FlexIO presence indicators 1 and 2 Figure 2 9 shows the indicators and buttons on the front panel of a server 24 x 2 5 SAS SATA pass through drives Figure 2 9 Indicators and buttons on the front panel of a server 24 x 2 5 SAS SATA pass through drives 1 UID b...

Page 20: ...t down the OS When the server is powered on you can hold down this button for 6 seconds to force the server to power off When the server is in the standby state you can press this button to start the server UID button indicator The UID button indicator helps identify and locate a device UID indicator Off The device is not being located Blinking blue blinking 255 seconds The device has been located...

Page 21: ...gure 2 10 Rear panel components 1 I O module 1 2 I O module 2 3 Power supply unit PSU 1 4 I O module 3 5 PSU 2 6 PSU socket 7 FlexIO card 2 connected to CPU 2 8 USB 3 0 port 9 VGA port 10 Serial port 11 Management network port 12 FlexIO card 1 connected to CPU 1 I O modules 1 2 and 3 can be drive modules or riser modules The preceding figure is for reference only FlexIO card 1 or 2 can be a TM210 ...

Page 22: ...ou can set it as the iBMC serial port by using the iBMC command This port is used for debugging NOTE For details about how to set the system serial port as the iBMC serial see Logging In over the Serial Port in 8 2 Logging In to the iBMC CLI GE electrical port RJ45 4 8 Each FlexIO card provides four GE electrical ports A maximum of eight GE electrical ports can be provided through the two FlexIO c...

Page 23: ...rt connection status indicator 3 Management network port data transmission status indicator 4 Management network port connection status indicator 5 UID indicator 6 Optical port transmission rate indicator 7 Optical port connection status indicator data transmission status indicator 8 PSU indicator Table 2 5 Indicators on the rear panel Indicator State Description GE electrical port Managem ent net...

Page 24: ...ected Connection status indicator Data transmission status indicator Steady green The network port is properly connected Blinking green Data is being transmitted Off The network port is not connected PSU indicator Steady green The power input and output are normal Steady orange The input is normal but no power output is supplied due to overheat protection overcurrent protection short circuit prote...

Page 25: ...cription FlexIO card with four GE electrical ports Data transmission status indicator Blinking yellow Data is being transmitted Off No data is being transmitted Connection status indicator Steady green The network port is properly connected Off The network port is not connected FlexIO card with four 25GE optical ports Transmission rate indicator Steady green The data transmission rate is 25 Gbit s...

Page 26: ...with 12 x 3 5 inch drives in Expander mode Figure 2 14 Server with 12 x 3 5 inch drives in Expander mode Table 2 7 Drive slot numbers of a server with 12 x 3 5 inch drives in Expander mode Physical Slot Number Slot Number Identified by iBMC Slot Number Identified by RAID Controller 40 Disk40 12 41 Disk41 13 42 Disk42 14 43 Disk43 15 Figure 2 15 shows the drive slot numbers of a server with 12 x 3 ...

Page 27: ...le 2 8 Drive slot numbers of a server with 25 x 2 5 inch drives in Expander mode Physical Slot Number Slot Number Identified by iBMC Slot Number Identified by RAID Controller 40 Disk40 25 41 Disk41 26 Figure 2 17 shows the drive slot numbers of a server with 8 x 2 5 inch SAS SATA drives and 12 x 2 5 inch NVMe SSDs TaiShan 200 Server User Guide Model 2280 2 Components Issue 04 2020 01 16 Copyright ...

Page 28: ...rives Maximum Rear Drives Drive Manageme nt Mode Server with 25 x 2 5 inch drives in Expander mode 1 25 SAS SATA drives I O module 1 2 SAS SATA drives I O module 3 2 4 NVMe SSDs One RAID controller card Server with 12 x 3 5 inch drives in Expander mode 12 SAS SATA drives I O module 1 2 SAS SATA drives I O module 2 2 SAS SATA drives I O module 3 2 4 NVMe SSDs One RAID controller card TaiShan 200 Se...

Page 29: ...e SSDs can only be 2 5 inch drives and the front drives in a server with 12 x 3 5 inch drives in Expander mode or a server with 12 x 3 5 inch drives in pass through mode can only be 3 5 inch drives 2 I O module 3 supports only 2 5 inch drives and I O modules 1 and 2 support 2 5 inch and 3 5 inch drives 3 CPU SAS pass through requires a SAS riser card By default it is installed on I O module 2 4 Th...

Page 30: ...on A member drive in the RAID array is faulty 2 6 3 NVMe SSD Indicators Figure 2 20 shows the NVMe SSD indicators Figure 2 20 NVMe SSD indicators Table 2 11 NVMe SSD indicators Drive Activity Indicator Green Indicator Drive Fault Indicator Yellow Indicator State Description Off Off The NVMe SSD cannot be detected Steady green Off The NVMe SSD is detected and working properly Blinking green 2 Hz Of...

Page 31: ...stalled in I O module 1 and PCIe slots 4 to 6 when installed in I O module 2 Figure 2 21 Riser card 1 three x8 slots The riser card shown in Figure 2 22 supports full height full length dual width GPUs It provides PCIe slots 2 and 3 when installed in I O module 1 and PCIe slots 5 and 6 when installed in I O module 2 The card must be used together with the power cables delivered with the server Do ...

Page 32: ...ble connectors Figure 2 23 Riser card 3 dedicated for a server with 12 NVMe SSDs When configured with 2 x 2 5 inch rear drives respectively both I O modules 1 and 2 support x16 riser cards as shown in Figure 2 24 This riser card provides slot 3 when installed in I O module 1 and slot 6 when installed in I O module 2 TaiShan 200 Server User Guide Model 2280 2 Components Issue 04 2020 01 16 Copyrigh...

Page 33: ...lots 4 to 6 and only slot 6 x8 is available When the server is configured with Kunpeng 920 5220 or 3210 processors the SAS riser card can be installed only in I O module 2 and occupies PCIe slots 4 to 6 Slots 4 and 5 do not output signals and slot 6 supports x8 signals Figure 2 25 Riser card 5 SAS Figure 2 26 and Figure 2 27 show riser cards supported by I O module 3 When installed in I O module 3...

Page 34: ...ure 2 27 Riser card 7 one x16 slot Figure 2 28 shows the rear PCIe slots of the 2280 Figure 2 28 PCIe slots I O module 1 provides slots 1 to 3 I O module 2 provides slots 4 to 6 and I O module 3 provides slots 7 and 8 TaiShan 200 Server User Guide Model 2280 2 Components Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 27 ...

Page 35: ... Slot1 CPU1 PCIe 4 0 x16 2 slot PRM N A 3 slot PRM x8 Port0 00 00 0 Full heigh t full lengt h Slot2 CPU1 PCIe 4 0 x16 2 slot PRM x16 3 slot PRM x8 Port4 00 04 0 Full heigh t full lengt h Slot3 CPU1 PCIe 4 0 x16 Single slot PRM x16 2 slot PRM x8 3 slot PRM x8 Port1 2 00 0C 0 Full heigh t half lengt h Slot4 CPU2 PCIe 4 0 x16 2 slot PRM N A 3 slot PRM x8 SAS PRM N A Port0 80 00 0 Full heigh t full le...

Page 36: ... Port1 6 80 10 0 Full heigh t half lengt h Slot7 CPU2 PCIe 4 0 x16 Single slot PRM N A 2 slot PRM x8 Port8 80 08 0 Full heigh t half lengt h Slot8 CPU2 PCIe 4 0 x16 Single slot PRM x16 2 slot PRM x8 Port1 2 80 0C 0 Full heigh t half lengt h RAID contr oller card CPU1 PCIe 4 0 x8 x8 Port8 00 08 0 TaiShan 200 Server User Guide Model 2280 2 Components Issue 04 2020 01 16 Copyright Huawei Technologies...

Page 37: ...submit the compatibility test requirements When two 2 5 inch drives are installed in I O module 1or 2 this module also supports a PCIe x16 riser card in slot 3 or 6 B D F indicates Bus Device Function Number ROOT PORT B D F indicates the B D F of a CPU internal PCIe root port Device B D F indicates the B D F displayed on the OS of an onboard or external PCIe port This table lists the default B D F...

Page 38: ...nfigured with Kunpeng 920 7260 5250 or 5230 processors as an example Fan positions are the same for the 2280 with Kunpeng 920 5220 or 3210 processors TaiShan 200 Server User Guide Model 2280 2 Components Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 31 ...

Page 39: ...or 2U rack server Processor Number of processors two 64 core 48 core or 32 core processors with the frequency of 2 6 GHz Inter processor communication two Hydra links between the processors with a maximum speed of 30 Gbit s each L3 cache capacity 45 5 MB to 46 MB CPU TDP 138 W to 195 W Number of processors two 32 core or 24 core processors with the frequency of 2 6 GHz Inter processor communicatio...

Page 40: ... in one server That is all DIMMs on one server must have the same part No Storage Drive Support for a variety of drive configurations For details see Table 2 9 Hot swap of a single drive RAID controller card Support for a variety of RAID controller cards Use the Intelligent Computing Compatibility Checker to obtain information about the specific RAID controller cards supported Supercapacitor to pr...

Page 41: ...and download services The PCIe slots support Huawei developed Atlas 300 AI accelerator cards to implement fast and efficient processing and inference and image identification and processing NOTE For details about the PCIe card models supported by the 2280 use the Intelligent Computing Compatibility Checker Port Front panel two USB 3 0 ports and one DB15 VGA port Rear panel two USB 3 0 ports one DB...

Page 42: ...ort is available 3 2 Environmental Specifications Table 3 2 Environmental specifications Category Specifications Temperature Operating temperature 5 C to 40 C 41 F to 104 F ASHRAE Classes A2 and A3 compliant Storage temperature 72 hours 40 C to 65 C 40 F to 149 F Long term storage temperature 72 hours 21 C to 27 C 69 8 F to 80 6 F Maximum temperature change rate 20 C h 36 F h NOTE The highest oper...

Page 43: ...71 04 2013 standard on gaseous corrosion Silver corrosion rate test 200 Å month Particle contaminant The equipment room environment meets the requirements of ISO 14664 1 Class 8 There is no explosive conductive magnetic or corrosive dust in the equipment room NOTE It is recommended that the particulate pollutants in the equipment room be monitored by a professional organization Acoustic noise The ...

Page 44: ...12 x 2 5 inch NVMe SSDs Supports all configurations Supports all configurations Not supported NOTE If one fan fails the highest operating temperature of the server is 5 C 9 F lower than that in normal cases Servers with Kunpeng 920 5220 or 3210 processors do not support the configuration of 24 x 2 5 inch SAS SATA pass through drives 3 3 Physical Specifications Physical Specifications Table 3 4 Phy...

Page 45: ...x 2 5 inch front NVMe SSDs 4 x 2 5 inch rear drives 24 kg 52 91 lb Server with 24 x 2 5 inch front drives 4 x 2 5 inch rear drives 24 kg 52 91 lb Packaging materials 5 kg 11 03 lb Power consumption The power consumption parameters vary according to configurations Use the Intelligent Computing Product Power Calculator to obtain the specific power consumption value 3 4 PSU Specifications The PSUs ar...

Page 46: ...rdware supported by the server NOTICE Do not use incompatible components Otherwise the server may fail to work properly The technical support and warranty do not cover faults caused by incompatible components TaiShan 200 Server User Guide Model 2280 4 Software and Hardware Compatibility Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 39 ...

Page 47: ... the Server on Guide Rails 5 8 Connecting External Cables 5 9 Powering On and Off the Server 5 10 Initial Configuration 5 1 Tool Preparations Prepare the following tools ESD wrist strap or ESD gloves M3 Phillips screwdriver Protective gloves ESD bag Flat head screwdriver TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 40 ...

Page 48: ...nd the safety of the operator ESD label This label indicates a static sensitive area Do not touch the device with your hands When operating the device within this area take electrostatic discharge ESD preventive measures For example wear an ESD wrist strap Altitude Indicates that the device operates properly at an altitude of 2000 m or lower The symbol applies only to CCC High touch current This l...

Page 49: ...ectly grounded All electric meters or tools on a workbench must be connected to the common ground point of the workbench Monitor the temperature and humidity in the equipment room The heating system reduces indoor humidity and increases ESD Place components in ESD bags or boxes during transportation or storage Wear an ESD wrist strap when installing or removing a server component Ensure that the g...

Page 50: ...trap into the ESD jack in a cabinet or chassis End 5 4 Environmental Requirements For details about the safety precautions to be observed when you install or replace servers and their parts see the Huawei Server Safety Information Suitable for mounting on concrete or other non combustible surface only 5 4 1 Space and Airflow Requirements To allow for servicing and adequate airflow observe the foll...

Page 51: ...n install or position the system in a well ventilated climate controlled environment Use temperature control devices all year long in any climates In dry and humid areas maintain ambient humidity within range with humidifiers and dehumidifiers respectively Table 5 2 Temperature and humidity requirements in the equipment room Item Description Temperature 5ºC to 40ºC 41ºF to 104ºF Humidity 8 RH to 9...

Page 52: ...they are free from oxidation corrosion or damage Table 5 3 Shipped items No Description 1 Documentation bag that contains a warranty card and a Quick Start Guide 2 Guide rails 3 Rack server End 5 6 Installing Optional Parts Before installing and configuring the server you need to install all optional parts required for example extra drives and PCIe cards For details see TaiShan 200 Server Maintena...

Page 53: ...inet 2 Fasten the lower end of a floating nut to the target square hole in a mounting bar at the front of the cabinet 3 Use a floating nut hook to pull the upper end of the floating nut and fasten it to the upper edge of the square hole See Figure 5 5 Figure 5 5 Installing a floating nut 4 Install a floating nut to the other front mounting bar in the same way TaiShan 200 Server User Guide Model 22...

Page 54: ... Figure 5 6 Installing an L shaped guide rail 3 Install the other guide rail in the same way Step 3 Install the server 1 Lift the server This task requires at least two people 2 Place the server on the guide rails and slide it into the cabinet See 1 in Figure 5 7 TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 47 ...

Page 55: ...stable guide rails are for a cabinet with a depth of 543 5 mm to 848 5 mm 21 40 in to 33 41 in between the front and rear mounting bars The servers are stackable onto adjustable guide rails Step 1 Install the adjustable guide rails 1 Position a guide rail horizontally in contact with the mounting bars and hook it onto the cabinet See 1 in Figure 5 8 The three holes in each mounting ear of a guide ...

Page 56: ...re 5 8 While screws are not necessary for the installation of adjustable guide rails M6 screws at the rear end of the server will make it more shockproof and secure 4 Install the other guide rail in the same way Step 2 Install the server 1 Lift the server This task requires at least two people 2 Place the server on the guide rails and slide it into the cabinet See 1 in Figure 5 9 TaiShan 200 Serve...

Page 57: ... to 914 mm 24 02 in to 35 98 in between the front and rear mounting bars When installed on holding rails the servers cannot be stacked on each other in a cabinet with a depth of 1 m 3 28 ft If holding rails are used and the cable management arm CMA is equipped the server cannot be installed in a cabinet with a depth of 1 m 3 28 ft Step 1 Install the holding rails 1 Hold down the ejector release bu...

Page 58: ...e 5 10 4 Push the hook backwards so that its metal sheet touches the mounting bar See 5 in Figure 5 10 5 Optional Install an M6 screw in the third square hole at the rear of the holding rail to secure it See 6 in Figure 5 10 6 Install the other holding rail in the same way Step 2 Install the server 1 Pull out the inner rails as far as they will go See Figure 5 11 TaiShan 200 Server User Guide Mode...

Page 59: ...e rails push the server inwards until you hear a sound and ensure that the latches eject and completely block the screws to affix the server to the inner guide rails See Figure 5 12 TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 52 ...

Page 60: ...s 3 Press the release buttons on both sides and push the server into the cabinet along the holding rails See Figure 5 13 TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 53 ...

Page 61: ...e mounting ears to secure the server See Figure 5 14 Figure 5 14 Securing the server Step 3 Install the CMA 1 Insert the support lever into both left and right outer rails See 1 in Figure 5 15 TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 54 ...

Page 62: ...re 5 15 3 Do the same for the nail heads on the inner left rail and the inner support lever See 3 Figure 5 15 Step 4 Connect the power cables network cables VGA cable and USB device as required and power on the server End 5 8 Connecting External Cables TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 55 ...

Page 63: ...il any surplus lengths of cables and bind them to proper positions inside the cabinet Route cables straightly and bind them neatly The bending radius of a cable varies depending on the position where the cable is bent If you need to bend a cable in its middle the bending radius must be at least twice the diameter of the cable If you need to bend a cable at the output terminal of a connector the be...

Page 64: ...the front or rear panel of the server and tighten the two screws Step 5 Connect the other end of the VGA cable to the VGA port on the monitor and tighten the two screws Figure 5 16 Connecting PS 2 and VGA cables End 5 8 3 Connecting a Network Cable Before connecting or replacing a network cable use a network cable tester to check whether the new network cable is functional The new and old cables m...

Page 65: ...are routed neatly and undamaged Separate network cables from power cables when routing The minimum bend radius of a network cable is 4 cm 1 57 in Check that the cable insulation layer is intact Ensure that cables are routed for easy maintenance and capacity expansion Bind cables with ties when routing Ensure that optical cables are routed straightly and bound neatly and that cable ties are install...

Page 66: ...ork cable Step 4 Lay out the new cable in the same way as the old one Lay out optical cables or SFP cables in the rack based on installation regulations You are advised to arrange cables in original mode Ensure that cables are routed neatly and intact Separate optical cables or SFP cables from power cables and signal cables when laying out the cables Bend an optical cable or SFP cable with a bendi...

Page 67: ...5 18 Connecting an optical cable When you use an SFP cable 1 Remove the old SFP cable Gently push the cable connector inwards and pull the latch out to remove the SFP cable See Figure 5 19 NOTICE Do not directly pull out the latch TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 60 ...

Page 68: ... securely connected Figure 5 20 Connecting an SFP cable Step 6 Check that the new cable is properly connected Power on the server and ping the IP address of the peer device If the peer device cannot be pinged check whether the cable is intact or the connectors are securely connected Step 7 Bind the new optical cable TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020 01 ...

Page 69: ...Serial Cable The rear panel of the server provides a standard RJ45 serial port three pin serial port which works as the system serial port by default You can set it as the iBMC serial port using the iBMC CLI The serial port can be used as System serial port to monitor the OS status iBMC serial port for debugging and fault locating Procedure Step 1 Wear an ESD wrist strap For details see 5 3 ESD Pr...

Page 70: ...m for other devices Step 1 Wear an ESD wrist strap For details see 5 3 ESD Protection Step 2 Connect the power cable to the PSU See Figure 5 23 Figure 5 23 Connecting a power cable Step 3 Secure the power cable using a velcro strap See Figure 5 24 TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 63 ...

Page 71: ... use them for other devices Connect the power cables of the active and standby PSUs to different power distribution units PDUs to ensure reliable system operation Ground the equipment before powering it on Procedure Step 1 Wear an ESD wrist strap For details see 5 3 ESD Protection Step 2 Take the spare part out of its ESD bag Step 3 Connect the power cables to the PSUs 1 Put the OT terminal for th...

Page 72: ... on the PDU according to the plan Step 5 Bundle the power cables to the cable guide using cable ties End 5 8 8 Verifying Cable Connections Before verifying cable connections check that the power is cut off Otherwise any incorrect connection or loose connection may cause human injury or device damage Check cable connections against Table 5 4 Table 5 4 Cable connection checklist Item Description Pow...

Page 73: ...d to the external power supply and the server is in the standby state the power indicator is steady yellow power on the server as follows Press the power button on the front panel to power on the server For details about the power button position see 2 2 Front Panel Indicators and Buttons Power on the server using the iBMC WebUI i Log in to the iBMC WebUI For details see 5 10 4 Logging In to the i...

Page 74: ...own the server OS to power off the server Press the power button on the front panel to power off the server For details about the power button position see 2 2 Front Panel Indicators and Buttons When the server is powered on press the power button to shut down the OS to power off the server If the server OS is running shut it down as prompted When the server is powered on hold down the power butto...

Page 75: ...LI a Log in to the iBMC CLI For details see 8 2 Logging In to the iBMC CLI b On the iBMC CLI run the ipmcset d powerstate v 0 command to power off the server or the ipmcset d powerstate v 2 command to forcibly power it off NOTICE A forced power off may cause data loss or program damage Forcibly power off the server only when necessary c Enter y or Y to power off the server 5 10 Initial Configurati...

Page 76: ...Boot data Password Admin 9000 5 10 2 Configuration Process Figure 5 26 shows the initial configuration process of the server Figure 5 26 Initial configuration process Table 5 6 describes the initial configuration process TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 69 ...

Page 77: ...boot option priority and BIOS password Install an OS Install an OS for the server 5 10 3 Querying the Management Network Port IP Address Methods You can obtain the IP address using any of the following methods Obtain the default IP address Use the iBMC WebUI Use the BIOS For details see this topic Log in to the iBMC CLI through the serial port and run the ipmcget d ipinfo to query the IP address o...

Page 78: ...rd when prompted The default password for logging in to the BIOS is Admin 9000 The server will be locked after three consecutive failures with wrong passwords You can restart the server to unlock it Step 6 Choose Advanced IPMI iBMC Configuration IBMC Config and press Enter The IBMC Config screen is displayed See Figure 5 28 and Figure 5 29 TaiShan 200 Server User Guide Model 2280 5 Install and Con...

Page 79: ...Figure 5 28 IBMC Config screen 1 Figure 5 29 IBMC Config screen 2 End TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 72 ...

Page 80: ...Step 2 Open Internet Explorer on the local PC Step 3 In the address box enter the iBMC address in the format https IP address of the iBMC management network port on the server Example https 192 168 2 100 Step 4 Press Enter The iBMC login page is displayed as shown in Figure 5 31 and Figure 5 32 If the message There is a problem with this website s security certificate is displayed click Continue t...

Page 81: ...Figure 5 31 iBMC login page earlier than V500 TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 74 ...

Page 82: ...ator and the default password is Admin 9000 If the account is locked due to five consecutive failed attempts try again in 5 minutes Step 6 Select This iBMC from the Domain drop down list Step 7 Click Log In End TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 75 ...

Page 83: ...rking correctly For details see 2 2 Front Panel Indicators and Buttons and 2 4 Rear Panel Indicators Step 2 Check the server Check the server using the iBMC WebUI a Log in to the iBMC over the WebUI For details see 5 10 4 Logging In to the iBMC WebUI You are advised to change the initial password when logging in to the iBMC for the first time For details see 5 10 6 Changing Initial Passwords TaiSh...

Page 84: ... is V500 or later choose iBMC Settings Firmware Upgrade The page shown in Figure 5 35 is displayed Figure 5 35 Querying firmware information iBMC V500 or later c Check the health status of the server If the iBMC version is earlier than V500 choose Information Overview The page shown in Figure 5 36 is displayed TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020 01 16 Cop...

Page 85: ...ment network port and iBMC user name and password By default SSH is used to log in to the iBMC If the SSH service is disabled enable it by choosing Configuration Services on the iBMC WebUI d Run the ipmcget d ver command to view the server version information Check that the server versions meet site requirements iBMC ipmcget d ver iBMC INFO IPMC CPU Hi1710 IPMI Version 2 0 CPLD Version U6076 1 00 ...

Page 86: ...em in health state If System in health state is displayed no further action is required If alarm information is displayed go to the next step f Query any generated alarms iBMC ipmcget d healthevents Event Num Event Time Alarm Level Event Code Event Description 1 2019 02 10 00 52 23 Minor 0x12000021 get description failed 2 2019 02 10 01 37 42 Minor 0x12000013 Failed to obtain data of the air inlet...

Page 87: ...ollowing describes how to change a user password on the iBMC WebUI For details about operations on the iBMC CLI see the TaiShan Rack Server iBMC User Guide Changing the Initial Password of the Default iBMC User Step 1 Log in to the iBMC WebUI and open the Local User page If the iBMC version is earlier than V500 choose Configuration Local Users The page shown in Figure 5 38 is displayed Figure 5 38...

Page 88: ...5 41 is displayed Figure 5 41 Modifying user information iBMC V500 or later Step 3 Change the user password by following on screen instructions The password must meet the following complexity requirements Contain 8 to 20 characters TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 81 ...

Page 89: ...ly when the system displays the message Hit ctrl b to stop autoboot 1 Step 5 Enter the default password for the iBMC U Boot The following prompt indicates that you have logged in to the U Boot u boot Step 6 Run the following command to change the U Boot password u boot passwd The following information is displayed Enter old password Step 7 Enter the old password The default password is Admin 9000 ...

Page 90: ...ure 5 42 is displayed Figure 5 42 RAID controller card information earlier than iBMC V500 If the iBMC version is V500 or later choose System Storage Management The page shown in Figure 5 43 is displayed Figure 5 43 RAID controller card information iBMC V500 or later The information shown in Figure 5 43 is for reference only The actual information may differ Step 3 Configure a RAID array The RAID c...

Page 91: ...For details see 8 1 Logging In to the Remote Virtual Console Step 2 On the Remote Virtual Console click or on the menu bar Step 3 Select Forced System Reset The system displays Are you sure to perform this operation Step 4 Click Yes The server restarts Step 5 Press Delete or F4 on the startup screen shown in Figure 5 45 TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020...

Page 92: ...y after your first login For details see Set the BIOS password For security purposes change the administrator password periodically The system will be locked if incorrect passwords are entered three consecutive times Restart the server to unlock it End Set the server boot priority Step 1 Press and to switch to the Boot screen as shown in Figure Boot screen TaiShan 200 Server User Guide Model 2280 ...

Page 93: ... boot sequence is Hard Disk Drive CD or DVD ROM Drive PXE Others Step 3 Select a boot option and press or to change the boot order Press to move a boot option up Press to move a boot option down The server will boot in the order displayed Step 4 Press F10 The Save Configuration Exit dialog box is displayed Step 5 Select Yes and press Enter End TaiShan 200 Server User Guide Model 2280 5 Install and...

Page 94: ...d Select PXE Boot Capability and press Enter In the dialog box that is displayed select the PXE boot network protocol UEFI IPv4 UEFI IPv6 UEFI IPv4 IPv6 e Press F10 The system displays Save configuration changes and reset and exit f Select Yes and press Enter to save the setting Setting the PXE for a NIC connected to the server The displayed information varies according to the external NIC when yo...

Page 95: ...s Enter c Select the network port such as MAC 48 F8 DB D9 6E 73 of the external NIC and press Enter d Select Network Adapter Configuration Wizard and press Enter The Main Configuration Page screen is displayed as shown in Figure 5 49 TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 88 ...

Page 96: ...Save configuration changes and reset and exit g Select Yes and press Enter to save the setting Set the BIOS password Step 1 Press or to select the Security menu as shown in Figure 5 50 TaiShan 200 Server User Guide Model 2280 5 Install and Configure Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 89 ...

Page 97: ...aracters uppercase letters lowercase letters and digits Cannot be the same as any of the previous five passwords The default password is Admin 9000 Step 3 Optional After a password is set select Clear Supervisor Password to delete the password Step 4 Press F10 The Save Configuration Exit dialog box is displayed Step 5 Select Yes and press Enter End Selecting a Language Step 1 On the Main screen ch...

Page 98: ...ent Computing Compatibility Checker to check compatible OSs The installation method varies according to the OS type For details see the installation guide of each OS You can log in to https support huawei com enterprise choose TECHNICAL SUPPORT Product Support Server Intelligent Computing TaiShan Servers and click the product model to go to the document page of the product Then search browse and d...

Page 99: ...re mainboard CPLD and drive backplane CPLD on the iBMC WebUI For details see the TaiShan Rack Server Upgrade Guide Updating Drivers If the existing driver versions on a server are inconsistent with those in the driver version mapping install the drivers of required versions Otherwise the server may operate abnormally For details see the OS installation guide TaiShan 200 Server User Guide Model 228...

Page 100: ... fault occurs on a server collect logs for fault diagnosis Fault diagnosis Fault diagnosis rules and tools help Huawei technical support engineers and maintenance engineers to analyze and rectify faults according to alarms and hardware fault symptoms Software and firmware upgrade Software and firmware upgrade packages can be downloaded by server model and installed as needed Preventive maintenance...

Page 101: ...Safety 7 1 Maintenance and Warranty For details see Maintenance Warranty 7 2 Safety For details see Huawei Server Safety Information TaiShan 200 Server User Guide Model 2280 7 Warranty and Safety Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 94 ...

Page 102: ...er 8 1 Logging In to the Remote Virtual Console 8 1 1 Logging In to the Remote Virtual Console through the iBMC WebUI Procedure Earlier Than iBMC V500 Step 1 Log in to the iBMC WebUI For details see 5 10 4 Logging In to the iBMC WebUI Step 2 On the menu bar choose Remote Console The Remote Console page is displayed as shown in Figure 8 1 TaiShan 200 Server User Guide Model 2280 8 Common Operations...

Page 103: ...age the server at a time Java Integrated Remote Console Shared allows two local users or five VNC users to access and manage the server at a time The users can see each other s operations HTML5 Integrated Remote Console Private allows only one local user or VNC user to access and manage the server at a time HTML5 Integrated Remote Console Shared allows two local users or five VNC users to access a...

Page 104: ... 8 2 Real time operation console Java Figure 8 3 Real time operation console HTML5 End TaiShan 200 Server User Guide Model 2280 8 Common Operations Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 97 ...

Page 105: ...ure 8 6 Java Integrated Remote Console Private allows only one local user or VNC user to access and manage the server at a time Java Integrated Remote Console Shared allows two local users or five VNC users to access and manage the server at a time The users can see each other s operations HTML5 Integrated Remote Console Private allows only one local user or VNC user to access and manage the serve...

Page 106: ... 8 5 Real time operation console Java Figure 8 6 Real time operation console HTML5 End TaiShan 200 Server User Guide Model 2280 8 Common Operations Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 99 ...

Page 107: ... and the iBMC The IP address configured and the iBMC management network port IP address must be on the same network segment Step 2 Double click KVM exe A dialog box similar to the one shown in Figure 8 7 is displayed Figure 8 7 Login interface Step 3 Enter the network address user name and password The network address can be in any of the following formats iBMC management network port IP address I...

Page 108: ...cess and manage a server at a time Information shown in Figure 8 8 is displayed Figure 8 8 Security risk information Step 5 Perform any of the following operations based on the actual situation Click Yes to open the IRC Click No to return to the login interface Click Import CA to import the CA certificate cer crt or pem After the CA certificate is imported the security risk dialog box will no long...

Page 109: ...t network port IP address must be on the same network segment Step 2 Open the console and set the folder where the IRC is stored as the working folder Step 3 Run the chmod 777 KVM sh command to set the permission for the IRC Step 4 Run KVM sh to start the IRC A dialog box similar to the one shown in Figure 8 10 is displayed TaiShan 200 Server User Guide Model 2280 8 Common Operations Issue 04 2020...

Page 110: ...rt number can be left blank Step 6 Select a login mode and click Connect Shared Mode allows two users to access and manage a server at the same time The two users can see each other s operations Private Mode allows only one user to access and manage a server at a time Information shown in Figure 8 11 is displayed Figure 8 11 Security risk information Step 7 Perform any of the following operations ...

Page 111: ...ble communication between the client and the iBMC The IP address configured and the iBMC management network port IP address must be on the same network segment Step 2 Open the console and set the folder where the IRC is stored as the working folder Step 3 Run the chmod 777 KVM sh command to set the permission for the IRC Step 4 Run KVM sh to start the IRC A dialog box similar to the one shown in F...

Page 112: ...the default port number 443 the port number can be left blank Step 6 Select a login mode and click Connect Shared Mode allows two users to access and manage a server at the same time The two users can see each other s operations Private Mode allows only one user to access and manage a server at a time Information shown in Figure 8 14 is displayed Figure 8 14 Security risk information Step 7 Perfor...

Page 113: ... login failures with wrong passwords The user is automatically unlocked 5 minutes later and an administrator can unlock the user on the CLI For security purposes change your initial password at your first login and change the password periodically By default the CLI timeout interval is 15 minutes Logging In over SSH Secure Shell SSH provides secure remote login and other network services on a non ...

Page 114: ...rs such as the IP address Step 5 Connect to the iBMC and enter the user name and password Local and LDAP users can both log in to the iBMC CLI over SSH To log in to the iBMC LDAP users do not need to enter information about the domain server which is automatically assigned by the system End Logging In over the Serial Port Step 1 Set the serial port as the iBMC serial port To set the serial port th...

Page 115: ...OTE If no SDI V3 is installed in a server option can be 0 to 3 only If one SDI V3 card is installed the values 4 and 5 are available for setting the ports on the SDI V3 in I O module 1 or 2 If two SDI V3 cards are installed the values 4 to 7 are available The values 4 and 5 are used for setting the ports on the SDI V3 in I O module 1 while the values 6 and 7 are for the ports on the SDI V3 in I O ...

Page 116: ...r over a serial port in any of the following scenarios The server is configured for the first time at a site A remote connection to the server cannot be established Visit the chiark website and download the PuTTY software from the homepage PuTTY of an earlier version may cause server login failures You are advised to use PuTTY of the latest version TaiShan 200 Server User Guide Model 2280 8 Common...

Page 117: ...peed baud 115200 Data bits 8 Stop bits 1 Parity None Flow control None n in COMn indicates a serial port number and its value is an integer Figure 8 17 PuTTY Configuration Serial Step 4 In the navigation tree choose Session Step 5 Select Serial under Connection type as shown in Figure 8 18 TaiShan 200 Server User Guide Model 2280 8 Common Operations Issue 04 2020 01 16 Copyright Huawei Technologie...

Page 118: ...user name and password If the login is successful the server host name is displayed on the left of the prompt End 8 4 Logging In to the Server over a Network Port Using PuTTY The login method described in this chapter applies to components that support SSH access for example iBMC and OS Use PuTTY to remotely log in to the server over a local area network LAN and configure and maintain the server T...

Page 119: ...nterface CLI run the following command to check whether the IP address is reachable Ping Server IP address If yes go to Step 2 If no check the network connection rectify the fault and go to Step 1 Step 2 Double click PuTTY exe The PuTTY Configuration window is displayed as shown in Figure 8 19 Figure 8 19 PuTTY Configuration window Step 3 In the navigation tree choose Session Step 4 Set the login ...

Page 120: ...e is displayed on the left of the prompt End 8 5 Querying the Processor Model of a Server You can query the processor model of a server using the following methods Open the chassis cover and remove the CPU heat sink Check and record the processor model on the mainboard processor silkscreen For details about how to open the chassis cover and remove the CPU heat sink see the TaiShan 200 Server Maint...

Page 121: ... setting page The default BIOS password is Admin 9000 For security purposes change the administrator password periodically The system will be locked if an incorrect password is entered three consecutive times Restart the server to unlock it Step 7 On the Main screen choose Select Language as shown in Figure 8 21 TaiShan 200 Server User Guide Model 2280 8 Common Operations Issue 04 2020 01 16 Copyr...

Page 122: ...n to the iBMC WebUI For details see the TaiShan 200 Server Maintenance and Service Guide Model 2280 Step 2 Choose Information System Info Processors and view the processor model in the Model column TaiShan 200 Server User Guide Model 2280 8 Common Operations Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 115 ...

Page 123: ...Figure 8 22 Querying processor information End TaiShan 200 Server User Guide Model 2280 8 Common Operations Issue 04 2020 01 16 Copyright Huawei Technologies Co Ltd 116 ...

Page 124: ...gent Q A system for quick learning about products Huawei Enterprise Support Community Server for learning and discussion News For notices about product life cycles warnings and updates visit Product Bulletins Cases Learn about server applications at Knowledge Base Huawei Technical Support If a fault persists after taking the above measures contact technical support at your local Huawei office If a...

Page 125: ...servers Table 9 1 Software tools for routine maintenance Tool Server Model and Software Version Description FusionServer Tools SmartKit See the FusionServer Tools 2 0 SmartKit User Guide SmartKit contains tools required for operations such as batch deployment maintenance and upgrade of server devices Download link FusionServer Tools TaiShan 200 Server User Guide Model 2280 9 Support and Other Reso...

Page 126: ...ipheral Interface SPI flash memory The BIOS performs a power on self test POST initializes CPU and memory checks the I O and boot device and finally boots the OS The BIOS also supports the advanced configuration and power interface ACPI and hot swap setting HUAWEI Kunpeng 920 platform server is a patented BIOS product with independent intellectual property rights It supports customization and prov...

Page 127: ...LI Data Center Manageability Interface DCMI Redfish interfaces Hypertext Transfer Protocol Secure HTTPS and SNMP Fault detection and alarm management The iBMC implements fault detection and alarm management ensuring stable uninterrupted 24 7 system operation Virtual KVM and virtual media The iBMC provides virtual KVM and virtual media facilitating remote maintenance WebUI The iBMC provides a web b...

Page 128: ...formation about the managed objects for the management module so that the management module can manage the objects E Ethernet A baseband local area network LAN architecture developed by Xerox Corporation in cooperation with DEC and Intel Ethernet uses Carrier Sense Multiple Access Collision Detection CSMA CD and supports a data transfer rate of 10 Mbps on multiple cables The Ethernet specification...

Page 129: ...vers a faster speed and can replace almost all existing bus standards including AGP and PCI R RAID redundant array of independent disks A storage technology that combines multiple drives into a logical unit in several ways called RAID levels providing redundancy and delivering higher storage performance than a single disk redundan cy The ability of a system to keep functioning normally in the even...

Page 130: ...ual in line memory module DRAM dynamic random access memory DVD digital video disc E ECC Error Checking and Correcting F FC Fibre Channel FCC Federal Communications Commission FTP File Transfer Protocol G GE Gigabit Ethernet GPU Graphics Processing Unit H HA High Availability HDD hard disk drive HPC High Performance Computing TaiShan 200 Server User Guide Model 2280 A Appendix Issue 04 2020 01 16 ...

Page 131: ...yboard video and mouse L LRDIMM load reduced dual in line memory module LED light emitting diode LOM LAN on motherboard M MAC Media Access Control N NBD next business day NC SI Network Controller Sideband Interface P PCIe Peripheral Component Interconnect Express PDU power distribution unit PHY physical layer PXE Preboot Execution Environment Q QPI QuickPath Interconnect R RAID redundant array of ...

Page 132: ...er LAN SSD solid state drive T TCG Trusted Computing Group TCM TCO Trusted Cryptography Module Total Cost of Ownership TDP Thermal Design Power TET Trusted Execution Technology TFM Trans Flash Module TFTP Trivial File Transfer Protocol TPM Trusted Platform Module U UEFI Unified Extensible Firmware Interface UID unit identification light UL Underwriter Laboratories Inc USB universal serial bus V VG...

Search results

Summary of Contents for TaiShan 200 Series

Reviews:

Related manuals for TaiShan 200 Series

Brands by name

Popular brands

Huawei TaiShan 200 Series, User Manual

Search results

Summary of Contents for TaiShan 200 Series

Reviews:

Related manuals for TaiShan 200 Series

Brands by name

Popular brands