Gigabyte R283-S90-AAE1 User Manual Download | Manualshive

Page: 61 / 131

background image

- 61 -

System Hardware Installation

CPU1

CPU0

B

B

A
A

B

C

C
C

A

F

F

F

D

D
D

E

E

E

A

NVMe

0-1Cable

Motherboard

:

U2_P0_3AC

D

NVMe 6-7

Cable

Motherboard

:

U2_P0_4CA

F/ HDD Board:

U_2_0/U_2_1

F/ HDD Board:

U_2_6/U_2_7

B

NVMe 2-3

Cable

Motherboard

:

U2_P0_3EG

E

NVMe 8-9

Cable

Motherboard

:

U2_P1_3AC

F/ HDD Board:

U_2_2/U_2_3

F/ HDD Board:

U_2_8/U_2_9

C

NVMe 4-5

Cable

Motherboard

:

U2_P0_3EG

F

NVMe10-11

Cable

Motherboard

:

U2_P1_3EG

F/ HDD Board:

U_2_4/U_2_5

F/ HDD Board:

U_2_10/U_2_11

«
...
59
60
61
62
63
...
»

Summary of Contents for R283-S90-AAE1

Page 1: ...R283 S90 AAJ3 4th Gen Intel Xeon Scalable Server System 2U DP 12 2 Bay NVMe SATA SAS AAE1 AAJ1 4th Gen Intel Xeon Scalable Server System 2U DP 12 2 Bay SATA SAS AAE2 AAJ2 4th Gen Intel Xeon Scalable Server System 2U DP 12 2 Bay NVMe SATA SAS AAE3 AAJ3 User Manual Rev 1 0 ...

Page 2: ...g hardware and BIOS User Guide detailed information about the installation use of an add on hardware or software component e g BMC firmware rail kit compatible with this product Quick Installation Guide a short guide with visual diagrams that you can reference easily for installation purposes of this product e g motherboard server barebones Please see the support section of the online product page...

Page 3: ...this user s guide NOTE Pieces of additional information related to the current topic CAUTION Precautionary measures to avoid possible hardware or software problems WARNING Alerts to any damage that might result from doing or not doing specific actions ...

Page 4: ...k of personal injury from hot surfaces allow the drives and the internal system components to cool before touching them WARNING This server is equipped with high speed fans Keep away from hazardous moving fan blades during servicing CAUTION Do not operate the server for long periods with the access panel open or removed Operat ing the server in this manner results in improper airflow and improper ...

Page 5: ...ystem is removed from the rack before opening the chassis adding or removing any non hot plug components Hazardous conditions devices and cables Hazardous electrical conditions may be present on power telephone and communication cables Turn off the system chassis and disconnect the cables attached to the system before servicing the chassis Otherwise personal injury or equip ment damage can result ...

Page 6: ... do not have such a tab take care when us ing needle nosed pliers to remove or install a jumper grip the narrow sides of the jumper with the pliers never the wide sides Gripping the wide sides can dam age the contacts inside the jumper causing intermittent problems with the function con trolled by that jumper Take care to grip with but not squeeze the pliers or other tool used to remove a jumper o...

Page 7: ...er 31 3 2 Removing and Installing the Hard Disk Drive 32 3 3 Removing and Installing the Fan Duct 34 3 4 Removing and Installing the Heat Sink 35 3 5 Installing the CPU and Heat Sink 36 3 6 Removing and Installing Memory 38 3 6 1 Eight Channel Memory Configuration 38 3 6 2 Removing and Installing a Memory Module 39 3 6 3 Memory Population Table 39 3 6 4 Processor and Memory Module Matrix Table 40 ...

Page 8: ...port Configuration 84 5 2 8 NVMe Configuration 85 5 2 9 Chipset Configuration 86 5 2 10 Tls Auth Configuration 87 5 2 11 iSCSI Configuration 88 5 2 12 Intel R i350 Gigabit Network Connection 89 5 2 13 VLAN Configuration 91 5 2 14 Driver Health 92 5 3 Chipset Menu 93 5 3 1 Processor Configuration 94 5 3 2 Common RefCode Configuration 97 5 3 3 UPI Configuration 98 5 3 4 Memory Configuration 100 5 3 ...

Page 9: ...Configuration 120 5 4 5 IPv6 BMC Network Configuration 121 5 5 Security Menu 122 5 5 1 Secure Boot 123 5 6 Boot Menu 126 5 7 Save Exit Menu 128 5 8 BIOS Recovery 130 5 9 BIOS POST Beep code AMI standard 131 5 9 1 PEI Beep Codes 131 5 9 2 DXE Beep Codes 131 ...

Page 10: ... 10 This page intentionally left blank ...

Page 11: ...s dry and first touch a metal object to eliminate static electricity Prior to installing the motherboard please have it on top of an antistatic pad or within an electrostatic shielding container Before unplugging the power supply cable from the motherboard make sure the power supply has been turned off Before turning on the power make sure the power supply voltage has been set according to the loc...

Page 12: ...ket E Socket Socket Security Security Server Operating Properties Power Supply System fan Chipset Intel C741 Chipset Socket Socket Security Security Server Operating Properties Power Supply System fan Security UEFI Secure Boot Silicon root of trust SNMP Support V3 Memory 32 x DIMM slots DDR5 memory supported only 8 Channel memory architecture RDIMM modules up to 128GB supported 3DS RDIMM modules u...

Page 13: ... bays on rear side SAS card is required for SAS devices support SAS Depends on SAS Add on card RAID Intel SATA RAID 0 1 10 5 Expansion Slot AAE1 AAJ1 Riser Card CRS101J 1 x PCIe x16 slot Gen5 x16 FHHL from CPU_0 Riser Card CRS101K 1 x PCIe x16 slot Gen5 x16 FHHL from CPU_1 Riser Card CRS202E 2 x Low profile half length slots with PCIe x16 Gen5 x8 bus from CPU_0 Riser Card CRS202G 2 x PCIe x16 slot...

Page 14: ...02H 2 x PCIe x16 slots Gen5 x16 FHHL from CPU_1 2 x OCP 3 0 slots with PCIe Gen5 x16 bandwidth 1 x from CPU_0 and 1 x from CPU_1 Supported NCSI function Expansion Slot AAE3 AAJ3 Riser Card CRS101J 1 x PCIe x16 slot Gen5 x16 FHHL from CPU_0 Riser Card CRS101K 1 x PCIe x16 slot Gen5 x16 FHHL from CPU_1 Riser Card CRS202G 1 x PCIe x16 slots Gen5 x16 FHHL from CPU_0 Riser Card CRS202H 2 x PCIe x16 slo...

Page 15: ...h LED Backplane I O AAE1 AAJ1 AAE3 AAJ3 Front Side Backplane P N 9CBP20C5NR 00 Rear Side Backplane P N 9CBP2022NR 00 Speed and bandwidth PCIe Gen4 x4 or SATA 6Gb s or SAS 12Gb s on front side SATA 6Gb s or SAS 12Gb s on rear side AAE2 AAJ2 Front Side Backplane P N 9CBP20C5NR 00 Rear Side Backplane P N 9CBP2022NR 00 Speed and bandwidth SATA 6Gb s or SAS 12Gb s on front side SATA 6Gb s or SAS 12Gb s...

Page 16: ...40Vdc 10A DC Output Max 1000W 100 120V 12 2V 81 5A 12Vsb 2 5A Max 1600W 180 199V 12 2V 131A 12Vsb 2 5A Max 1800W 200 220V 12 2V 147 5A 12Vsb 2 5A Max 2000W 221 240V 12 2V 163 5A 12Vsb 2 5A AAJ1 AAJ2 AAJ3 Dual 2000W 240V 80 PLUS Platinum redundant power supply AC Input 100 120V 12A 50 60Hz 180 240V 10A 50 60Hz DC Input 240Vdc 10A DC Output Max 1000W 100 127V 12 2V 82A 12Vsb 3A Max 1800W 200 220V 12...

Page 17: ...e Inventory Fan Profile System Firewall Power Consumption Power Control LDAP AD RADIUS Support Backup Restore Configuration Remote BIOS BMC CPLD Update Event Log Filter User Management Media Redirection Settings PAM Order Settings SSL Settings SMTP Settings Socket cket Security Security Server Operating Properties Power Supply System fan Operating Properties Operating temperature 10 C to 35 C Oper...

Page 18: ...USB2 0 4 bay 3 5 2 5 Gen4 NVMe SATA SAS 8 bay 3 5 2 5 SATA SAS 2 bay 2 5 SATA SAS rear PCIe5 0 x16 SATAIII x16 PCIe5 0 x16 PCIe5 0 x16 PCIe5 0 x16 MCIO 8i x8 8 Channel DDR5 16 x DIMMs Speed up to 4800 MHz 8 Channel DDR5 16 x DIMMs Speed up to 4800 MHz 4 x UPI 16 GT s 2 x PCIe5 0 x16 FHHL slots Riser CRS202H PCIe5 0 x16 PCIe5 0 x16 PCIe5 0 x16 2 x PCIe5 0 x16 FHHL slots Riser CRS202G PCIe5 0 x8 PCI...

Page 19: ...SB2 0 12 bay 3 5 2 5 SATA SAS 2 bay 2 5 SATA SAS rear PCIe5 0 x16 SATAIII x16 PCIe5 0 x16 PCIe5 0 x16 PCIe5 0 x16 MCIO 8i x8 8 Channel DDR5 16 x DIMMs Speed up to 4800 MHz 8 Channel DDR5 16 x DIMMs Speed up to 4800 MHz 4 x UPI 16 GT s 2 x PCIe5 0 x16 FHHL slots Riser CRS202H PCIe5 0 x16 PCIe5 0 x16 PCIe5 0 x16 2 x PCIe5 0 x16 FHHL slots Riser CRS202G PCIe5 0 x8 PCIe5 0 x8 PCIe5 0 x16 PCIe5 0 x16 P...

Page 20: ...3 x4 USB3 0 USB2 0 USB3 0 USB2 0 PCIe5 0 x16 SATAIII x16 PCIe5 0 x16 PCIe5 0 x16 NVMe x8 PCIe5 0 x16 MCIO 8i x8 8 Channel DDR5 16 x DIMMs Speed up to 4800 MHz 8 Channel DDR5 16 x DIMMs Speed up to 4800 MHz 4 x UPI 16 GT s 2 x PCIe5 0 x16 FHHL slots Riser CRS202H PCIe5 0 x16 PCIe5 0 x16 PCIe5 0 x16 1 x PCIe5 0 x16 FHHL slot Riser CRS202G PCIe5 0 x16 disabled PCIe5 0 x16 CPU0 4th Gen Intel Xeon Scal...

Page 21: ...ption 1 Front Panel LEDs and Buttons 2 USB 3 2 Gen1 Port x 2 Note Drives with green latches support NVMe Refer to section 2 3 Front Panel LEDs and Buttons for a detailed description of the function of the LEDs 1 2 HDD0 HDD1 HDD2 HDD3 HDD4 HDD5 HDD6 HDD7 HDD8 HDD9 HDD10 HDD11 ...

Page 22: ...ement LAN Port 2 ID LED 6 OCP 3 0 Slot Option SFF 3 USB 3 2 Gen1 Port x 2 7 PCIe Slot 4 1GbE LAN Port x 2 No Description No Description 1 Mini DP Port 6 OCP 3 0 Slot Option SFF 2 ID LED 7 PCIe Slot 3 USB 3 2 Gen1 Port x 2 8 2 5 Hard Drive Bay 4 1GbE LAN Port x 2 9 PCIe Slot 5 Server Management LAN Port Refer to section 2 5 Rear System LAN LEDs for a detailed description of the function of the LEDs...

Page 23: ...in ACPI S5 state power off System is in ACPI S4 state hibernate mode 4 ID Button with LED Note This LED represents the RoT function LED behavior Please see the following section for detail LED behavior 5 HDD Status LED Note Green On Indicates locating the HDD Blink Indicates accessing the HDD Amber On Indicates HDD error Green Amber Blink Indicates HDD rebuilding N A Off Indicates no HDD access or...

Page 24: ...or the server to generate a NMI to the processor If multiple bit ECC errors occur the server will effectively be halted 5 System Status LED Note Green On Indicates system is operating normally Amber On Indicates a critical condition may include System fan failure System temperature Blink Indicates non critical condition may include Redundant power module failure Temperature and voltage issue Chass...

Page 25: ...ages OFF OFF Recovering BMC Active Flash Blinks Blue 4 times per second Blinks Green 4 times per second Recovering BIOS Active Flash Blinks Blue 4 times per second Blinks Green 4 times per second Authentication AUTH Pass Recovering BIOS Active Flash OFF OFF BMC AUTH pass after doing recovery BIOS AUTH pass after doing recovery OFF OFF BMC AUTH pass after doing recovery BIOS AUTH pass OFF OFF BMC A...

Page 26: ...or Microchip CEC1702 Once Microchip CEC1702 is working Auth or recovery the front panel LED is controlled by Microchip CEC1702 and vice versa Active Flash Authentication AUTH Fail BMC AUTH Fail Note2 Blinks Blue 1 time per second Blinks Green 1 time per second BIOS AUTH fail Note2 Blinks Blue 1 time per second Blinks Amber 1 time per second BMC AUTH fail after doing recovery Note3 Blinks Blue 2 ti...

Page 27: ... Speed LED Yellow On 1 Gbps data rate Green On 100 Mbps data rate N A Off 10 Mbps data rate 2 1GbE Link Activity LED Green On Link between system and network or no access Blink Data transmission or reception is occurring N A Off No data transmission or reception is occurring 1 2 1 2 2 1 ...

Page 28: ...2Hz Green Blinking Power supply firmware updating mode Amber AC cord unplugged or AC power lost with a second power supply in parallel still with AC input power Power supply critical event causing shut down failure OCP OVP fan failure and UVP 1Hz Amber Blinking Power supply warning events where the power supply continues to operate high temp high power high current and slow fan ...

Page 29: ...OFF OFF OFF Removed HDD Slot LED on Back Panel Green ON 1 OFF Amber OFF OFF RAID configuration via HW RAID Card or SW RAID Card Disk LED Green ON OFF BLINK 2 OFF Amber OFF ON Low Speed 2 Hz OFF OFF Removed HDD Slot Green ON 1 OFF 3 Amber OFF ON 3 NOTE 1 Depends on HBA Utility Spec 2 Blink cycle depends on HDD s activity signal 3 If HDD is pulled out during rebuilding the disk status of this HDD is...

Page 30: ...ver you are working inside the computer case If possible wear a grounded wrist strap when you are working inside the computer case Alternatively discharge any static electricity by touching the bare metal system of the computer case or the bare metal body of any other grounded appliance Hold electronic circuit boards by the edges only Do not touch the components on the board unless it is necessary...

Page 31: ...o AC power Follow these instructions to remove the chassis cover 1 Remove the screw securing the chassis cover 2 Unlock the plastic handle and pull the grip handle to open the panel cover 3 Slide the cover cover to the rear of the system and then remove the cover in the direction indicated by the arrow 4 To reinstall the chassis cover follow steps 1 4 in reverse order 4 2 3 1 ...

Page 32: ... is connected to the connector on the backplane Follow these instructions to install a 3 5 hard disk drive 1 Press the release button 2 Extend the locking lever 3 Pull the locking lever in the direction indicated to remove the 3 5 HDD tray 4 Pull the sides of the HDD tray in the direction indicated 5 Slide the hard disk drive into the HDD tray 6 Push the sides of the HDD tray back in the direction...

Page 33: ...ss the release button 2 Extend the locking lever 3 Pull the locking lever in the direction indicated to remove the HDD tray 4 Align the hard disk drive with the positioning screw on the HDD tray 5 Secure the hard disk drive with five screws 6 Reinsert the HDD tray into the slot and close the locking lever 2 1 3 4 5 ...

Page 34: ...g and Installing the Fan Duct Follow these instructions to remove the fan duct 1 Lift up to remove the fan duct 2 To reinstall the fan duct align the fan duct with the guiding groove Push down the fan duct until it is firmly seated on the system ...

Page 35: ...and stable surface Open the system according to the instructions WARNING Failure to turn off the server before you start installing components may cause serious damage Do not attempt the procedures described in the following sections unless you are a qualified service technician Follow these instructions to install the heat sink 1 Loosen the screws securing the heat sink in place in reverse order ...

Page 36: ...n Follow these instructions to install the CPU 1 Align the processor to the carrier so that the gold triangle on the processor aligns with the triangle on the carrier and then install the processor into the carrier NOTE Apply thermal compound evenly on the top of the CPU 2 Carefully flip the heatsink over Align the carrier assembly so that the triangle on the carrier aligns with the triangle on th...

Page 37: ...pes used for Package Types NOTE The carrier code is marked on each carrier and matches a code laser marked on to the IHS Integrated Heat Spreader to ensure the right parts are used together When installing the heatsink to CPU use T30 Lobe driver to tighten 4 captive nuts in sequence as 1 4 The screw tightening torque 8 0 5 kgf cm ...

Page 38: ...DIMM_P0_E1 DIMM_P1_I1 DIMM_P1_L1 DIMM_P1_K0 DIMM_P1_K1 DIMM_P1_J0 DIMM_P1_J1 DIMM_P1_I0 DIMM_P1_L0 DIMM_P1_P0 DIMM_P1_M0 DIMM_P1_N1 DIMM_P1_N0 DIMM_P1_O1 DIMM_P1_O0 DIMM_P1_P1 DIMM_P1_M1 Read the following guidelines before you begin to install the memory Make sure that the motherboard supports the memory It is recommended that memory of the same capacity brand speed and chips be used Always turn ...

Page 39: ...rtically into the DIMM slot and push it down 2 Close the plastic clip at both edges of the DIMM slots to lock the DIMM module 3 Reverse the installation steps when you want to remove the DIMM module 1 2 2 3 6 3 Memory Population Table Type Ranks Per DIMM and Data Width DIMM Capacity GB Speed MT s Voltage V DIMM per Channel DPC 1DPC 2DPC 16Gb 1 1V RDIMM SRx8 RC D 16GB 4800 4400 SRx4 RC C 32GB SRx4 ...

Page 40: ... L0 L1 K0 K1 O1 O0 P1 P0 M1 M0 N1 N0 V 1 DIMM 2 DIMM 6 DIMM 8 DIMM 12 DIMM V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V 16 DIMM V V V V V V V V V V V V V V V V V CPU0 B0 B1 A0 A1 D0 D1 C0 C1 G1 G0 H1 H0 E1 E0 F1 F0 V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V ...

Page 41: ...include a riser card or any cabling as standard To install a PCIe card a riser card must be installed Follow these instructions to install a PCIe card 1 Loosen the two thumbnail screws securing the riser bracket inside the system 2 Lift up the riser bracket out of system 3 Remove the screw securing the slot cover from riser bracket 4 Orient the PCIe card with the riser guide slot and push in the d...

Page 42: ... 42 System Hardware Installation 2 2 1 1 3 2 4 5 3 2 4 5 ...

Page 43: ... latch Follow these instructions to install an OCP 3 0 Mezzanine card 1 Remove the two screws securing the OCP 3 0 card slot cover 2 Remove the slot cover from the system 3 Insert the OCP 3 0 card into the card slot ensuring that the card is firmly connected to the connector on the motherboard 4 Tighten the thumbnail screw to secure the OCP 3 0 card in place 5 Reverse steps 3 4 to replace the OCP ...

Page 44: ... previous steps to install the replacement fan assembly 1 2 Voltages can be present within the server whenever an AC power source is connected This voltage is present even when the main power switch is in the off position Ensure that the system is powered down and all power sources have been disconnected from the server prior to replacing a system fan Failure to observe these warnings could result...

Page 45: ... power supply handle 2 Press the retaining clip on the right side of the power supply unit in the direction indicated 3 Pull out the power supply unit using the handle 4 Insert the replacement power supply unit firmly into the chassis Connect the AC power cord to the replacement power supply 5 Repeat steps 1 4 for replacement of the second power supply 3 1 2 4 ...

Page 46: ...allation CPU1 CPU0 A B A B A Front Panel LEDs and Buttons Cable Motherboard FP_1 Front IO Board FP_1 Front IO Board FP_1 B Front Panel USB 3 Ports Cable Motherboard FUSB_1 3 11 Cable Routing 3 11 1 R283 S90 AAE1 R283 S90 AAJ1 ...

Page 47: ... 47 System Hardware Installation CPU1 CPU0 A A B B A HDD Backplane Board Signal Cable Motherboard BP_1 F HDD Board BP_1 B HDD Backplane Board Signal Cable F HDD Board BP_SERIES R HDD Board BP_1 ...

Page 48: ...System Hardware Installation 48 CPU1 CPU0 A B B A A HDD Backplane Board Power Cable Motherboard BP_ATX1 F HDD Board ATX1 B HDD Backplane Board Power Cable Motherboard ATX2 R HDD Board BP_2X3 ...

Page 49: ...on CPU1 CPU0 A A B B C C D D A SATA Cable Motherboard SATA0 C SATA Cable Motherboard SATA2 F HDD Board SL_SAS0 F HDD Board SL_SAS2 B SATA Cable Motherboard SATA1 D SATA Cable Motherboard SATA3 F HDD Board SL_SAS1 R HDD Board SL_SAS0 ...

Page 50: ... 50 System Hardware Installation CPU1 CPU0 B B A B A A A NVMe 8 9 Cable Motherboard U2_P1_3AC B NVMe 10 11 Cable Motherboard U2_P1_3AC F HDD Board U_2_8 U_2_9 F HDD Board U_2_10 U_2_11 ...

Page 51: ...ar Side PCIe Cable Motherboard U2_P0_3AC U2_P0_3EG Motherboard Slot1 MCIO_P1 MCIO_P2 B System Rear Side PCIe Cable Motherboard U2_P0_4GE U2_P0_4CA Left PCIe Card MCIO_PCIE1 MCIO_PCIE2 C System Rear Side PCIe Cable Motherboard U2_P1_4GE U2_P1_4CA Motherboard Slot4 MCIO_P1 MCIO_P2 ...

Page 52: ...dware Installation 3 11 2 R283 S90 AAE2 R283 S90 AAJ2 CPU1 CPU0 A B A B A Front Panel LEDs and Buttons Cable Motherboard FP_1 Front IO Board FP_1 Front IO Board FP_1 B Front Panel USB 3 Ports Cable Motherboard FUSB_1 ...

Page 53: ... 53 System Hardware Installation CPU1 CPU0 A A B B A HDD Backplane Board Signal Cable Motherboard BP_1 F HDD Board BP_1 B HDD Backplane Board Signal Cable F HDD Board BP_SERIES R HDD Board BP_1 ...

Page 54: ... 54 System Hardware Installation CPU1 CPU0 A B B A A HDD Backplane Board Power Cable Motherboard ATX1 F HDD Board ATX1 B HDD Backplane Board Power Cable Motherboard ATX2 R HDD Board BP_2X3 ...

Page 55: ...ation CPU1 CPU0 A A B B C C D D A SATA Cable Motherboard SATA0 F HDD Board SL_SAS0 B SATA Cable Motherboard SATA1 F HDD SL_SAS1 C SATA Cable Motherboard SATA2 F HDD Board SL_SAS2 D SATA Cable Motherboard SATA3 R HDD Board SL_SAS0 ...

Page 56: ...ar Side PCIe Cable Motherboard U2_P0_3AC U2_P0_3EG Motherboard Slot1 MCIO_P1 MCIO_P2 B System Rear Side PCIe Cable Motherboard U2_P0_4GE U2_P0_4CA Left PCIe Card MCIO_PCIE1 MCIO_PCIE2 C System Rear Side PCIe Cable Motherboard U2_P1_4GE U2_P1_4CA Motherboard Slot4 MCIO_P1 MCIO_P2 ...

Page 57: ...dware Installation 3 11 3 R283 S90 AAE3 R283 S90 AAJ3 CPU1 CPU0 A B A B A Front Panel LEDs and Buttons Cable Motherboard FP_1 Front IO Board FP_1 Front IO Board FP_1 B Front Panel USB 3 Ports Cable Motherboard FUSB_1 ...

Page 58: ... 58 System Hardware Installation CPU1 CPU0 A A B B A HDD Backplane Board Signal Cable Motherboard BP_1 F HDD Board BP_1 B HDD Backplane Board Signal Cable F HDD Board BP_SERIES R HDD Board BP_1 ...

Page 59: ... 59 System Hardware Installation CPU1 CPU0 B B A A A HDD Backplane Board Power Cable Motherboard BP_ATX1 F HDD Board ATX1 B HDD Backplane Board Power Cable Motherboard ATX2 R HDD Board BP_2X3 ...

Page 60: ...on CPU1 CPU0 A A B B C C D D A SATA Cable Motherboard SATA0 C SATA Cable Motherboard SATA2 F HDD Board SL_SAS0 F HDD Board SL_SAS2 B SATA Cable Motherboard SATA1 D SATA Cable Motherboard SATA3 F HDD Board SL_SAS1 R HDD Board SL_SAS0 ...

Page 61: ...Cable Motherboard U2_P0_4CA F HDD Board U_2_0 U_2_1 F HDD Board U_2_6 U_2_7 B NVMe 2 3 Cable Motherboard U2_P0_3EG E NVMe 8 9 Cable Motherboard U2_P1_3AC F HDD Board U_2_2 U_2_3 F HDD Board U_2_8 U_2_9 C NVMe 4 5 Cable Motherboard U2_P0_3EG F NVMe10 11 Cable Motherboard U2_P1_3EG F HDD Board U_2_4 U_2_5 F HDD Board U_2_10 U_2_11 ...

Page 62: ... 62 System Hardware Installation CPU1 CPU0 A A A A A System Rear Side PCIe Cable Motherboard U2_P1_4GE U2_P1_4CA Motherboard Slot4 MCIO_P1 MCIO_P2 ...

Page 63: ...ector U2_P1_4GE 4CA 5 2 x 2 Pin P12V Backplane Power Connector 6 MCIO Connector U2_P1_3AC 3EG 7 MCIO Connector U2_P0_4GE 4CA 8 2 x 2 Pin P12V Backplane Power Connector 9 MCIO Connector U2_P0_3AC 3EG 10 HDD Back Plane Board Connector 11 Front Panel Connector 12 2 x 3 Pin ATX Power Connector 13 Front Panel USB 3 0 Connector 14 P12V GPU Power Connector P12V_S6 15 Power Supply Connector 1 Primary 16 R...

Page 64: ...ht SATA0 SATA1 SATA2 SATA3 20 System Battery 21 TPM Module Connector SPI Interface 22 G SC Module Connector 23 OCP 3 0 Connector PCIe Gen5 x16 24 Riser Connector 3 PCIe x16 25 Riser Connector 4 PCIe x16 26 Power Supply Connector 2 Secondary 27 P12V GPU Power Connector P12V_S11 ...

Page 65: ...R_CMOS Enable Default 1 2 3 J2 J1 J4 J2 ON OFF 1 ME_UPDATE Force ME update Normal Default 2 BIOS_PWD Clear supervisor password Normal Default 3 BIOS_RCVR BIOS recovery mode Normal Default 4 ME_RCVR ME recovery mode Normal Default J1 ON OFF 1 HSMB_SEL BIOS defined 2 PMBUS_SEL BIOS defined 3 S3_MASK Stop initial power on when BMC is not ready Normal Default 4 DP_PLD CPLD debug mode Normal Default ...

Page 66: ...rd Components 66 4 3 G SC Module 4 3 1 CDCR112 BMC1 BMC2 BIOS1 BIOS2 1 2 3 4 5 Item Description 1 10 100 1000 Server Management LAN Port 2 1GbE LAN Port 2 3 1GbE LAN Port 1 4 USB 3 2 Gen1 Port x 2 5 Mini DP Port ...

Page 67: ...ctor SFF 8654 4i U 2_3 5 SlimLine SAS Connector SFF 8654 4i U 2_4 6 SlimLine SAS Connector SFF 8654 4i U 2_5 7 SlimLine SAS Connector SFF 8654 4i U 2_6 8 SlimLine SAS Connector SFF 8654 4i U 2_7 9 SlimLine SAS Connector SFF 8654 4i U 2_8 10 SlimLine SAS Connector SFF 8654 4i U 2_9 11 SlimLine SAS Connector SFF 8654 4i U 2_10 12 SlimLine SAS Connector SFF 8654 4i U 2_11 13 SlimLine SAS Connector SF...

Page 68: ...rd Components 68 4 4 2 CBP2022 Rear System Storage Board 2 3 1 Item Description 1 SlimLine SAS Connector SFF 8654 4i U_2_0 2 SlimLine SAS Connector SFF 8654 4i U_2_1 3 SlimLine SAS Connector SFF 8654 4i SL_SAS0 ...

Page 69: ... with caution Inadequate BIOS flashing may result in system malfunction It is recommended that you not alter the default settings unless you need to to prevent system instability or other unexpected results Inadequately altering the settings may result in system s failure to boot If this occurs try to clear the CMOS values and reset the board to default values Refer to the Exit section in this cha...

Page 70: ... Change set or disable supervisor and user password Configuration supervisor password allows you to restrict access to the system and BIOS Setup A supervisor password allows you to make changes in BIOS Setup A user password only allows you to view the BIOS settings but not to make changes Boot This setup page provides items for configuration of the boot sequence Save Exit Save all the changes made...

Page 71: ... displayed on the bottom line of the Main Menu Submenu Help While in a submenu press F1 to display a help screen General Help of function keys available for the menu Press Esc to exit the help screen Help for each item is in the Item Help block on the right side of the submenu When the system is not stable as usual select the Restore Defaults item to set your system to its defaults The BIOS Setup ...

Page 72: ... CPU Brand String Max CPU Speed CPU Signature Processor Core Microcode Patch Displays the technical information for the installed processor s Platform Information Processor PCH RC Revision Displays the information of the installed processor s and PCH Memory Information Note2 Total Memory Displays the total memory size of the installed memory Usable Memory Displays the usable memory size of the ins...

Page 73: ...ory Onboard LAN Information Note3 LAN MAC Address Displays LAN MAC address information System Date Sets the date following the weekday month day year format System Time Sets the system time following the hour minute second format Note3 The number of LAN ports listed will depend on the motherboard system model ...

Page 74: ...IOS Setup 5 2 Advanced Menu The Advanced Menu displays submenu options for configuring the function of various hardware components Select a submenu item then press Enter to access the related submenu screen ...

Page 75: ...eter Description Configuration TPM v1 2 Support Enable Disable BIOS support for security device OS will not show security device TCG EFI protocol and INT1A interface will not be available Options available Disable Enable Default setting is Enable ...

Page 76: ...gs Press Enter to configure advanced items Please note that this item is configurable when COM1 Console Redirection is set to Enabled Terminal Type Selects a terminal type to be used for console redirection Options available VT100 VT100PLUS VT UTF8 ANSI Default setting is VT100PLUS Bits per second Selects the transfer rate for console redirection Options available 9600 19200 38400 57600 115200 Def...

Page 77: ... Control Flow control can prevent data loss from buffer overflow When sending data if the receiving buffers are full a stop signal can be sent to stop the data flow Once the buffers are empty a start signal can be sent to re start the flow Hardware flow control uses two wires to send start stop signals Options available None Hardware RTS CTS Default setting is None VT UTF8 Combo Key Support Enable...

Page 78: ...ency Management Service EMS allows for remote management of a Windows Server OS through a serial port Default setting is COM1 Terminal Type EMS Selects a terminal type to be used for console redirection Options available VT100 VT100PLUS VT UTF8 ANSI Default setting is VT100PLUS Bits per second EMS Selects the transfer rate for console redirection Options available 9600 19200 57600 115200 Default s...

Page 79: ...llows you to configure the serial port settings When set to Disabled displays no configuration for the serial port Options available Enabled Disabled Default setting is Enabled Logical Device Settings Current Displays the serial port base I O address and IRQ Possible Configures the serial port base I O address and IRQ Use Automatic Settings IO 3F8h IRQ 4 DMA IO 3F8h IRQ 4 DMA IO 2F8h IRQ 4 DMA IO ...

Page 80: ... 80 BIOS Setup 5 2 4 PCI Subsystem Settings ...

Page 81: ...N controller Options available Enabled Disabled Default setting is Enabled Onboard LAN1 LAN2 I O ROM Note2 Enable Disable the onboard LAN devices and initializes device expansion ROM Options available Enabled Disabled Default setting is Enabled PCI Devices Common Settings Above 4G Decoding Enable Disable memory mapped I O to 4GB or greater address space Above 4G Decoding Options available Enabled ...

Page 82: ...nd off support Options available Enabled Disabled Default setting is Enabled USB Mass Storage Driver Support Note Enable Disable the USB Mass Storage Driver Support Options available Enabled Disabled Default setting is Enabled Port 60 64 Emulation Enables the I O port 60h 64h emulation support This should be enabled for the complete USB Keyboard Legacy support for non USB aware OSes Options availa...

Page 83: ...ons available Enabled Disabled Default setting is Disabled Ipv6 PXE Support Enable Disable the Ipv6 PXE feature Options available Enabled Disabled Default setting is Disabled Ipv6 HTTP Support Enable Disable the Ipv6 HTTP feature Options available Enabled Disabled Default setting is Disabled PXE boot wait time Wait time in seconds to press ESC key to abort the PXE boot Press the keys to increase o...

Page 84: ...Description Post Report Configuration Error Message Report Post Error Message Enable Disable the POST Error Message support Options available Enabled Disabled Default setting is Enabled Halt On Options available No Error All Error Default setting is No Error ...

Page 85: ...up 5 2 8 NVMe Configuration Parameter Description NVMe Configuration Displays the NVMe devices connected to the system NVMe OPROM Select Options available BIOS Build In NVMe Device Default setting is BIOS Build In ...

Page 86: ... IO Size Specifies P2P Bridge IO aligned to the size Options available 0x100 0x150 0x1000 Default setting is 0x1000 SATA HDD Security Frozen Enable Disable this item to send freeze lock command to SATA HDD Options available Enabled Disabled Default setting is Enabled NVMe SSD Security Frozen Attempt to send freeze lock command to NVMe SSDs during boot Options available Enabled Disabled Default set...

Page 87: ...figuration of advanced items Enroll Cert Press Enter to enroll a certificate Enroll Cert Using File Cert GUID Input digit character in 1111111 2222 3333 4444 1234567890ab format Commit Changes and Exit Discard Changes and Exit Delete Cert Client Cert Configuration Press Enter for configuration of advanced items ...

Page 88: ... Priority Use arrow keys to select the attempt then press keys to move the attempt up down in the attempt order list Commit Changes and Exit Host iSCSI Configuration Press Enter to configure advanced items iSCSI Initiator Name Only IQN format is accepted Range from 4 to 223 Add an Attempt Delete Attempts Change Attempt Order ...

Page 89: ... 89 BIOS Setup 5 2 12 Intel R i350 Gigabit Network Connection ...

Page 90: ...he numeric keys to adjust desired values up to 15 seconds UEFI Driver Displays the technical specifications for the Network Interface Controller Adapter PBA Displays the technical specifications for the Network Interface Controller Device Name Displays the technical specifications for the Network Interface Controller Chip Type Displays the technical specifications for the Network Interface Control...

Page 91: ...ng VLAN Press the keys to increase or decrease the desired values The valid range is from 0 to 4094 Priority Sets 802 1Q Priority for a new VLAN or an existing VLAN Press the keys to increase or decrease the desired values The valid range is from 0 to 7 Add VLAN Press Enter to create a new VLAN or update an existing VLAN Configured VLAN List Remove VLAN Press Enter to remove an existing VLAN ...

Page 92: ... 92 BIOS Setup 5 2 14 Driver Health Parameter Description Driver Health Displays driver health status of the devices controllers if installed ...

Page 93: ...IOS Setup 5 3 Chipset Menu Chipset Setup menu displays submenu options for configuring the function of Platform Controller Hub PCH Select a submenu item then press Enter to access the related submenu screen ...

Page 94: ... 94 BIOS Setup 5 3 1 Processor Configuration ...

Page 95: ...ult setting is Disable Adjacent Cache Prefetch When enabled cache lines are fetched in pairs When disabled only the required cache line is fetched Options available Enable Disable Default setting is Enable DCU Streamer Prefetcher Enable Disable DCU streamer prefetcher Options available Enable Disable Default setting is Enable DCU IP Prefetcher Enable Disable DCU IP Prefetcher Options available Ena...

Page 96: ...on Press Enter to configure advanced items Provision S3M CFR Options available Disable Enable Default setting is Enable Manual Commit S3M FW CFR Options available Disable Enable Auto Default setting is Auto Provision PUcode CFR Options available Disable Enable Default setting is Enable Manual Commit PUcode CFR Options available Enable Disable Default setting is Enable Socket0 CFR Revision Info Dis...

Page 97: ...ption Common RefCode Configuration Virtual Numa Divide physical NUMA nodes into evenly sized virtual NUMA nodes in ACPI table This may improve Windows performance on CPUs with more than 64 logical processors Options available Enable Disable Default setting is Disable ...

Page 98: ...lt setting is Auto SNC Enable Disable Sub NUMA Cluster function Options available Auto Disable Enable SNC2 2 clusters Enable SNC4 4 clusters Default setting is Auto Stale AtoS Enable Disable Stale A to S directory optimization Options available Disable Enable Auto Default setting is Auto LLC dead line alloc Enable Disable fill dead lines in LLC Options available Disable Enable Auto Default setting...

Page 99: ...uration continued MMIO High Granularity Size Selects the allocation size used to assign mmioh resources Options available 1G 4G 16G 64G 256G 1024G Default setting is 64G Clock Modulation Enabled Options available Disable Enable Auto Default setting is Auto ...

Page 100: ... Auto Enable ADR Enables the detecting and enabling of ADR Asynchronous DRAM Refresh function Options available Enable Disable Default setting is Enable Legacy ADR Mode Enable Disable the Legacy ADR Mode Options available Enable Disable Auto Default setting is Auto Minimum System Memory Size Configures the minimum memory size Options available 2GB 4GB 6GB 8GB Default setting is 2GB ADR Data Save M...

Page 101: ...fetch Options available Disabled Full Mirror Mode Partial Mirror Mode Default setting is Disabled Partial Mirror 1 Size GB Selects multiplier of 1GB for the size of the SAD to be created Correctable Error Threshold Correctable Error Threshold 0x01 0x7fff used for sparing and leaky bucket Press the keys to increase or decrease the desired values Trigger SW Error Threshold Note Enable Disable Sparin...

Page 102: ...he desired values Leaky bucket high bit Configures leaky bucket high bit 0x1 0x29 Press the keys to increase or decrease the desired values ADDDC Sparing Note Enable Disable ADDDC Sparing Options available Disabled Enabled Default setting is Disabled Enable ADDDC Error Injection Options available Disabled Enabled Default setting is Enabled Patrol Scrub Options available Disabled Enable at End of P...

Page 103: ...Enable ACS Control Enable Programs ACS only to Chipset PCIe Root Ports Bridges Disable Programs ACS to all PCIe bridges Default setting is Enable Cache Allocation Options available Enable Disable Default setting is Enable Opt Out Illegal MSI Mitigation Enable Disable Opt Out Illegal 0xFEE Platform Mitigation Options available Disable Enable Default setting is Disable DMA Control Opt In Flag Enable...

Page 104: ...A Protection Options available Enable Disable Default setting is Disable Intel VMD technology Press Enter to configure advanced items Intel VMD Configuration Enable Disable Intel VMD technology Options available Enable Disable Default setting is Disable Intel VMD for Non Hotplug NVMe Note Enable Disable Intel VMD for Non Hotplug NVMe Options available Enable Disable Default setting is Disable Note...

Page 105: ... of its processing cores to improve its performance When this item is disabled the processor will not overclock any of its core Options available Enable Disable Default setting is Enable Hardware PM State Control Press Enter to configure advanced items Hardware P States When this item is disabled the processor hardware chooses a P state based on OS Request Legacy P States In Native mode the proces...

Page 106: ...ress Enter to configure advanced items Package C State Configures the state for the C State package limit Options available C0 C1 state C2 state C6 non Retention state C6 Retention state No Limit Auto Default setting is Auto CPU Advanced PM Tuning Press Enter to configure advanced items Energy Perf BIAS Press Enter to configure advanced items Power Performance Tuning Options available OS Controls ...

Page 107: ...I functionality Then the RAID function is disabled and cannot be access the RAID setup utility at boot time RAID Mode When set to RAID the SATA controller enables both its RAID and AHCI functions You will be allowed to access the RAID setup utility at boot time Options available AHCI RAID Default setting is AHCI RAID Device ID Note Choose RAID Device ID Options available Client Alternate Server De...

Page 108: ...bles its AHCI functionality Then the RAID function is disabled and cannot be access the RAID setup utility at boot time RAID Mode When set to RAID the SATA controller enables both its RAID and AHCI functions You will be allowed to access the RAID setup utility at boot time Options available AHCI RAID Default setting is AHCI RAID Device ID Note Choose RAID Device ID Options available Client Alterna...

Page 109: ...on Active Video Selects the active video type Options available Auto Onboard Device PCIE Device Specific PCIE Device Default setting is Auto External SSC CK440 Enables Spread spectrum only affects external clock generator Options available SSC Off SSC 0 3 SSC 0 5 Hardware Default setting is SSC Off ...

Page 110: ...on Oper Firmware Version Displays the operational firmware version ME Firmware Status 1 2 Displays ME Firmware status information Current State Displays ME Firmware current status information Error Code Displays ME Firmware status error code Recovery Cause Displays ME Firmware recovery cause ...

Page 111: ... setting is Disable Whea Settings Press Enter to configure advanced items WHEA Windows Hardware Error Architecture Support Enable Disable WHEA Support Options available Enable Disable Default setting is Enable Memory Error Enabling Press Enter to configure advanced items Memory Corrected Error Enable Disable Memory Corrected Error Options available Enable Disable Default setting is Enable Uncorrec...

Page 112: ...e Enables and escalates Fatal Errors to error pins Options available Enable Disable Default setting is Enable Assert NMI on SERR Note Enable Disable BIOS generates a non maskable interrupt NMI and logs an error when a system error SERR occurs Options available Enabled Disabled Default setting is Enabled Assert NMI on PERR Note Enable Disable BIOS generates a non maskable interrupt NMI and logs an ...

Page 113: ...p the clock speed of 1 2 of its processing cores to improve its performance When this item is disabled the processor will not overclock any of its core Options available Enable Disable Default setting is Enable CPU C6 report Enable Disable the BIOS to enable the report from the CPU C6 state ACPI C3 to the OS Options available Disable Enable Auto Default setting is Auto Enhanced Halt State C1E Enab...

Page 114: ...ilable Enable Disable Default setting is Enable Adjacent Cache Prefetch Options available Enable Disable Default setting is Enable DCU Streamer Prefetcher Options available Enable Disable Default setting is Enable Intel VT for Directed I O Enable Disable the Intel VT for Directed I O VT d support function by reporting the I O device assignment to VMM through DMAR ACPI Tables Options available Enab...

Page 115: ...og Timer Enable Disable OS Watchdog Timer function Options available Enabled Disabled Default setting is Disabled OS Wtd Timer Timeout Note2 Configures OS Watchdog Timer The value is between 1 to 30 minutes Default setting is 10 minutes OS Wtd Timer Policy Note2 Configure OS Watchdog Timer Policy Options available Reset Do Nothing Power Down Power Cycle Default setting is Reset Wait BMC Ready POST...

Page 116: ...re advanced items View FRU Information Press Enter to view the FRU information BMC VLAN Configuration Press Enter to configure advanced items BMC network Configuration Press Enter to configure advanced items IPv6 BMC Network Configuration Press Enter to configure advanced items ...

Page 117: ...oose options for erasing SEL Options available No Yes On next reset Yes On every reset Default setting is No When SEL is Full Choose options for reactions to a full SEL Options available Do Nothing Erase Immediately Delete Oldest Record Default setting is Do Nothing Custom EFI Logging Options Log EFI Status Codes Enable Disable the logging of EFI Status Codes if not already converted to legacy Opt...

Page 118: ...U Information The FRU page is a simple display page for basic system ID information as well as System product information Items on this window are non configurable Note The model name will vary depends on the product you purchased ...

Page 119: ...uration BMC VLAN ID Select to configure BMC VLAN ID The valid range is from 0 to 4094 When set to 0 BMC VLAN ID will be disabled BMC VLAN Priority Select to configure BMC VLAN Priority The valid range is from 0 to 7 When BMC VLAN ID is set to 0 BMC VLAN Priority will not be selected ...

Page 120: ...dynamically DHCP Options available Unspecified Static DynamicBmcDhcp Default setting is DynamicBmcDhcp Station IP address Displays IP Address information Subnet mask Displays Subnet Mask information Please note that the IP address must be in three digitals for example 192 168 000 001 Router IP address Displays the Router IP Address information Station MAC address Displays the MAC Address informati...

Page 121: ... network during BIOS phase Options available Unspecified Disable Enable Default setting is Enable IPv6 BMC Lan IP Address Source Selects to configure LAN channel parameters statically or dynamically by BIOS or BMC Options available Unspecified Static Dynamic Obtained by BMC running DHCP Default setting is Dynamic Obtained by BMC running DHCP IPv6 BMC Lan IP Address Prefix Length Check if the IPv6 ...

Page 122: ...all settings in the Setup Utility User Password Entering this password will restrict a user s access to the Setup menus To enable or disable this field a Administrator Password must first be set A user can only access and modify the System Time System Date and Set User Password fields Parameter Description Administrator Password Press Enter to configure the administrator password User Password Pre...

Page 123: ... the applications that are running during the booting process to be pre signed with valid digital certificates This way the system knows all files being loaded before Windows loads to the login screen have not been tampered with When set to Standard it will automatically load the Secure Boot keys form the BIOS databases When set to Custom you can customize the Secure Boot settings and manually loa...

Page 124: ...t of Secure Boot variables to files in a root folder on a file system device Secure Boot variable Displays the current status of the variables used for secure boot Platform Key PK Displays the current status of the Platform Key PK Press Enter to configure a new PK Options available Update Key Exchange Keys KEK Displays the current status of the Key Exchange Key Database KEK Press Enter to configur...

Page 125: ...tabase Press Enter to configure a new DBT or load additional DBT from storage devices Options available Update Append OsRecovery Signatures Displays the current status of the OsRecovery Signature Database Press Enter to configure a new OsRecovery Signature or load additional OsRecovery Signature from storage devices Options available Update Append ...

Page 126: ... the desired values Bootup NumLock State Enable Disable the Bootup NumLock function Options available On Off Default setting is On Quiet Boot Enable Disable showing the logo during POST Options available Enabled Disabled Default setting is Enabled Endless Retry Boot Options available Disable Enable Default setting is Disable Setup Flash Press Enter to run setup flash Dump full Setup Data Press Ent...

Page 127: ... the boot order priority By default the server searches for boot devices in the following sequence 1 Hard drive 2 CD COM DVD drive 3 USB device 4 Network 5 UEFI UEFI Network Drive BBS Priorities Press Enter to configure the boot priority UEFI Application Boot Priorities Press Enter to configure the boot priority ...

Page 128: ...card changes and exit Discards changes made and exits the BIOS setup Options available Yes No Save Changes and Reset Restarts the system after saving the changes made Options available Yes No Discard Changes and Reset Restarts the system without saving any changes Options available Yes No Save Changes Saves changes done so far to any of the setup options Options available Yes No Discard Changes Di...

Page 129: ...ese settings the system might not function properly Options available Yes No Save the User Default Values Saves the changes made as the user default settings Options available Yes No Restore the User Default Values Loads the user default settings for all BIOS setup parameters Options available Yes No Boot Device Priority Press Enter to configure the device as the boot up drive Launch EFI Shell Att...

Page 130: ... corrupt the boot block can be used to restore the BIOS to a working state To restore your BIOS please follow the instructions listed below Recovery Instruction 1 Copy the XXX rom to USB diskette 2 Setting BIOS Recovery jump to enabled status 3 Boot into BIOS recovery 4 Run Proceed with flash update 5 BIOS updated ...

Page 131: ... Recovery failed 4 S3 Resume failed 7 Reset PPI is not available of Beeps Description 1 Invalid password 4 Some of the Architectural Protocols are not available 5 No Console Output Devices are found 5 No Console Input Devices are found 6 Flash update is failed 7 Reset protocol is not available 8 Platform PCI resource requirements cannot be met 5 9 BIOS POST Beep code AMI standard 5 9 1 PEI Beep Co...

Reviews:

No comments

Related manuals for R283-S90-AAE1

Netfinity 6000R

Brand: IBM Pages: 218

eserver xSeries 440

Brand: IBM Pages: 74

eserver xSeries 440

Brand: IBM Pages: 98

eserver xSeries 440

Brand: IBM Pages: 84

Eserver xSeries 360 Type 8686

Brand: IBM Pages: 184

eserver xSeries 350

Brand: IBM Pages: 62

eServer xSeries 135

Brand: IBM Pages: 62

eserver pSeries 690

Brand: IBM Pages: 212

System x3690 X5

Brand: IBM Pages: 32

System x3690 X5

Brand: IBM Pages: 33

System x3690 X5

Brand: IBM Pages: 180

Brand: IBM Pages: 1032

Brand: 3onedata Pages: 4

Brand: Omega Pages: 49

Brand: Iwatsu Pages: 338

SAT-IP EXIP 418

Brand: Kathrein Pages: 16

301P - DP Print Server

Brand: D-Link Pages: 150

Brand: Zycoo Pages: 36

Brands by name

0 1 2 3 4 5 6 7 8 9 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Popular brands

Load more brands