Fujitsu PRIMERGY BX300 Operating Manual Download | Manualshive

Page: 1 / 163

background image

PRIMERGY

PRIMERGY BX300
Blade Server System

Operating Manual

Xenia Fierley / Martin Jung
Fujitsu Siemens Computers GmbH München
81730 Munich
e-mail: email: [email protected]
Tel.: (0 89) 610 01-157 / (0 89) 6 10 01-154
Fax: (++49) 700 / 372 00000
A26361-K863-Z102-8-7619
Sprachen: En

Edition April 2005

1
2
3
...
»

Summary of Contents for PRIMERGY BX300

Page 1: ... Operating Manual Xenia Fierley Martin Jung Fujitsu Siemens Computers GmbH München 81730 Munich e mail email manuals fujitsu siemens com Tel 089 61001 157 089 61001 154 Fax 49 700 372 00000 A26361 K863 Z102 8 7619 Sprachen En Edition April 2005 ...

Page 2: ...Department Certified documentation according DIN EN ISO 9001 2000 To ensure a consistently high quality standard and user friendliness this documentation was created to meet the regulations of a quality management system which complies with the requirements of the standard DIN EN ISO 9001 2000 cognitas Gesellschaft für Technik Dokumentation mbH www cognitas de Copyright and Trademarks Copyright 20...

Page 3: ...r System Installation Steps Important Notes Installing the Hardware Preparation for Use and Operation Blade Server System LAN Port Assignment Property and Data Protection The Server Blade The Switch Blade The Management Blade Continued ...

Page 4: ......

Page 5: ...The Power Supply Concept The Ventilation Concept Troubleshooting and Tips Related Publications and Index ...

Page 6: ......

Page 7: ...orting the Server 20 3 7 Environmental Protection 21 4 Installing the Hardware 23 4 1 Installation Steps 23 4 2 Unpacking the System 24 4 3 Installing the System Into the Rack 25 4 3 1 Mounting the Assembly Kit 28 4 3 2 Mounting Removing the System 30 4 4 Cabling the System 31 4 4 1 Connecting External Devices 31 4 4 2 Cable Routing 34 4 4 3 Instructions On Connecting and Disconnecting Cables 39 4...

Page 8: ... 1 BIOS Setup Security Functions 69 8 The Server Blade 71 8 1 Server Blade Pentium III 71 8 1 1 CPU 73 8 1 2 Memory 73 8 2 Server Blade Pentium M 74 8 2 1 CPU 75 8 2 2 Memory 75 8 3 Control and Connection Panel 76 8 4 PCI Modules 78 8 4 1 LAN PCI Module 79 8 4 2 FC PCI Module 80 8 5 Exchanging Adding Procedures 81 8 5 1 Installing SDRAM DDR RAM Modules 81 8 5 2 Installing an Additional Hard Disk D...

Page 9: ...odule 129 12 2 1 Replacing the Rear Fan Module 129 13 Troubleshooting and Tips 133 13 1 System beeps three times and stands still 133 13 2 System Power LED Remains Dark 134 13 3 Front or Rear Identify Fault LED Blinks Amber 134 13 4 System Switches Itself OFF 135 13 5 Screen Remains Dark 135 13 6 Flickering Stripes On the Monitor Screen 136 13 7 No Screen Display or Display Drifts 136 13 8 No Mous...

Page 10: ......

Page 11: ... Blade Server System offers a high level of reliability and availability through highly developed hardware and software components This includes hot swappable server blades switch blades management blades hot swappable power supply units and fan modules the server management software ServerView and RemoteDeploy Prefailure Detection and Analysing PDA and Automatic Server Reconfiguration and Restart...

Page 12: ...please refer to chapter 2 on page 11ff To understand the different expansion options you need a knowledge of hardware and data transmission as well as basic knowledge of the operating system used Other Components of the PRIMERGY BX300 Documentation set To the PRIMERGY BX300 documentation set belong the following manuals Safety manual print version delivered together with the system PDF version ava...

Page 13: ...h blade from the CPU server blade Two management blades with an integrated management solution for complete redundant remote administration of the system are also implemented Fault tolerance on a complete blade system level is also maintained by using two redundant hot swap power supply units PSU as well as hot swap redundant fans The server blade combines all the core components of a traditional ...

Page 14: ...t switch blades provides high speed LAN access via multiple Gigabit interfaces Each switch blade has ten downlink ports to the server blades and three uplink ports to layer 3 switches These LAN connections provide the only I O function ality for the server blade The two management blades have separate LAN connections for maintaining accessibility to the system even when the standard traffic networ...

Page 15: ...ond one ensures that operation continues unimpaired The defective power supply unit can be replaced during operation hot swap Ventilation The system is kept cool by three fans in each power supply unit and five fans in the front panel in a redundant and hot swappable configuration with the two rear fans Make sure that the system is always populated with two power supply units High Level of Availab...

Page 16: ...tions Remote startup Wake On LAN Temperature monitoring of the CPU and the surrounding area Watchdog timer for Automatic Server Reconfiguration and Restart ASR R in the event of failure of memory modules or processors Power monitoring End of life monitoring of the fans with timely notification before a failure Watchdog timer for operating system monitoring and application monitoring with ASR R Dep...

Page 17: ...OM ports ensure complete remote control Together they facilitate remote diagnosis for system analysis remote configuration and remote restart should the operating system or hardware fail 1 4 Notational Conventions The following notational conventions are used in this manual Italics indicate commands menu items or software programs Quotation marks indicate names of chapters and terms that should be...

Page 18: ...rent power 100 127 V 946 VA 200 240 V 1183 VA Thermal dissipation range 1100 kJh 1043 BTU 4450 kJh 4218 BTU Protection class I Product safety and ergonomics IEC 60950 EN 60950 UL 60950 3rd Ed CAN CSA C22 2 No 60950 3rd Ed Electromagnetic compatibility FCC class A Emitted interference EN 55022 class A Harmonic current EN 61000 3 2 Noise immunity EN 55024 CE label according to EU directives Low Volt...

Page 19: ...idth 435 mm Installation depth 740 mm Total depth with front panel 775 mm Height 130 mm or 3HU Environment class 3K2 Environment class 2K2 EN 60721 IEC 721 section 3 3 EN 60721 IEC 721 section 3 2 Temperature Operation 3K2 Transport 2K2 5 C 35 C 25 C 60 C Relative humidity 10 85 Sound power level LWAd ISO 7779 7 4 BA Sound pressure level at bystander position LpAm ISO 7779 56 6 dB A in the standar...

Page 20: ......

Page 21: ... also refer to the section Cable Routing on page 34 and the section Instructions On Connecting and Disconnecting Cables on page 39 Ê Connect the system to the line voltage see 4 5 on page 40 Ê Make yourself familiar with the operating and indicator elements on the front and on the rear side of the blade server system see chapter 5 beginning on page 41 Ê Install the desired operating systems and ap...

Page 22: ...ithout using ServerStart I For further information on remote or local installation of server blades please refer to the manual ServerView Suite ServerStart which contains a Quick Step Guide as well as detailed description of the different installation options and installation wizards A print version of the manual is included in the ServerView Suite bundle delivered with the blade server system A P...

Page 23: ...ons contact your sales outlet or the customer service centre of Fujitsu Siemens Computers V CAUTION The actions described in these instructions should only be performed by technical specialists Equipment repairs should only be performed by authorized qualified staff Any unauthorized openings and improper repairs could expose the user to risks electric shock energy hazards fire hazards and could al...

Page 24: ...ation that receives power from an industrial public power supply network with the IEC309 connector the public power supply protection must comply with the requirements for the non industrial public power supply networks for the type A connector The server automatically adjusts to a mains voltage between 100 V 127 V or 200 V 240 V The server may only be put in operation if the mains voltage range s...

Page 25: ...in place electric shock cooling fire protection interference suppression Install only system expansions that satisfy the requirements and rules governing safety and electromagnetic compatibility and relating to telecommunications terminal equipment If you install other expan sions you may damage the system or violate the safety regulations and regulations governing RFI suppression Information on w...

Page 26: ...ium battery on the corresponding components in accordance with the instructions in this manual All batteries containing pollutants are marked with a symbol a crossed out garbage can as well as the chemical symbol for the heavy metal which classifies it as a pollutant Cd Cadmium Hg Mercury Pb Lead Note about the laser The CD DVD drive is classified for laser class 1according to IEC 60825 1 V CAUTIO...

Page 27: ...in conditions sharp edged pieces of broken CDs DVDs can penetrate the cover of the drive damage to the device and be thrown out of the device danger of injury particularly on uncovered body parts such as the face or neck I You protect the CD DVD drive and prevent mechanical damage as well as premature wearing of the CDs DVDs by observing the following suggestions Only insert the CDs DVDs in the dr...

Page 28: ...f static charge Always hold components with ESDs by their edges Do not touch any exposed pins or conductors on a component Use a grounding cable designed for this purpose to connect yourself to the system unit as you install components Place all components on a static safe base I You will find a detailed description for handling ESD components in the relevant European or international standards EN...

Page 29: ...at inter ference will not occur in a particular installation If this equipment does cause harmful interference to radio or television reception which can be determined by turning the equipment off and on the user is encouraged to try to correct the interference by one or more of the following measures Reorient or relocate the receiving antenna Increase the separation between equipment and the rece...

Page 30: ...chapter Important notes in the technical manual for the corresponding rack The technical manual is supplied with the corresponding rack The power connection for the rack must be installed by an authorized technician electrician V CAUTION If the server is integrated in a rack installation that receives power from an industrial public power supply network with the IEC309 connector the public power s...

Page 31: ...ve to be on permanently should not be switched on until they need to be used and should be switched off during long breaks and on completion of work Notes On Packaging Please do not throw away the packaging We recommend that you keep the original packaging in case you need it later for transporting your system unit If possible devices should be transported in their original packaging Notes On Deal...

Page 32: ...ing and Disposal For details on take back and reuse of devices and consumables within Europe contact your Fujitsu Siemens Computers branch office subsidiary or our recycling center in Paderborn Fujitsu Siemens Computers Recycling Center D 33106 Paderborn Tel 49 5251 8 18010 Fax 49 5251 8 18015 ...

Page 33: ...4 1 Installation Steps The installation steps are described in detail in the following sections of this chapter Unpacking the system 4 2 on page 24 Mounting the system into the rack see 4 3 on page 25 and also the layout arrangement on the order lists Cabling the system see 4 4 on page 31 Please also refer to the section Cable Routing on page 34 and the section Instructions On Connecting and Disco...

Page 34: ...the front panel It is recommended that you do not throw away the original packaging material It may be required for future transportation Ê Unpack all the individual parts Ê Check the contents of the package for visible transport damage Ê Check whether the delivery agrees with the details in the delivery note The identification rating plate is located on the rear left side of the system If you fin...

Page 35: ...taCenter Rack support fully the installation of the PRIMERGY server systems The installation into the at present usual rack systems of different foreign manufacturers 3rd Party Rack is supported to large part To accommodate the ventilation concept and ensure proper ventilation of the components in the rack any unused areas must be closed using dummy covers The power is supplied via the socket stri...

Page 36: ...ke in the rack front and air discharge in the rear cover of the rack are necessary In principle the ventilation concept plans that the necessary cooling is reached by the horizontal self ventilation of the installed devices air flow from the front to the rear Power supply For the installation in 3rd Party Racks it is to be made certain that appro priate socket strips are present 1 rack front side ...

Page 37: ...A26361 K863 Z102 8 7619 Rev 8 0 27 Installing the Hardware Installing the System Into the Rack Figure 3 Mechanical conditions ...

Page 38: ...3rd Party Rack only I General information are provided in the Technical Manual for the corre sponding Rack see also Related Publications on page 141 For mounting the system into the rack a support bracket must be first mounted on the rear left support upright of the rack This bracket must be mounted level with the lower edge of the device The bracket is used for the rear fixing of the left carrier...

Page 39: ...cket 1 Ê Place two plugwashers see figure 6 on page 29 in the holes of the front left support upright at the marked attachment points and while holding the rail in place fasten it with two screws 2 Ê Place two plugwashers see figure 6 on page 29 in the holes of the support bracket at the marked attachment points and fasten it with two screws 3 Figure 6 Mounting the plugwashers into the support bra...

Page 40: ...unting Removing the System V CAUTION For safety reasons at least two people are required to mount or remove the server because of its weight and size Figure 7 Mounting the system Ê Lift the system onto the two carrier rails V CAUTION Never lift the server into the rack using the handles on the front panel Ê Slide the system into the rack 1 Ê Secure the system in the rack using the two knurled scre...

Page 41: ...agement Blade section Control and Connection Panel on page 112 Ê Connect the LAN cables according to the desired system configuration see chapter Blade Server System LAN Port Assignment on page 63 4 4 1 Connecting External Devices The ports for connecting external devices are located on front of the Blade Server System via each server blade port marked with 1 in figure 8 on page 32 on front of the...

Page 42: ...32 Rev 8 0 A26361 K863 Z102 8 7619 Cabling the System Installing the Hardware Some ports are indicated by color coding for the connectors Figure 8 Connectors for external devices ...

Page 43: ...n page 80 4 PS2 keyboard connector purple 5 PS2 mouse connector green 6 Serial port connector on management blade 2 see also figure 72 on page 112 Standard serial port management communication port 7 LAN connector on management blade 2 see also figure 72 on page 112 LAN port RJ45 10Mb management LAN 8 Serial port connector on management blade 1 see also figure 72 on page 112 Standard serial port m...

Page 44: ...s case a cable support figure 9 position 1 a b c d must be mounted at first on the front of the server Additionally a cover with passage opening 2 and a cable guide 3 must be mounted in the expansion area of the rack Figure 9 Components for cable routing from the front side 1 cable support two brackets a b support c cable tie d 2 cover with passage opening 3 cable guide with cable clips ...

Page 45: ... the associated openings of the vertical support 1 in the expansion area of the rack I Note that the cable guide must be placed level with the upper edge of the support bracket Ê Place two plugwashers see also figure 6 on page 29 in the holes of the rear left support upright into the associated openings 2 and while holding the guide in place fasten it with two screws 3 I If two PRIMERGY BX300 are ...

Page 46: ...1 Mounting cable support Ê Hang up the left support bracket see 1a figure 9 on the associated two knurled screws of the front panel 1 2 Ê Repeat the procedure with the right bracket see 1b figure 9 Ê Hang up the cable support see 1c figure 9 in the associated openings of the brackets 3 4 ...

Page 47: ...A26361 K863 Z102 8 7619 Rev 8 0 37 Installing the Hardware Cabling the System Figure 12 Cable routing ...

Page 48: ...h the cable aperture in the vertical cover 2 and through the cable clips on the cable guide 3 up to the loom of cables in the rack I If two PRIMERGY BX300 are installed directly on top of each other or in the top location of the rack the cable clips on the cable guide must be removed from space reasons Ê Route the cables in the loom of cables to the corresponding devices and connect it V CAUTION P...

Page 49: ...lug Connect and disconnect the cables in the order described below Connecting Cables Ê Plug all cables into the system and peripherals Secure the data trans mission cable connections e g nut retention Ê Plug all data communication cables into the utility sockets Ê Plug all power cables into the grounded power sockets Disconnecting Cables Ê Unplug all data communication cables from the utility sock...

Page 50: ...ltage range Figure 13 Connecting the system to the line voltage Ê Connect first the insulated connector of the power cables to the power supply units of the system 1 and the power plug 2 into the mains socket strip of the rack see technical manual of the rack V CAUTION Connect first always the power cable to the power supply units and after it to the mains I Phase redundancy in the power supply of...

Page 51: ...nstructions in the chapter Important Notes on page 13 All unoccupied component slots are fitted with corresponding dummy modules to ensure that the electromagnetic emission properties of the system are observed and that the system components are cooled properly Figure 14 PRIMERGY BX300 Blade Server System ...

Page 52: ...wer button for 10 seconds will switch OFF the system 2 Power indicator green LED dark System is switched OFF no 5 V stand by power present lights green System is switched ON 5 V stand by power present 3 Front identify button with integrated front identify fault indicator Pressing this button lights up the integrated front identify indicator The front and rear identify indicators will be synchroniz...

Page 53: ...cator The front and rear identify indicator will be synchronized 2 Rear identify Fault indicator amber LED dark The system operates normally and has not been selected for identification or remote administration lights amber This system has been selected for identification identify LED is lit by pressing the front or rear identify button Press either of the identify buttons again to unmark the syst...

Page 54: ...cessary switch ON the needed server blades see Switching ON OFF the Server Blades on page 45 The system is switched ON and the switched ON server blades perform a system test and boot the operating system Switching OFF the System system is powered ON The system is operating server blades are also switched ON Ê For gracefully shut down the server blades press the system power ON OFF button position...

Page 55: ...er blade press the power button of the server blade position 1 on figure 37 on page 76 for 4 seconds If the ServerView agents are installed a gracefull shutdown is initiated For hard shutdown press the power button for 10 seconds Specified switch ON time switch OFF time The server blade is switched ON or OFF at a time specified in the ServerView program The switch ON switch OFF times also can be s...

Page 56: ...tial configuration of the management blade To configure the management blade follow the steps listed below Pre Configuration Requirements The procedures that follow assume that the blade server is connected to the power line Cabling the System Ê Connect the serial port of the client COM1 to the serial port of the master management blade using a RS232 cable null modem cable I The master management ...

Page 57: ...ome screen Ê Log in as root The default password reads root V CAUTION Change the default root password as soon as possible Failure to do so may result in unauthorized access and loss of data I You can change the root password of the management blade by selecting 6 Username and Password in the Management Agent menu see figure 19 on page 48 When you have logged on the main menu of the console menu w...

Page 58: ...Operation Ê Enter 1 to call up the Management Agent menu The Management Agent menu looks like this Figure 19 Management Agent menu Ê Enter 1 to call up the Management Agent Information menu The Management Agent Information menu provides access to the parameters required by the LAN connection ...

Page 59: ...enu Follow the steps below to make the management blade accessible via the LAN Ê Select 1 to set the default IP address of the management blade to the IP address used for it in your LAN Ê Select 2 to enter the network mask of your subnet Ê Select 3 to enter the IP address of your gateway Ê Select 18 to call up the Agent NIC Duplex Mode menu ...

Page 60: ...troller Ê Enter 0 in this menu and in the preceding menus to leave the management blade console menu Ê Close the HyperTerminal session Ê Unplug the power cable from the blade server and plug it in again to reboot the management blade I This makes sure that the management blade keeps the master role after reboot A reboot without disconnecting the power cable would cause a change of roles The manage...

Page 61: ...and BMC firmware using an USB floppy disk drive see 5 4 1 1 using an TFTP see 5 4 1 2 5 4 1 1 Using an USB Floppy Disk Drive Proceed as follows Ê Download the file BX300_BIOS_ version _ processor type EXE BIOS and BMC update FD and execute it to create a bootable floppy disk Ê Connect the breakout cable Y cable to the front panel of the desired server blade Connect the USB floppy disk drive to the...

Page 62: ... Ê Check the LAN connection by pinging the desired server blade Ê Update the server blade firmware BIOS and BMC There are two ways of doing so 1 In the management console Telnet choose the TFTP Update submenu The update process takes place similarly to the process via management blade WebUI see below 2 In the management blade WebUI choose System Property Environ Maintenance Firmware Update Server ...

Page 63: ... Name for the server blade image file Ê Use the Add and Delete buttons to add server blades to or to remove them from the job list Ê Click the Apply button The update file is sent to all selected server blades and the update process is started A status screen informs you about the update progress Ê After the update process has been completed the server blade s will be rebooted Ê Repeat the procedu...

Page 64: ...54 Rev 8 0 A26361 K863 Z102 8 7619 Server Blade BIOS BMC Updating BX300 Components Figure 23 Server blade BMC update via WebUI ...

Page 65: ...the TFTP file system root directory For information on image file names see the readme file of the TFTP update package Ê Check the LAN connection by pinging the desired management blade Ê Update the management blade firmware There are two ways of doing so 1 In the management console Telnet choose the TFTP Update submenu The update process takes place similarly to the process via management blade W...

Page 66: ...nagement blades are connected to the LAN Ê Specify the TFTP Server IP Address providing the image file for the management blade firmware Ê Specify an Agent Update IP Address I The IP address to be supplied in the field Agent Update IP Address is only temporarily used Enter any IP address which is not used in the LAN segment of the server Ê Enter the Boot Image File Name for the management blade im...

Page 67: ...Console Redirection 4 TFTP update 5 Logout 6 Reboot Management Blade 7 System Information Dump Enter Selection 3 Ê Select Console Redirection Console Redirection Table page_3 1 Console Redirect Server Blade 2 Console Redirect Switch Blade 3 Set Return Hotkey Ctrl a character 0 Enter selection or type 0 to quit 2 Ê From the Console Redirection Table choose Console Redirect Switch Blade Console Redi...

Page 68: ... netmask 10 50 50 51 255 0 0 0 on VLAN 1 and address mode User specified Ê Enter the commands above I Please mind that the entries for IP address and subnetmask are merely examples and probably will differ from your system Ê Press CTRL Q to return to the console menu Ê You may check the newly established LAN connection by pinging the switch blade on the client machine Ê Install and run your TFTP s...

Page 69: ...hoose Flash File I On the switch blade only two operation code image files can be stored If there are stored already two image files you have to remove at least one of them before updating the firmware It is recommended to remove the older file i e the file with the lower number Ê Expand the File Name list red arrow in the Remove Operation Code Image File section to check if there are already stor...

Page 70: ...x and Destination File Name Figure 26 Transfer the new Operation Code Image File Ê Click Transfer from Server Ê Wait for a few minutes for completing the update process Refresh the browser for viewing Ê Select the new image file in the popup window red arrow and click Apply Changes Figure 27 Select Start up Operation Code Image File ...

Page 71: ...mware Ê Choose Reset from the navigation bar I After resetting the switch blade will reboot However all settings specified before IP address etc will be lost and must be reentered on the management console Ê Repeat the firmware updating procedure for each installed switch blade ...

Page 72: ......

Page 73: ...61 K863 Z102 8 7619 Rev 8 0 63 6 Blade Server System LAN Port Assignment 6 1 One LAN Switch Blade 10 Server Blades V CAUTION No redundancy Figure 28 Configuration with one switch blade and 10 server blades ...

Page 74: ...6 and chapter The Switch Blade on page 103 6 2 Two Redundant LAN Switch Blades 10 Server Blades Figure 29 Configuration with two switch blades slot 3 redundant and 10 server blades I In this configuration the data traffic into and out of the server blades is transmitted via the LAN channel A switch blade in slot 1 and or the LAN channel B switch blade in slot 3 Refer also to the table 2 on page 66...

Page 75: ...ation with four switch blades and 20 server blades I In this configuration the data traffic into and out of the server blades is transmitted on the LAN channel A switch blade in slot 1 or slot 2 corre sponding to the server blade slot and or on the LAN channel B switch blade in slot 3 or 4 corresponding to the server blade slot Refer also to the table 2 on page 66 ...

Page 76: ...itch Blade slot channel 1 2 3 4 1 CH A X CH B X 2 CH A X CH B X 3 CH A X CH B X 4 CH A X CH B X 5 CH A X CH B X 6 CH A X CH B X 7 CH A X CH B X 8 CH A X CH B X 9 CH A X CH B X 10 CH A X CH B X 11 CH A X CH B X 12 CH A X CH B X 13 CH A X CH B X Table 2 Server blade Switch blade LAN mapping ...

Page 77: ...do not transfer data via switch blades and are intended for using PCI 33 MHz or 66 MHz or PCI X low profile or non standard expander controller cards for configurations with external devices 14 CH A X CH B X 15 CH A X CH B X 16 CH A X CH B X 17 CH A X CH B X 18 CH A X CH B X 19 CH A X CH B X 20 CH A X CH B X Server Blade Switch Blade slot channel 1 2 3 4 Table 2 Server blade Switch blade LAN mappi...

Page 78: ......

Page 79: ... an optimum protection for the system can be achieved I A detailed description of the Security menu and how to assign passwords can be found in the manual for the BIOS Setup and on the ServerBooks CD see also Related Publications on page 141 Preventing Unauthorized BIOS Setup Calls This protection mechanism can be activated by setting a supervisor password in the Security menu In addition the Pres...

Page 80: ......

Page 81: ...ehind the front panel figure 31 Figure 31 PRIMERGY BX300 Blade Server System with removed front panel 8 1 Server Blade Pentium III The server blade Pentium III includes figure 33 Mono or dual processor support Two DIMM sockets for maximum 2 GB PC133 SDRAMs Two integrated Ethernet controllers On board IDE RAID controller Two locations for 2 5 inch IDE hard disk drives On board graphics controller A...

Page 82: ...t be entered after installation the first time you start the operating system You find this license number on the COA label on the rear of the server blade Ê Note the license number for further use Figure 33 Server blade Pentium III I The SDRAM modules and hard disk drives must be installed on the server blades before these will be inserted in the corresponding locations slots COA label ...

Page 83: ...III 933 MHZ or 1 GHz processors All CPUs are equipped with 512 kB second level cache SLC The mono CPU server blade cannot be upgraded to a dual CPU server blade 8 1 2 Memory On the server blade Pentium III there are two 168 pin dual inline memory module DIMM sockets These can be populated with 256 MB 512 MB or 1 GB PC133 SDRAM modules figure 34 The maximum memory expansion is 2 GB It is possible t...

Page 84: ...rd disk drives On board graphics controller ATI Rage XL 4MB Special connector for 2xUSB and VGA port special cable required see figure 38 on page 78 Connector for expanding with a PCI module see section PCI Modules on page 78 Figure 35 Server blade Pentium M COA label I In any case of Windows operating systems the license number must be entered after installation the first time you start the opera...

Page 85: ...wo slots in the server system I A server blade expanded with a PCI module cannot be installed in the slot numbers 10 and 20 8 2 1 CPU The mono CPU server blade Pentium M is equipped with one Intel Pentium M standard processor The processors are automatically sensed by VRM Voltage Regulator Module without hardware change All CPUs are equipped with 1 MB second level cache SLC on chip 8 2 2 Memory On...

Page 86: ...d Configuration Power Interface ACPI When the server blade is switched OFF and you press the power button a power_up command is send to the management blade and the server blade will be switched ON When the power button is kept pressed for 4 seconds the server blade will be switched OFF and a power_off notification command will be send to the management blade power button override 2 Power Select i...

Page 87: ... this server blade lights green KVM is selected ON from this server blade blinks amber KVM is not selected OFF from this server blade and this server blade is disabled due to power budget blinks green amber KVM is selected ON from this server blade and this server blade is disabled due to power budget 4 KVM keyboard video mouse button Pressing the KVM button switches the KVM to this server blade 5...

Page 88: ...CI module are intended to be used in the server blade Pentium M with addition of PCI 33 MHz or 66 MHz or PCI X low profile expander controller card The PCI module will be attached to the server blade Pentium M via a connector and fixed to with seven screws Two PCI module types are available LAN PCI module FC PCI module You find further details for adding a PCI module to the server blade Pentium M ...

Page 89: ... or two RJ 45 10 100 1000 Mbps base T Ethernet LAN ports Figure 39 LAN PCI module Connectors LAN 1 LAN2 connector is available and can be accessed from the front of the system below the front panel figure 40 Figure 40 LAN PCI module connector I The inscription link a on the PCI module shows the affiliation to the appropriate server blade ...

Page 90: ... card with one or two fibre channel FC ports Figure 41 FC PCI module Connectors FC1 FC2 connector is available and can be accessed from the front of the system below the front panel figure 42 Figure 42 FC PCI module connector I The inscription link a on the PCI module shows the affiliation to the appropriate server blade ...

Page 91: ...on page 18 The SDRAM DDR RAM modules are equipped with coded connectors so that they cannot be installed incorrectly V CAUTION Use extreme care when removing an SDRAM DDR RAM module Apply only enough pressure on the ejector levers to release the SDRAM module Ê Remove the server blade from the system see Removing the Server Blade on page 101 Ê Remove the SDRAM DDR RAM module from its antistatic pac...

Page 92: ...arrows 1 to disengage the locking mechanism of the SDRAM socket Ê Position the SDRAM module so that the two notches on the bottom edge align with the socket on the server blade 2 Ê Insert the SDRAM module into the socket and press firmly in the direction of the arrow 3 until it is seated correctly Ê Secure the SDRAM module by carefully pushing the two levers a into the locking position 4 ...

Page 93: ...s to release the SDRAM module 8 5 2 Installing an Additional Hard Disk Drive Each server blade can accommodate two 2 5 inch IDE hard disk drives HDD The hard disk drives are controlled by the on board IDE RAID controller Usually two disks are mirrored in a RAID 1 configuration V CAUTION Observe the safety information and the information on handling electro static sensitive components in the sectio...

Page 94: ... Procedures The Server Blade I No jumper settings on the hard disk drive are necessary Figure 45 Mounting the IDE interface adapter Ê Align the IDE interface adapter on the marked side 1 and press it in the direction of the arrow on the HDD IDE connector ...

Page 95: ...server blade so that the IDE interface adapter snaps into the corresponding IDE interface connector 1 on the server blade Figure 47 Installing the hard disk drive Ê Fasten the HDD on the server blade with three screws Ê Insert the server blade into the slot in the system see figure 63 in the section Inserting the Server Blade on page 99 The hard disk drives are removed in reverse order ...

Page 96: ...t in the system see section Removing the Server Blade on page 101 Figure 48 Removing the hard disk drive Ê Unscrew the three mounting screws and remove the HDD from the server blade Figure 49 Removing the hard disk drive Ê Remove the IDE interface adapter 1 unscrew the two screws on each side 2 and remove the hard disk drive from the mounting bracket 3 ...

Page 97: ...onding error message is provided The lithium battery must then be replaced V CAUTION Observe the safety information and the information on handling electro static sensitive components in the section Components With Electro static Sensitive Devices on page 18 V CAUTION Observe the information on handling batteries in the section Batteries on page 16 Incorrect replacement of batteries may lead to a ...

Page 98: ...press in the direction of the arrow 4 until it clicks into place 8 5 5 Adding PCI Module to the Server Blade Pentium M V CAUTION Observe the safety information and the information on handling electro static sensitive components in the section Components With Electro static Sensitive Devices on page 18 Server blades can be extremely sensitive to electrostatic discharge and must always be handled ca...

Page 99: ...n the connector a on the server blade Remove it before mounting the PCI module I In any case of Windows operating systems the license number must be entered after installation the first time you start the operating system You find this license number on the COA label on the rear of the server blade see figure 35 on page 74 Ê Note the license number for further use before mounting the PCI module Ê ...

Page 100: ...ver Blade Figure 52 Attaching PCI module Ê Press the PCI module in the direction of the arrows 1 on the server blade Ê Unscrew the mounting screw 2 and remove the connector cover 3 Ê Remove the air duct 4 Figure 53 Fastening PCI module Ê Fix the PCI module with six screws ...

Page 101: ...cards can be extremely sensitive to electrostatic discharge and must always be handled carefully Do not slide it over any surface I Attaching the controller card occurs in the same way Only attaching the connectors is different The following figures show the procedure for attaching the PCI FC controller card only PCI FC Controller Card I The connectors cover and air duct must be removed see step 2...

Page 102: ...2 8 7619 Exchanging Adding Procedures The Server Blade Figure 55 Mounting PCI FC controller card Ê Insert the controller card in the PCI slot until it engage in place 1 2 Ê Engage the locking mechanism for the controller card 3 ...

Page 103: ... card Ê Remove the protective cape from the FC connector on the controller card and from the FC connector on the FC PCI module Ê Connect the fibre cable to the controller Ê Re mount the connector cover and air duct see figure 57 on page 93 Figure 57 Module with PCI FC controller card Removing occurs in the reverse order ...

Page 104: ... be removed see step 2 and 4 on figure 52 on page 90 Ê Mount the PCI Ethernet controller card as described in section PCI FC Controller Card on page 91 Figure 58 Connecting PCI Ethernet controller card Ê Connect the LAN 1 cable to the controller I Pay attention to the cable label a Ê Re mount the connector cover and air duct see figure 59 on page 95 ...

Page 105: ...the desired configuration the system can be upgraded with up to 20 CPU server blades Pentium III mono or dual or Pentium M V CAUTION Observe the safety information and the information on handling electro static sensitive components in the section Components With Electro static Sensitive Devices on page 18 I Before removing or installing server blades or the corresponding dummy modules in any case ...

Page 106: ...Module All unoccupied slots in the Blade Server System are fitted with dummy modules to ensure that the electromagnetic emission properties of the system are observed and that the system components are properly cooled If you wish to add a server blade you must first remove the dummy module from the corresponding slot Figure 60 Releasing the locking mechanism a green touch point Ê Release the locki...

Page 107: ...K863 Z102 8 7619 Rev 8 0 97 The Server Blade Adding Removing a Server Blade to from the System Figure 61 Ejecting the dummy module a green touch point Ê Eject the dummy module by pulling the ejecting handle a ...

Page 108: ...t V CAUTION Keep the dummy module for future use If the server blade is removed and not replaced with a new server blade then the dummy module must be reinstalled for cooling to comply with the applicable EMC regulations regulations on electromagnetic compatibility and for fire protection Installation occurs in the same way with the server blade see Inserting the Server Blade on page 99 ...

Page 109: ... be extremely sensitive to electrostatic discharge and must always be handled carefully After removing the server blade from its antistatic package place it with the component side up on a non conductive antistatic surface Do not slide the server blade over any surface Ê Remove the server blade from its antistatic package Figure 63 Inserting the server blade a green touch points Ê Press the button...

Page 110: ... K863 Z102 8 7619 Adding Removing a Server Blade to from the System The Server Blade Figure 64 Engaging of the locking mechanism Ê Swing up the eject handle until the locking mechanism the server blade engages completely ...

Page 111: ...ke sure that the dummy module engages in the slot correctly 8 6 2 Server Blade Pentium M with attached PCI Module Depending on the desired configuration a maximum of 10 server blades Pentium M with attached PCI module can be installed in the Blade Server System One server blades Pentium M with attached PCI module occupies two slots on the front side of the server system V CAUTION Observe the safet...

Page 112: ...x 1 minute Ê Remove the dummy modules from the two desired slots see section Removing the Dummy Module on page 96 Ê Insert the expanded server blade Pentium M into the two slots as described in section Inserting the Server Blade on page 99 Ê Attach the cable support route and connect the cables to the corresponding PCI modules see section Cable Routing on the Front side on page 34 For removing pro...

Page 113: ...h Blade User Interface Description Figure 65 Switch blade The basic configuration includes one switch blade slot 1 Depending on the desired configuration the system can be upgraded with up to three additional switch blades The slots for these blades are numbered from 1 to 4 and are located on the rear side of the server system underneath the rear fan module see figure 66 on page 104 A maximum of 1...

Page 114: ...used and a third or forth switch blade must be installed in these slots For corresponding server blade switch blade LAN mapping see table 2 on page 66 Figure 66 Switch blade locations 9 1 Control and Connection Panel The connection panel of the switch blade can be accessed from the rear of the system under the rear fan module figure 67 Figure 67 Switch Blade control and connection panel ...

Page 115: ... 3x uplink LAN connector with two integrated LAN status LEDs each see next positions 3 and 4 3 Speed indicator bicolor LED dark The LAN port is operating at 10 Mb lights green The LAN port is operating at 100 Mb lights amber The LAN port is operating at 1000 Mb System fault indication all speed indicators flash amber simulta neously There is a fault on the switch 4 LAN link activity indicator gree...

Page 116: ...tro static Sensitive Devices on page 18 V Before removing or installing switch blades or the corresponding dummy modules the rear fan module must be removed see section Replacing the Rear Fan Module on page 129 Removing the Dummy Module All unoccupied slots in the Blade Server System are fitted with dummy modules to ensure that the electromagnetic emission properties of the system are observed and...

Page 117: ...3 Z102 8 7619 Rev 8 0 107 The Switch Blade Installing a Switch Blade Figure 68 Removing the dummy module a green touch point Ê Swing down 1 the handle a until the locking mechanism of the dummy module disengages ...

Page 118: ...ule Installation occurs in the same way with the switch blade see Inserting the Switch Blade on page 108 Inserting the Switch Blade V CAUTION Observe the safety information and the information on handling electro static sensitive components in the section Components With Electro static Sensitive Devices on page 18 Ê Remove the switch blade from its package Figure 69 Inserting the switch blade Ê Pu...

Page 119: ...see Removing the Dummy Module on page 106 V CAUTION Observe the safety information and the information on handling electro static sensitive components in the section Components With Electro static Sensitive Devices on page 18 If you remove the switch blade and do not replace it with a new one you must insert a dummy module into the empty slot for insure cooling to comply with the applicable EMC re...

Page 120: ......

Page 121: ...interface is available as well as a console menu interface using the Telnet protocol For a detailed description please refer to the manual RemoteView Management Blade User Interface Description The management blades have separate 10 Mb LAN connections to maintain accessibility to the system even with the standard traffic network connections down The slots for the management blades are located on t...

Page 122: ...owing indicator and connection elements are available 1 Serial port connector Standard serial port management communication port 2 LAN connector with two integrated LAN status LEDs see next positions 3 and 4 LAN port RJ45 10Mb management LAN 3 LAN active indicator green LED dark System is switched OFF no 5 V stand by power present The LAN is not active blinks green The LAN is active ...

Page 123: ...omputers service applications 6 Failure indicator amber LED dark This management blade is o k lights amber If only one management blade is present this blade has failed blinks amber If two management blades are present this blade has failed 7 Master indicator green LED dark This management blade is a slave stand by backup of master management blade lights green This management blade is the master ...

Page 124: ...attery must then be replaced V CAUTION Observe the safety information and the information on handling batteries in the section Batteries on page 16 Incorrect replacement of batteries may lead to a risk of explosion The battery may only be replaced with an identical battery or with a type recommended by the manufacturer Make sure you insert the battery the right way round The plus pole must be at t...

Page 125: ...n on handling electro static sensitive components in the section Components With Electro static Sensitive Devices on page 18 Removing the Management Blade Figure 73 Disengaging the management blade a green touch point Ê Swing the eject handle a of the management blade in the direction of the arrow until the locking mechanism disengages and the blade is pulled out a few centimeters ...

Page 126: ...he management blade Ê Remove the management blade from the slot V CAUTION To insure cooling to comply with the applicable EMC regulations regula tions on electromagnetic compatibility and for fire protection always both management blades have to be plugged in The management blade is inserted in reverse order ...

Page 127: ...ontinues unimpaired The defective power supply unit can be replaced during operation hot swap 11 1 Power Supply Unit PSU The power supply units are directly accessible at the rear of the system figure 75 Figure 75 PRIMERGY BX300 Blade Server System rear view The power supply unit can communicate with the system service processor via the I2C bus interface PSU part number FRU number barcode number m...

Page 128: ... When either Fan 2 or Fan 3 becomes fail PSU is kept to work The blinking LED can be reset only by power ON power OFF and or through plugging out the power supply cable Power supply condition 1 AC indicator green LED 2 Fan failure indicator green LED 3 PSU status indicator green LED AC present only standby outputs ON ON OFF OFF Power supply DC outputs ON and OK ON ON ON Fan failure alert ON blinks...

Page 129: ...e error must be resolved before adding or removing any additional components V CAUTION Because of chassis airflow disruption the power supply unit slot should not be vacant and or not covered for more than five minutes when the system power is ON Exceeding the five minute limit may damage components V CAUTION If one power supply unit has failed do not remove front fan module Ê Look at the FAN LED ...

Page 130: ...ply Concept Ê Remove the power supply cable from the insulated socket of the defective PSU V CAUTION Pay attention The PSU can be very hot Figure 77 Disengaging the power supply unit a green touch point Ê Press the locking button a to disengage the detent of the PSU handle ...

Page 131: ...it PSU Figure 78 Removing the power supply unit Ê Swivel the handle completely in the direction of the arrow to unlock the PSU from the chassis and pull it out from the slot V CAUTION Pay attention The PSU can be very hot To mount a PSU follow the instructions in reverse order ...

Page 132: ...irements are available it assumes the maximum value for each server blade type Therefore in some situations it might be possible to switch on an additional server blade afterwards If for example none of the used server blades has a memory extension there might be enough power reserves for an additional server blade The following table shows that depending on the available AC voltage range on the i...

Page 133: ...l server blade if a slot is available V CAUTION In this case if a power supply unit fails the server blade installed in the slot with the highest number will be gracefully shut down type of the server blades 100 V 127 V 200 V 240 V UP 1 4 GHz 1 6 GHz 14 20 DP 1 GHz 15 20 DP 933 MHz 16 20 DP 800 MHz 17 20 Table 4 Maximal number of server blades depending on the power supply ...

Page 134: ......

Page 135: ... the fan status via the server management software ServerView I Even though the system can continue operating with a defective fan the defective fan module or power supply unit must be replaced within a reasonable amount of time For how to replace a power supply unit see section Replacing a Power Supply Unit on page 119 Due to the hot swap architecture replacement is also possible during operation...

Page 136: ...move and or install one of the fan modules front or rear V CAUTION The system can continue operating without the front fan module The defective front fan module must be replaced within a reasonable amount of time max 1 minute If PCI modules are installed some cables are routed on the front side In this case the cable support see Removing the support cable on the front fan module on page 127 must b...

Page 137: ...Figure 80 Removing the support cable on the front fan module Ê Remove the cable support 1 with the fastened cables from the support brackets and let it hang down 2 Ê Push the support bracket somewhat upward 3 and remove it from the knurled screws 4 Repeat the step with the second support bracket Mounting is done in the reverse order ...

Page 138: ...e screws on the front fan module Ê Loosen the four knurled screws on the front panel of the system Figure 82 Removing the front fan module Ê Remove the front fan module The defective front fan module must be replaced within a reasonable amount of time max 1 minute Mounting is done in the reverse order ...

Page 139: ...ION If a system error has occurred and the front identify fault LED is blinking the error must be resolved before adding or removing any additional components e g Be sure that both power supply units are inserted and functional before you remove and or install one of the fan modules front or rear V CAUTION The system can continue operating without the rear fan module The defective rear fan module ...

Page 140: ... 0 A26361 K863 Z102 8 7619 The Rear Fan Module The Ventilation Concept Figure 84 Disengaging the rear fan module a green touch point Ê Press the locking button green to disengage the detent of the module handle ...

Page 141: ... 0 131 The Ventilation Concept The Rear Fan Module Figure 85 Removing the rear fan module Ê Swivel the handle completely down to disengage the locking mechanism and pull out the rear fan module Mounting is done in the reverse order ...

Page 142: ......

Page 143: ... the problem proceed as follows Ê Make a note of the steps and the circumstances that led to the fault Also make a note of any error messages displayed Ê Switch OFF the defective server blade or the system Ê Contact your customer service 13 1 System beeps three times and stands still The system beeps three times and stand still after you have switched ON your system Connector for the Mouse Cable a...

Page 144: ...ont or Rear Identify Fault LED Blinks Amber If the front or rear identify fault indicator blinks amber see section System Operating and Indicator Elements on page 42 one of the malfunctions described below may have occurred in the system One of the Power Supply Units Fails The PSU status LED is dark and or the PSU fan failure LED blinks green if there is an error in the corresponding power supply ...

Page 145: ...e Ê Check the switch blades failure LEDs to identify the defective unit Ê If the switch blade is still indicated as defective exchange it see section Installing a Switch Blade on page 106 13 4 System Switches Itself OFF Server Management has Detected an Error Ê In the ServerView program check the error list or the error log file with the SCU utility and attempt to eliminate the error 13 5 Screen R...

Page 146: ...tal frequency also known as the line frequency or horizontal deflection frequency in the documentation for your monitor Ê Refer to the documentation for your operating system or the software for your screen controller for how to set the correct horizontal frequency for your monitor and follow the procedure accordingly 13 7 No Screen Display or Display Drifts Wrong Horizontal Frequency or Resolutio...

Page 147: ...nding server blade to see whether the floppy disk drive controller and write permission are enabled 13 10 Time and Date Are Not Correct The management blades administers central the time and date of all server blades Ê Power ON the PRIMERGY BX300 to set all server blades to the correct time I If the time and date are repeatedly wrong when you switch on your server blade you must change the lithium...

Page 148: ...During booting the BIOS displays an error message Problem is detected with Array 1 Critical Status A disk member of a mirrored array has failed or is not responding The array is still functional but fault tolerance is disabled Ê Follow the instructions on the screen to identify and rebuild the data Ê Press Ctrl F to display the FastBuild tm Utility Main Menu Figure 86 FastBuild tm Utility Main Men...

Page 149: ...en appear Ê Under Select Drive for Rebuild highlight the replacement new drive The ID of this drive must be set to Slave V CAUTION All drive data will be overwritten Make sure you choose the correct drive and have defined the new blank drive as a Slave drive Ê Press Enter and confirm that the data will be copied to the selected drive All data on the replacement drive will be overwritten with mirro...

Page 150: ......

Page 151: ...ocumentation availble in the Internet can be fount via the URL http manuals fujitsu siemens com choose intel based servers 1 Safety 2 Ergonomics 3 Warranty 4 DataCenter Rack Technisches Handbuch Technical Manual 5 PRIMECENTER Rack Technisches Handbuch Technical Manual 6 PRIMERGY ServerView Suite ServerStart 7 ServerView Server Management User Manual 8 ServerView Web Extension User Manual 9 RemoteV...

Page 152: ...142 Rev 8 0 A26361 K863 Z102 8 7619 Related publications 12 PRIMERGY BX Blade Server Systems RemoteView Management Blade User Interface Description User Guide 13 BIOS Setup Beschreibung Reference Manual ...

Page 153: ...ppable 6 components hardware software 1 configuration system 63 configuring server 6 connecting cables 39 external devices 39 connectors switch blade 104 consumables 21 control panel 112 CPU 4 server blade Pentium III 73 server blade Pentium M 75 D data manipulation 1 data protection 69 date incorrect 137 DDR RAM module 75 installing 81 delivery note 24 dimensions 9 disconnecting cables 39 disposa...

Page 154: ...creen 136 no mouse pointer 137 screen remains dark 135 server blade will not boot 137 system switches itself OFF 135 FCC statement 19 FC PCI module connectors 80 Flash EPROM 7 floppy disk cannot be read written 137 front fan module replacing 126 H hard disk drive HDD 5 HDD installing 83 height units 28 hot swap fan module 6 management blade 6 power supply unit 6 server blade 6 switch blade 6 I ind...

Page 155: ...d on boot 69 PCI module attaching 88 FC PCI module 78 80 LAN PCI module 78 79 mounting controller 94 removing controller 94 PDA 5 6 Ports additional LAN 67 power supply power supply unit 5 117 system 117 power supply unit 5 117 indicators 118 replacing 119 property protection 69 R RAID level 5 rear fan module replacing 129 recycling of devices 22 reliability 5 replacing front fan module 126 power ...

Page 156: ...21 supervisor password 69 switch blade 103 connection panel 104 connectors 104 control panel 104 dummy module 106 installing 106 108 LAN mapping 66 104 switching OFF system 44 switching ON system 44 switch OFF time define 45 switch ON time define 45 system configuration 63 connecting mains voltage 40 front side 42 height units 28 indicators 42 installing 25 management blade 111 operating elements ...

Page 157: ...A26361 K863 Z102 8 7619 Rev 8 0 147 Index V ventilation fan in power supply unit 5 125 fan module 5 125 system 125 ventilation clearance 9 W weight 9 ...

Page 158: ......

Page 159: ...er System A26361 K863 Z102 8 7619 Comments Suggestions Corrections Submitted by Fujitsu Siemens Computers GmbH User Documentation 81730 Munich Germany Fax 49 700 372 00000 email manuals fujitsu siemens com http manuals fujitsu siemens com ...

Page 160: ......

Page 161: ...er System A26361 K863 Z102 8 7619 Comments Suggestions Corrections Submitted by Fujitsu Siemens Computers GmbH User Documentation 81730 Munich Germany Fax 49 700 372 00000 email manuals fujitsu siemens com http manuals fujitsu siemens com ...

Page 162: ......

Page 163: ...tsu com Copyright Fujitsu Technology Solutions 2009 Hinweise zum vorliegenden Dokument Zum 1 April 2009 ist Fujitsu Siemens Computers in den alleinigen Besitz von Fujitsu übergegangen Diese neue Tochtergesellschaft von Fujitsu trägt seit dem den Namen Fujitsu Technology Solutions Das vorliegende Dokument aus dem Dokumentenarchiv bezieht sich auf eine bereits vor längerer Zeit freigegebene oder nic...

Reviews:

No comments

Related manuals for PRIMERGY BX300

Brand: Aastra Pages: 592

Brand: Buffalo Pages: 2

NPort IA5250I/5250I-T Series

Brand: Moxa Technologies Pages: 2

Brand: Axel Pages: 28

Brand: CNET Pages: 2

Brand: Atop Pages: 52

Brand: Atop Pages: 2

Express5800/R320f-E4

Brand: NEC Pages: 88

Brand: LOOQS Pages: 69

ProLiant DL380 Gen10 Plus

Brand: HP Pages: 16

Brand: HP Pages: 43

ProLiant DL385p Generation 8

Brand: HP Pages: 57

ProLiant DL380 Generation9

Brand: HP Pages: 76

ProLiant DL360p Gen8

Brand: HP Pages: 4

ProLiant DL380 Generation 6

Brand: HP Pages: 50

ProLiant DL360p G8

Brand: HP Pages: 35

ProLiant DL560 Gen10

Brand: HP Pages: 146

ProLiant DL380 Generation 5

Brand: HP Pages: 41

Brands by name

0 1 2 3 4 5 6 7 8 9 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Popular brands

Load more brands