manualshive.com logo in svg

Fujitsu PRIMERGY RX800 S2, Operating Manual

Share
Download
Fujitsu PRIMERGY RX800 S2 Operating Manual Download Page 53

U41621-J-Z156-1-76

 47

Preparation for Operation

Controls and Indicators

4.1.2

Rear View

Ports and Connectors

Figure 15: Rear view of server (ports and connectors)

12

Power-on LED

–

When this LED is lit and not flashing, it 
indicates that the server is turned on.

–

When this LED is flashing, it indicates 
that the server is turned off and still 
connected to an AC power source. 

–

When this LED is off, it indicates that 
AC power is not present, or the power 
supply or the LED itself has failed.

1

System Power Connector for 
1st power supply unit (PS1)

The system power cords are connected to 
these two connectors to provide power to 
the device.

2

System Power Connector for 
2nd power supply unit (PS2)

3

Service Processor Ethernet 
10/100 connector 

Use this connector to connect the service 
processor to a network.

1

2

5

6

7

8

9

12

13

14

15

10

11

3

4

Summary of Contents for PRIMERGY RX800 S2

Page 1: ... S2 Operating Manual Gottfried Staubach Fujitsu Siemens Computers GmbH Paderborn 33094 Paderborn e mail email manuals fujitsu siemens com Tel 05251 14888 19 Fax 49 700 372 00001 U41621 J Z156 1 76 Sprachen En Edition November 2005 ...

Page 2: ...EN ISO 9001 2000 To ensure a consistently high quality standard and user friendliness this documentation was created to meet the regulations of a quality management system which complies with the requirements of the standard DIN EN ISO 9001 2000 cognitas Gesellschaft für Technik Dokumentation mbH www cognitas de Copyright and Trademarks cognitas Gesellschft für Technik Dokumentation mbH 2005 Pfad ...

Page 3: ...ik Dokumentation mbH 2005 Pfad H GS PRIMERGY RX800 S2 BA rx800s2us vor Introduction Important Notes Installing the Server Preparation for Operation Troubleshooting and Tips Hot plug Components Abbreviations Related Publications Index ...

Page 4: ... cognitas Gesellschft für Technik Dokumentation mbH 2005 Pfad H GS PRIMERGY RX800 S2 BA rx800s2us vor ...

Page 5: ...Connecting Devices to the Server 37 3 4 2 SMP Expansion cabling 37 3 4 3 Power Cabling 42 4 Preparation for Operation 45 4 1 Controls and Indicators 45 4 1 1 Front View 45 4 1 2 Rear View 47 4 2 Switching the Server On and Off 51 4 2 1 Switching On the Server 51 4 2 2 Switching Off the Server 52 4 3 Configuring the Server 54 4 3 1 BIOS Setup 54 4 3 2 Using the Boot Menu Program 62 4 3 3 Passwords ...

Page 6: ... 100 5 2 7 System Fails to Boot 100 5 2 8 Drives dead at System Boot 100 5 2 9 Added Drive Defective 101 5 2 10 Error Messages on the Monitor 101 6 Hot plug Components 103 6 1 Hot plug Hard Disk Drives 104 6 1 1 Handling HDD Modules 105 6 1 2 Installing a hot plug HDD module 106 6 2 Removing the Cover 108 6 3 Replacing a hot plug power supply 110 6 4 Replacing a Hot plug System Fan Unit 112 6 4 1 ...

Page 7: ...ise class data center environments Appli cation areas are especially large database server and system platforms for server consolidation for VMware ESX server With its unique flexibility and scalability the PRIMERGY RX800 S2 is ideal where future proof servers are required to satisfy growing performance demands Each node offers 6 PCI X 2 0 slots and is equipped with a CD DVD drive and up to 6x2 5 ...

Page 8: ...he hardware and ensuring that the system runs smoothly It is necessary to have a knowledge of hardware and data transmission as well as basic knowledge of the operating system used Additional Components of the System Documentation The PRIMERGY RX800 S2 documentation comprises the following manuals Quick Start Hardware PRIMERGY RX800 S2 poster Quick Start Software PRIMERGY ServerView Suite poster W...

Page 9: ...able on the ServerBooks CD I If you need a backup of the ServerBooks CD send the details of your server via email address Reklamat PC LOG fujitsu siemens com RemoteView Management Board RSA II User Manual ServeRAID 8i HDD Controller User Manual Other Sources of Information Technical manual for the rack Manual for the monitor Manual for ServerView server management software Manual for the remote te...

Page 10: ...nit an 8 way 2 node configuration is formed Two 8 way configuration sets may be connected to form a 16 way 4 node configuration Large system memory In the basic configuration either 2 GB or 4 GB of memory is installed depending on the type of memory installied Each node supports up to 32 GB 64 GB of system memory The memory controller supports error correcting code ECC for up to 16 industry standa...

Page 11: ...led and route the data around the failed chip Redundant Bit Steering reassigns memory bits to new locations within memory when recoverable errors have been detected Once a recoverable error is found by Memory Scrubbing Redundant Bit Steering writes the data that was to be stored in the damaged memory locations to spare memory locations within the same DIMM Memory Scrubbing and Redundant Bit Steeri...

Page 12: ...orts up to six 25 4 mm 1 inch slim high 2 5 inch hot plug hard disk drives with frames that are connected to the SAS backplane A 6 port onboard SAS controller is provided to assure SCSI functionality for the HDDs With the hot plug feature you can add remove or replace hard disk drives without turning off the server No HDD is contained in the basic configuration ServeRAID 8i RoMB Controller By defa...

Page 13: ...V Error indication is performed via LEDs on the PSU The server automatically sets itself to a voltage in the range of 100 to 120 V and from 200 to 240 V Hot plug Fans The server is equipped with 8 hot plug fans 2 fan blocks on the left and on the right with 4 fans each The cooling system is designed to meet thermal speci fications when any single fan in the system fails Additionally the loss of a ...

Page 14: ... modules or processors Pager message when rebooting system following an error Monitoring of PCI bus loading Watchdog timer for operating system monitoring and application monitoring Detailed status and error reports for bus systems processors and main memory Statistics for service technicians operating hours counter counter for switch on switch off cycles Error message logging in non volatile RAM ...

Page 15: ...error retry and recovery Automatic server restart ASR R Backup BIOS switching under the control of the service processor Baseboard management controller BMC aka service processor Built in menu driven electrically erasable programmable ROM EEPROM based setup system configuration and diagnostic programs Built in monitoring for fan power temperature voltage and power supply redundancy Chipkill memory...

Page 16: ...t Hot plug Cooling fans with speed sensing capability Power supplies Remind button to temporarily flash the Attention LED Remote system problem determination support RSA II to enable remote server management ROM based diagnostic programs SDRAM with serial presence detect SPD and vital product data VPD Standard cables presence detection Standby voltage for system management features and monitoring ...

Page 17: ... 256 MB Level 4 cache and remote I O controllers Memory Minimum 2 GB or 4 GB in basic configuration depending on memory type Maximum 32 GB or 64 GB depending on memory type Type ECC DDR II SDRAM registered DIMMs only Memory Scrubbing Chipkill Redundant Bit Steering Memory Mirroring Supports 1 GB and 2 GB 4 GB dual inline memory modules DIMMs which must be fitted in pairs Drives Supports up to six ...

Page 18: ...mote Management serial port RS232 Three USB ports one USB 1 1 on the front two USB 2 0 on the rear Keyboard port PS 2 Mouse port PS 2 VGA port System serial port COM1 RS232 Three Symmetrical Multiprocessor SMP Expansion Ports IXA port RS485 not used Cooling Eight hot plug fans four 80 mm redundant fans left block four 92 mm redundant fans right block Power supply Two hot plug power supplies standa...

Page 19: ...re shown as they appear on the keyboard If an uppercase letter must be entered explicitly the Shift key is also specified e g SHIFT A plus sign between the key symbols indicates that these keys are to be pressed simultaneously bold type Used for emphasis in the body of the text quotation marks Used for references to other chapters sections or manuals Ê Identifies an action that you need to take Al...

Page 20: ...ion max 6098 kJ h 5780 BTU Building fuse 16 A Protection class I Table 3 Electrical data Dimensions and Weight Height mm 128 35 3 U Width mm 440 Depth mm 715 mm Rack mount depth mm 715 mm incl SMP cable 815 mm Rack height units 3 6 12 U 4 8 16 way Rack cable depth 100 mm 900 mm rack sufficient 1000 mm rack recommended Rack integration kit inclusive telescopic rails as part of the standard delivery...

Page 21: ...e humidity 5 to 100 including condensation but excluding rain Mechanical environmental conditions Operation Class 3M2 Transport Class 2M2 Table 5 Environmental conditions Standards Product safety Global IEC 60950 Europe EN 60950 USA Canada UL 1950 CSA 950 Electromagnetic compatibility Europe EN 55022 Class A EN 55024 EN 61000 3 2 EN 61000 3 3 Taiwan CNS 13438 class A China Class A Japan VCCI Class...

Page 22: ...tibility Australia C Tick Mark Japan VCCI Taiwan BSMI Mexico NOM 018 Russia Gost Noise level ISO 9296 Sound power level LWAd max 6 6 B Operating sound pressure level LpAm 60 dB A in standard configuration Table 7 Noise level Maintenance surfaces and ventilation clearances Depends on 19 rack Table 8 Maintenance surfaces and ventilation clearances Table 6 Standards ...

Page 23: ...out where you can set up the device contact your sales outlet or our customer service team V CAUTION The actions described in these instructions should only be performed by technical specialists Equipment repairs should only be performed by authorized qualified staff Any unauthorized openings and improper repairs could expose the user to risks electric shock energy hazards fire hazards and could a...

Page 24: ...g or in a packaging which protects it from knocks and jolts Installation and Operation V CAUTION If the rack model is integrated in an installation that receives power from an industrial public power supply network with the IEC309 connector the public power supply protection must comply with the requirements for the non industrial public power supply networks for the type A connector The server au...

Page 25: ...n such a way that they do not form a potential hazard make sure no one can trip over them and that they cannot be damaged Refer to the relevant notes in the operating manual when connecting the device No data transmission cable should be connected or disconnected during a thunderstorm lightning hazard Make sure that no objects such as bracelets or paper clips fall into or liquids spill into the de...

Page 26: ...pened removed or exchanged by authorized qualified personnel The hot plug power supply units are exceptions to this rule The warranty is invalidated if the device is damaged during the instal lation or replacement of system expansions You may set only those resolutions and refresh rates specified in the Technical data section of the monitor description Otherwise you may damage your monitor If you ...

Page 27: ...rate the cover of the drive damage to the device and be thrown out of the device danger of injury particularly on uncovered body parts such as the face or neck I You protect the CD DVD drive and prevent mechanical damage as well as premature wearing of the CDs DVDs by observing the following suggestions Only insert the CDs DVDs in the drive when needed and remove them after use Store the CDs DVDs ...

Page 28: ...erting or removing components containing ESDs You must always discharge static build up e g by touching a grounded object before working Use a grounding cable designed for this purpose to connect yourself to the system unit as you install components The equipment and tools you use must be free of static charge Always hold components with ESDs at the edges or at the positions highlighted in green t...

Page 29: ...quirements of the Canadian Interference Causing Equipment Standard ICES 003 for digital apparatus These limits are designed to provide reasonable protection against harmful interference in a residential installation This equipment generates uses and can radiate radio frequency energy and if not installed and used in strict accordance with the instructions may cause harmful interference to radio co...

Page 30: ...bsti tution or attachment of connecting cables and equipment other than those specified by Fujitsu Siemens Computers The correction of interferences caused by such unauthorized modification substitution or attachment will be the responsibility of the user The use of shielded I O cables is required when connecting this equipment to any and all optional peripheral or host devices Failure to do so ma...

Page 31: ...onding rack Ensure that the anti tilt bracket is correctly mounted when you set up the rack For safety reasons only one unit may be withdrawn from the rack at a time when performing assembly or service work If more than one unit is withdrawn from the rack at any one time there is a danger that the rack will tilt forward The power connection for the rack must be installed by an authorized technicia...

Page 32: ... to the environment Notes on Saving Energy Devices that do not have to be on permanently should not be switched on until they need to be used and should be switched off during long breaks and on completion of work Notes on Packaging Please do not throw away the packaging It may be needed later for transporting your system unit If possible devices should be transported in their original packaging N...

Page 33: ...ilable to you see Local Contacts on page 28 The return of used devices which pose a health or safety risk for human beings due to soiling during use may be refused Reuse recycling and utilisation By actively using the offered return and collection systems you make your contribution to the reuse recycling and utilisation of electrical electronic devices Effects on the environment and human health E...

Page 34: ...the waste bin Cd Cadmium Hg Mercury Pb Lead The following applies to Germany Private consumers can return batteries at the point of sale or the immediate vicinity thereof free of charge exception starter batteries The final consumer is obligated to return defective or used batteries to the seller or to the return points established for this purpose Local Contacts For details on take back and reuse...

Page 35: ...ver see section Unpacking the Server on page 30 Ê Mount the server in the rack see section Mounting the Server in the Rack on page 31 Ê Attach the cables according to the configuration required see section Connecting and Disconnecting Cables on page 36 In particular Ê Connect the peripherals to the server see section Connecting Devices to the Server on page 37 Ê If you plan an 8 way or a 16 way co...

Page 36: ...recommended not to throw away the original packaging material It may be required for transport at some later date Ê Unpack all the individual parts Ê Check the delivery for damage incurred during transport Ê Check whether the delivery agrees with the details in the delivery note Should you discover that the delivery does not correspond to the delivery note notify your supplier immediately Ê Rotate...

Page 37: ... removed For mounting the server in the rack the following parts are necessary one support bracket 3 HU with two M5x10 screws with integrated plugwashers one rack mounting kit consisting of two telescopic rails left right ready for use including 8 screws with integrated plugwashers Two knurled screws and cage nuts for fastening the front panel of the server to the rack General Information is provi...

Page 38: ...ding height of the rear left support upright using the two screws delivered Ê Fasten the two telescopic rails to the support uprights the support bracket in the rack using the 8 screws delivered with the system Make sure the telescopic rails engage with their tail clamps No cage nuts are necessary for securing the telescopic rails as the attachment holes are threaded Figure 5 Mounting the telescop...

Page 39: ... find the right mounting point the two teeth protruding from the upper side of the telescopic bars must match the two triangular marks visible on each side of the server Figure 6 Lifting the server onto the two telescope bars The following steps require only one person Ê Push the server approx one inch 2 to 3 cm into the rack until the locking mechanism engages When locked in position a blue indic...

Page 40: ...hft für Technik Dokumentation mbH 2005 Pfad H GS PRIMERGY RX800 S2 BA rx800s2us k03 Ê Release the safety catch see magnifying view in figure 7 on both telescope bars by pushing it upwards in the direction of the arrow and slide the server into the rack Figure 7 Mounting the server into the rack ...

Page 41: ...ing the Server Mounting the Server in the Rack Ê Fasten the system unit to the rack using the two knurled screws 1 on the front side Figure 8 Fastening the server to the rack Removing the server is performed in reverse order 1 1 i ...

Page 42: ...age 47 to get more information about ports and connectors Notes on Connecting Cables All affected devices must be switched off The power plugs of all affected devices must be pulled from the sockets Then attach all cables to the server Mark the cables and note what function each cable serves Insert the power plugs into the grounded socket Make sure that the power cables of the devices are plugged ...

Page 43: ... to share system resources To configure and cable a multi node configuration complete the following steps Ê Verify that the BIOS code and the firmware have the most current level see System Information on page 56 Ê If necessary update the BIOS code and the service processor firmware To download the most current level of BIOS code and service processor firmware go to www fujitsu siemens com support...

Page 44: ... 7 6 foot scalability cable kits To cable a two node configuration for up to 8 way operation complete the following steps Ê Remove the protective covers from the connectors on the ends of the cables figure 9 Figure 9 Protective cover for scalability cable Ê Label each end of the SMP Expansion cables according to where it will be connected to each server See figure 10 and figure 11 Figure 10 Cablin...

Page 45: ...ute the cable through the node 1 cable management arm Use a 2 3 m 7 6 foot SMP Expansion cable for this connection Ê Connect the SMP Expansion cables to node 2 Ê Locate the SMP Expansion cable that is connected to port 1 on node 1 then connect the opposite end of the cable to port 1 of node 2 Next route the cable through the node 2 cable management arm Ê Locate the SMP Expansion cable that is conn...

Page 46: ...and three 2 9 m 9 5 foot scalability cable kits To cable a four node configu ration for up to 16 way operation complete the following steps Ê Remove the protective covers from the connectors on the ends of the cables see figure 9 Ê Label each end of the SMP Expansion cables according to where it will be connected to each server See figure 12 Figure 12 Cabling four nodes scheme Node 2 Node 3 Node 4...

Page 47: ...then route the cable through the node 2 cable management arm Use a 2 9 m 9 5 foot SMP Expansion cable for this connection Ê Locate the SMP Expansion cable that is connected to port 3 on node 1 then connect the opposite end of the cable to port 3 of node 2 Next route the cable through the node 2 cable management arm Ê Connect the SMP Expansion cables to node 3 Ê Locate the SMP Expansion cable that ...

Page 48: ...and the server is driven with 200 V to 240 V If a defect occurs in one unit the other unit ensures unimpaired further operation The defective unit can be replaced during operation see section Replacing a hot plug power supply on page 110 When the server is attached to 100 V to 127 V no power supply redun dancy is available Both power supply units are needed for proper operation of the server The t...

Page 49: ...cord to one of the system power connectors on the rear of the server Ê Plug the other end of the power supply cord into a properly grounded electrical outlet or a primary power unit inside the rack Ê Repeat these steps with the other power cord Figure 13 Connecting the server to the mains rack socket strip ...

Page 50: ......

Page 51: ...56 1 76 45 4 Preparation for Operation CAUTION Observe the safety information in the chapter Important Notes on page 17 4 1 Controls and Indicators 4 1 1 Front View Figure 14 Front view 1 2 3 4 5 6 7 8 9 10 11 12 ...

Page 52: ...indicates that the CD DVD drive is in use 5 USB port Use this port to connect one or more USB devices to the front of the server using Plug and Play technology 6 Power Button Press this button to manually turn the server on or off 7 Information LED When this LED is lit it indicates that an error or warning message has been writ ten to the system event log 8 Release Latch Slide this latch to the le...

Page 53: ... turned off and still connected to an AC power source When this LED is off it indicates that AC power is not present or the power supply or the LED itself has failed 1 System Power Connector for 1st power supply unit PS1 The system power cords are connected to these two connectors to provide power to the device 2 System Power Connector for 2nd power supply unit PS2 3 Service Processor Ethernet 10 ...

Page 54: ...a monitor to this connector 7 Service Processor Serial port RS232 Connect an optional 9 pin serial device to this connector this port is used for charac ter oriented console redirection 8 Mouse Port PS 2 Connect a mouse or another pointing device to this connector 9 Keyboard Port PS 2 Connect a keyboard to this connector 10 IXA Port RS485 This port is not used 11 Gigabit Ethernet Port 2 Use these ...

Page 55: ...n active connection on the Ethernet port 4 Service Processor Ethernet 10 100 activity indicator When this LED is lit it indicates that there is activity between the server and the net work 5 PCI X Adapter Error LED When this LED is lit it indicates that there is a problem with a PCI X adapter 6 ServeRAID 8i Error LED When this LED is lit it indicates that there is a problem with the ServeRAID 8i c...

Page 56: ...re is an active connection on the Ethernet port 11 Gigabit Ethernet 1 activity LED When this LED is lit it indicates that there is activity between the server and the net work 12 Gigabit Ethernet 1 link LED When this LED is lit it indicates that there is an active connection on the Ethernet port 13 SMP Expansion Port 3 link LED When this LED is lit it indicates that there is an active connection o...

Page 57: ... such as a remote request to turn on the server The power on LED flashes to indicate that the server is connected to AC power but not turned on see section Front View on page 45 Approximately 20 seconds after the server is connected to AC power see section Power Cabling on page 42 the power button becomes active and one or more fans might start running to provide cooling while the server is connec...

Page 58: ... that the server is connected to AC power but not turned on see section Front View on page 45 Some operating systems require an orderly shutdown before you turn off the server See your operating system documentation for details The server can be turned off in any of the following ways If your operating system is ACPI compatible Ê Shut down the operating system in an orderly manner The server will ...

Page 59: ... shutdown of the operating system and turn off the server The server can be turned off from the RSA II user interface see the RSA II user manual for more details If the Wake on LAN feature turned on the server the Wake on LAN feature can turn off the server You can turn off the server through a request from the service processor After you turn off the server wait at least 5 seconds before you turn...

Page 60: ...s for advanced hardware features View and clear error logs Change interrupt request IRQ settings Enable USB legacy keyboard and mouse support Resolve configuration conflicts The following sections provide instructions for starting the Configuration Setup Utility program and descriptions of the menu choices that are available Starting the Configuration Setup Utility Program Complete the following s...

Page 61: ...S Setup You can press F1 to display help information for a selected menu item The choices on some menus might differ slightly from the ones that are described in this book depending on the version of BIOS code in your server Ê Select settings to view or change Descriptions of the choices that are available from the main menu are as follows Configuration Setup Utility System Summary System Informat...

Page 62: ...ome of those changes are reflected in the system information you cannot change settings directly in the system information This choice is on the full Configuration Setup Utility menu only Product Data Select this choice to view the machine type and model of the server the serial number the revision level or issue date of the BIOS and diagnostics code stored in electrically erasable programmable RO...

Page 63: ...ct this choice to view and set the date and time in the server The system time is in a 24 hour format hour minute second This choice appears only on the full Configuration Setup Utility main menu System Security Select this choice to set or change the power on password and the adminis trator password for more details see section Passwords on page 62 Power on Password Select this choice to set or c...

Page 64: ...the hard disk drive and then checks a network adapter If you enable the boot fail count die BIOS default setting will be restored after three consecutive failures to find a boot record You also can enable a virus warning test that checks for changes in the master boot record at startup You can enable the use of a USB legacy keyboard in a DOS or System Setup environment If a keyboard is detected th...

Page 65: ...PCI PCI X devices are usually configured automatically This information is saved when you exit The Save Settings Restore Settings and Load Default Settings choices on the Configuration Setup Utility main menu do not save the PCI Slot Device Information settings RSA II Settings Select this choice to view and change RSA II settings You can also view the MAC address and set the IP address subnet mask...

Page 66: ...ng Enable is the default setting BMC Serial Port Access Mode Share or disable the BMC serial port access mode Shared is the default setting Reboot system on NMI If you enable this option the server automatically restarts 60 seconds after the service processor issues a nonmaskable interrupt NMI to the server If you disable this option the server does not restart Enable is the default setting BMC Ne...

Page 67: ...eys to move between pages in the System Error Log Select Clear error logs from the System Event Error Log menu to clear the error log This choice is available on the full Configuration Setup Utility menu only Save Settings Select this choice to save your customized settings Restore Settings Select this choice to cancel the changes that you have made in the settings and restore the previous setting...

Page 68: ...for protecting your data from unauthorized access By combining these options you can achieve optimum protection for your system This choice is on the full Configuration Setup Menu utility only If you set only a power on password you must type the power on password to complete the system startup and you have access to the full Configu ration Setup Utility menu An administrator password is intended ...

Page 69: ...assword is set and then forgotten it cannot be overridden or removed You must replace the I O board Preventing unauthorized system access power on password You can activate this protection by setting a power on password in the System Security menu When a power on password is set POST does not complete until you type the password After you set a power on password you can enable the Unattended Start...

Page 70: ...system to address the controller For device drivers and information about configuring the Ethernet controller see the ServerStart CD that comes with your server 4 3 5 Using the PXE boot agent utility program Use the Preboot Execution Environment PXE boot agent utility program to enable or disable operating system wake up support Your server does not support changing the network boot protocol or sp...

Page 71: ...t agent utility You can select Ctrl S default or Ctrl B Banner Message Timeout Select this choice to specify the amount of time in seconds that the server will wait for you to press Ctrl S after the prompt appears You can select 2 default 3 5 or 8 seconds Link Speed Select this choice to set the link speed for the LAN connection AutoNeg auto negotiate is the default setting Pre boot Wake on LAN Se...

Page 72: ...uctions on the screen to change the SerialSelect Utility or Disk Utilities settings SerialSelect Utility menu choices The following choices are on the SerialSelect Utility menu SAS Controller Configuration Select this choice to view or change SAS controller settings To reset the controller to its default settings press F6 and follow the instructions on the screen PHY Configuration Select this choi...

Page 73: ...at the RSA IIs can communicate with and manage scalable partitions Make sure that all nodes in the multi node configuration have the current level of BIOS code SAS BIOS code service processor firmware BMC firmware and CPLD firmware The code and firmware levels must be the same for all nodes When you set up the nodes for scalable partitions for the first time you must first log on and configure the...

Page 74: ...ee the RSA II user manual for more information then continue with the procedure to create a scalable partition The RSA II Web Interface must be open to view create delete or manage scalable partitions Make sure that the Web Interface is open before you continue Ê In the navigation pane click Status under Scalable Partitioning Use the Scalable Partition Status page to view information about the cur...

Page 75: ...or changing the host name Use the Create Scalable Partitions Settings page to create new scalable partitions A page similar to the one in the following illustration is displayed Ê In the RSAII Host Name or IP Address field type the host name or RSA II IP address for each node The node is assigned the associated chassis ID Ê After you enter information for all nodes click Assign ...

Page 76: ...ct the number of minutes POST waits for the scalable nodes to merge resources Allow at least 8 seconds for each GB of memory in the scalable partition You can view the merge status on the monitor attached to the primary node Ê In the On merge failure attempt partial merge field select if POST should attempt a partial merge if one error is detected during full merge You can view the merge status du...

Page 77: ...artition You can also start or stop a scalable partition A page similar to the one in the following illustration is displayed Deleting a scalable partition To delete the scalable partition complete the following steps Ê Log in to the RSA II Web Interface Ê In the navigation pane click Scalable Partitioning Ê In the navigation pane click Delete Partition s then follow the instructions on the Delete...

Page 78: ...em components fail the baseboard management controller lights LEDs to help you diagnose the problem and also records the error in the BMC system event log The baseboard management controller also provides the following remote server management capabilities through the OSA SMBridge management utility program Command line interface IPMI Shell The command line interface provides direct access to serv...

Page 79: ... F2 for Diagnostics appears press ESC Shift o then Shift q Updating and configuring the BIOS Ê Update the BIOS code Ê Download the latest version of the BIOS code from http www fujitsu siemens com support Ê Update the BIOS code following the instructions that come with the update file that you downloaded Ê Configure the BIOS settings Ê Restart the server and press F1 when prompted to start the Con...

Page 80: ...nar Ethernet 2 you must also set Run PXE only on selected Planar NIC to Enabled Ê Press ESC to exit the Start Options section of the Configuration Setup Utility program Ê Select Save Settings then press Enter Ê Press Enter to confirm Ê Select Exit Setup then press Enter Ê Make sure that Yes exit the Setup Utility is selected then press Enter Configuring Linux For SOL operation on the server you mu...

Page 81: ...etty h ttyS1 19200 vt102 Ê Add the following line at the bottom of the etc securetty file to enable a user to log in as the root user through the SOL console ttyS1 LILO configuration If you are using LILO complete the following steps Ê Modify the etc lilo conf file Ê Add the following text to the end of the first default linux line Monitor Ê Comment out the map boot map line by adding a at the beg...

Page 82: ...0n8 The following examples show the original content of the etc lilo conf file and the content of this file after modification Original etc lilo conf contents prompt timeout 50 default linux boot dev hda map boot map install boot boot b message boot message linear image boot vmlinuz 2 4 9 e 12smp label linux initrd boot initrd 2 4 9 e 12smp img read only root dev hda6 image boot vmlinuz 2 4 9 e 12...

Page 83: ...he first title line This will allow you to only Monitor the OS boot via SOL Ê Append the following text to the first title line SOL Monitor Modified etc lilo conf contents prompt timeout 50 default linux Monitor boot dev hda map boot map install boot boot b message boot message linear This will allow you to only Monitor the OS boot via SOL image boot vmlinuz 2 4 9 e 12smp label linux Monitor initr...

Page 84: ...wing examples show the original content of the boot grub grub conf file and the content of this file after modification Original boot grub grub conf contents grub conf generated by anaconda Note that you do not have to rerun grub after making changes to this file NOTICE You have a boot partition This means that all kernel and initrd paths are relative to boot eg root hd0 0 kernel vmlinuz version r...

Page 85: ...ough the SOL console 7 2345 respawn sbin agetty h ttyS1 19200 vt102 Modified boot grub grub conf contents grub conf generated by anaconda Note that you do not have to rerun grub after making changes to this file NOTICE You have a boot partition This means that all kernel and initrd paths are relative to boot eg root hd0 0 kernel vmlinuz version ro root dev hda6 initrd initrd version img boot dev h...

Page 86: ... Ê Append the following text to the kernel line of the first title section console ttyS1 19200 console tty1 Ê Add the following four lines between the first two title sections This will allow you to Interact with the OS boot via SOL title linux SOL Interactive kernel hd0 1 boot vmlinuz root dev hda2 acpi oldboot vga 791 console tty1 console ttyS1 19200 initrd hd0 1 boot initrd The following exampl...

Page 87: ...boot grub menu lst contents gfxmanu hd0 1 boot message color white blue black light gray default 0 timeout 8 This will allow you to only Monitor the OS boot via SOL title linux SOL Monitor kernel hd0 1 boot vmlinuz root dev hda2 acpi oldboot vga 791 console ttyS1 19200 console tty1 initrd hd0 1 boot initrd This will allow you to Interact with the OS boot via SOL title linux SOL Interactive kernel ...

Page 88: ...s command prompt type bootcfg EMS ON PORT COM1 BAUD 19200 ID boot_id where boot_id is the boot entry ID from the last step then press Enter Ê To verify that the EMS console is redirected to the COM2 serial port Ê Type bootcfg at a Windows command prompt then press Enter to display the current boot options for the server Ê Verify the following changes to the bootcfg settings In the Boot Loader Sett...

Page 89: ...pecify an IP address if you want to limit the connection requests that will be accepted by the utility program To accept connections from any server type INADDR_ANY as the IP address Also specify the port number that the utility program will use These values will be recorded in the smbridge cfg file for the automatic startup of the utility program To install the OSA SMBridge management utility pro...

Page 90: ... sol oem cfg usr sbin smbconfig usr bin smbconfig usr sbin ipmish The utility starts automatically when the server is started You can also locate the etc init d directory to start the utility and use the following commands to manage the utility smbridge status smbridge start smbridge stop smbridge restart 4 3 11 Using the BMC utility programs Use the BMC utility programs to configure the baseboard...

Page 91: ...ion be sure to update the server baseboard management controller firmware before updating the BIOS code To update the firmware if the Linux or Windows operating system update package is available from the World Wide Web and you have obtained the appli cable update package follow the instructions that come with the update package Using the OSA SMBridge management utility program Use the OSA SMBridg...

Page 92: ...ions over a Serial over LAN SOL network You can also use SOL to remotely view and change the server BIOS settings At a command prompt type telnet localhost 623 to access the SOL network Type help at the smbridge prompt for more information Use the following commands in an SOL session connect Connect to the LAN Type connect ip ip_address u username p password identify Control the system locator LED...

Page 93: ... technician Do not use any cleaning agents that contain abrasives or may corrode plastic Ensure that no liquid enters the system Ensure that the ventilation areas of the server and the monitor are free Use a cloth for disinfection to clean the keyboard and the mouse Wipe the server and monitor casing with a dry cloth If particularly dirty use a cloth that has been moistened in a mild domestic dete...

Page 94: ......

Page 95: ...Notes on page 17 and chapter Installing the Server on page 29 when you connect or disconnect cables If a fault occurs try to correct it as described in this chapter in the documentation of the connected devices in the help systems of the software used If you fail to correct the problem proceed as follows Ê Make a note of the steps and the circumstances that led to the fault Also make a note of any...

Page 96: ...e source of the error The server is designed so that LEDs remain lit when the server is connected to an AC power source but is not turned on provided that the power supply is operating correctly This feature helps you to isolate the problem when the operating system is shut down Many errors are first indicated by a lit information LED or system error LED on the Operator Information Panel on the fr...

Page 97: ...e refer to figure 14 on page 45 and to the table following it to get a more detailed explanation of their meaning 2 Power on LED 3 Power Button 4 HDD Activity Light 5 Locator Light 6 Information Light When this LED is lit it indicates that an error or warning message has been written to the system event log 7 System Error Light When this LED is lit it indicates that a system error has occurred An ...

Page 98: ... Information Panel to the left see pos 8 in figure 19 Ê Slide it forward This reveals the LED card Lit LEDs on this panel indicate the type of error that has occurred see figure 20 Figure 20 LED Card Layout seen from top Ê Look at the system service label on the top of the server which gives an overview of internal components that correspond to the LEDs on the LED card This information and the inf...

Page 99: ...AC instead of 110 V AC Ê Replace failed power supply see page 110 Ê Remove optional devices from the server until LED is no longer lit Ê If the error persists call for service PS A power supply has failed or has been removed also see figure 25 on page 111 In a redundant power configuration the DC power LED on one power supply might be off Ê Reinstall the removed power supply Ê Check the individual...

Page 100: ... service CPU A microprocessor has failed is missing or has been improperly installed Ê Check the BMC log or the system error log to determine the reason for the lit LED Ê Find the failing missing or mismatched microprocessor by checking the LEDs on the microprocessor tray Ê If a microprocessor error LED on the system board is on have system serviced VRM Voltage regulator module VRM failure Ê Check...

Page 101: ... is on have system serviced NMI A hardware error has been reported to the operating system Non maskable interrupt occurred The PCI or MEM LED might also be lit Ê See the BMC log and the system error log see Event Error Logs on page 61 Ê If the PCI LED is lit follow the instructions for that LED Ê If the MEM LED is lit follow the instructions for that LED Ê Restart the server Ê If problem persists ...

Page 102: ... source fails the sys tem will be over spec The LOG LED might also be lit Ê If the PS LED on the LED card is lit follow the instructions for that LED Ê Replace the failing power supply see page 110 Ê Remove optional devices Ê Use 220 V AC instead of 110 V AC TEMP A system temperature or component has exceeded specifications A fan LED might also be lit Ê See the BMC log and the system error log see...

Page 103: ...in Remind mode until one of the following conditions occurs All known errors are corrected The server is restarted A new error occurs causing the system error LED to be lit again FAN A fan has failed or has been removed A failing fan can also cause the TEMP LED to be lit Ê Reinstall the removed fan Ê If an individual fan LED is lit replace the fan see page 112 Ê If problem persists call for servic...

Page 104: ...nded power sockets Power supply overloaded Ê Pull the server power plugs out of their sockets Ê Wait a few seconds and plug the power plugs into their grounded sockets again Ê Switch your server ON 5 2 2 The Server Switches itself OFF Server management has detected an error Ê Check the error list or the ErrorLog file in the ServerView program and attempt to eliminate the error 5 2 3 The Monitor Re...

Page 105: ...rate graphics card is installed in the server then the monitor cable must be connected to the connection on this graphics card Ê Switch ON the monitor and the server 5 2 4 Flickering Stripes across the Monitor V CAUTION Switch OFF the server immediately Risk of damaging the server Monitor does not support the set horizontal frequency Ê Find out which horizontal frequency your monitor supports You ...

Page 106: ...e monitor controller for how to set the correct horizontal frequency for your monitor and follow the procedure accordingly 5 2 6 Time and or Date are Incorrect Ê Set the time and or date in the operating system or in the BIOS Setup Main menu I If the time and date are repeatedly wrong when you switch on your server you must change the lithium battery see Service Manual or contact our Service organ...

Page 107: ...orresponding utility Information is contained in the documentation on the RAID controller or Ê Re insert the HDD module with the system switched ON into a free module bay If the hard disk drive continues to be shown as defective then replace it see section Hot plug Hard Disk Drives on page 104 5 2 10 Error Messages on the Monitor The meaning of the error messages is explained in the documentation ...

Page 108: ......

Page 109: ...irectly accessible from the outside HDD modules After that hot plug components are treated which are only accessible after removing the cover fans power supply units memory cards and PCI X adapters V CAUTION Please observe the safety information in chapter Important Notes on page 17 V CAUTION Defective hot plug components should be replaced as soon as possible Above all this applies to system fans...

Page 110: ...and the carrier constitute the hard disk drive module called HDD module in the following sections V CAUTION Only a service technician may remove a hard disk drive from the HDD module V CAUTION The HDD modules drives must be marked clearly so that they can be put back into their original place after an upgrade If this is not taken into account existing data can be destroyed V CAUTION The hot plug f...

Page 111: ...f problems Store and transport HDD modules only within the limits stipulated in the specification When transporting HDD modules even over short distances always use the original packaging ESD labeling Never expose a HDD module to a temperature shock Avoid the formation of condensation inside and on the outside of the hard disk drives V CAUTION The HDD module must be acclimatized in its operating e...

Page 112: ...RGY RX800 S2 BA rx800s2us k06 6 1 2 Installing a hot plug HDD module To install a hot plug HDD module complete the following steps Ê Remove the dummy module from one of the empty hot plug bays see figure 21 Ê Alternatively if a defective HDD module is to be hot swapped remove it from its bay Figure 21 Removing the dummy module ...

Page 113: ...on the outside of the serve then remove the HDD module from the package Ê Make sure that the module handle is open then install the HDD module into the hot plug bay in the direction of the arrow see figure 22 Figure 22 Installing a hot plug HDD module Ê Push the module handle completely in the original position until the locking mechanism engages ...

Page 114: ...orized qualified staff Any unauthorized openings and improper repairs could expose the user to risks electric shock energy hazards fire hazards and could also damage the equipment Please observe the safety information in chapter Important Notes on page 17 To remove the cover complete the following steps Ê Slide the server out of the rack until the slide rails lock into place Ê Lift the cover relea...

Page 115: ...ulations on electromagnetic compatibility and to protect against fire Ê Lift the cover off the server All mostly hot pluggable server components are now accessible Figure 24 Server with cover open and mostly hot plug components accessible I For more details about the ServeRAID 8i HDD controller adapter see the ServeRAID 8i user manual fans 92 mm power supplies fans 80 mm PCI X adapters memory card...

Page 116: ...ts might be damaged because of excessive temperatures I The power supplies are numbered from left to right 1 and 2 as viewed from the rear of the server Power supplies must be installed in the following sequence power supply 1 then power supply 2 Complete the following steps Ê Slide the server out of the rack until the slide rails lock into place Ê Remove the server cover see Removing the Cover on...

Page 117: ... cord into a properly grounded electrical outlet Ê Make sure that the AC power LED on the rear of the power supply and the AC and DC power LEDs on the top of the power supply are lit indicating that the power supply is operating correctly Figure 25 Installing a hot plug power supply Ê Reinstall the cover and slide the server into the rack A C D C A C D C Locking handle open Locking latch Power sup...

Page 118: ...up to maintain a safe operating temperature in the server until the fan is reinstalled or replaced When the new fan is installed correctly the fans will slow down 6 4 1 Removing a hot plug fan To remove a hot plug fan complete the following steps Ê Slide the server out of the rack until the slide rails lock into place Ê Remove the top cover see Removing the Cover on page 108 For the following step...

Page 119: ...plug Components System Fans Figure 26 Replacing hot plug fans server front shown without bezel Hot plug fan 1 Hot plug fan 5 Hot plug fan 6 Hot plug fan 7 Hot plug fan 8 Fan Error LED Hot plug fan 2 Hot plug fan 3 Hot plug fan 4 ...

Page 120: ... ProteXion features Memory mirroring Memory mirroring enables you to improve the reliability of the memory in your server by creating a mirror of the data in memory port 1 and storing it in memory port 2 I For memory mirroring to work you must have DIMMs of the same size and clock speed in both memory ports see the Options Guide Complete the following steps to enable memory mirroring Ê Check your ...

Page 121: ...bled to work Memory scrubbing is an automatic daily test of all the system memory that detects and reports memory errors that might be developing before they cause a server outage When an error is detected memory scrubbing determines whether the error is recoverable If it is recoverable Memory ProteXion is enabled and the data that was stored in the damaged locations is rewritten to a new location...

Page 122: ...an hot replace one memory card at a time on each memory power bus If a problem with a DIMM is detected light path diagnostics will light the system error LED on the front of the server indicating that there is a problem and guide you to the memory card with the defective DIMM The following illustration shows the LEDs on the memory card Figure 27 Memory card LEDs Memory Hot Swap Enabled 1 When this...

Page 123: ...re being installed in the server You can hot add one memory card to each of the memory power buses provided your operating system supports that function Also hot add must be activated in BIOS setup see Memory Settings on page 59 Complete the following steps to add a memory card Ê Slide the server out of the rack until the slide rails lock into place Ê Remove the cover from the server see Removing ...

Page 124: ...de the server out of the rack until the slide rails lock into place Ê Remove the cover from the server see Removing the Cover on page 108 Ê Make sure the memory hot swap enabled LED is lit on the top of the memory card to be replaced see figure 27 If the LED is not lit enable memory mirroring in BIOS setup see Active Memory on page 114 Ê Prepare the memory card Ê Touch the static protective packag...

Page 125: ...ory card by the retention levers and turn the memory card so that the connector aligns with the connector on the microprocessor board Ê Insert the memory card into the memory card connector Ê Press the memory card into the connector and close the retention levers Ê Reinstall the top cover and slide the server into the rack A C D C ...

Page 126: ... and PCI X adapters The server scans devices and PCI X slots to assign system resources in the following order integrated Ethernet controller integrated SAS controller and then PCI X slots 1 through 6 Before starting you should proceed as follows Ê Locate the documentation that comes with the adapter and follow those instructions in addition to the instructions in this section Ê If the adapter is ...

Page 127: ...ing or removing cables To install a hot plug PCI or PCI X adapter complete the following steps Ê Make sure that the PCI hot plug device driver is installed For details see the documentation that comes with the adapter Ê Slide the server out of the rack until the slide rails lock into place Ê Remove the server cover see Removing the Cover on page 108 and determine which PCI X expansion slot you wil...

Page 128: ... adapter Ê Open the blue PCI X retaining bar by lifting the front edge Ê Push the orange adapter retention latch toward the rear of the server and open the tab The green power LED for the slot turns off Ê Remove the expansion slot cover Ê Touch the static protective package that contains the adapter to any unpainted surface on the outside of the server A C D C Tab Adapter retention latch Attention...

Page 129: ...lign it with the connector on the PCI X board Ê If necessary remove the adapter guide before installing a full length adapter see figure 30 Figure 30 Adapter guide V CAUTION When you install an adapter avoid touching the components and gold edge connectors on the adapter Make sure that the adapter is correctly seated in the connector Incorrectly seated adapters might cause damage to the I O board ...

Page 130: ...oling to comply with applicable EMC regulations regulations on electromagnetic compatibility and to protect against fire I Only PCI PCI X adapters of the same type and with the same settings may be replaced If the adapters do not match the new adapter will not be commissioned Ê Slide the server out of the rack until the slide rails lock into place Ê Remove the server cover see Removing the Cover o...

Page 131: ...Power Interface ANSI American National Standards Institute ASR R Automatic Server Reconfiguration and Restart BBU Battery Backup Unit BIOS Basic Input Output System BIST Built in Self Test BMC Baseboard Management Controller BTU British Thermal Unit CC Cache Coherency CD Compact Disk CD ROM Compact Disk Read Only Memory ...

Page 132: ...entary Metal Oxide Semiconductor COM Communications CPLD Complex Programmable Logic Device CPU Central Processing Unit DASD Direct Access Storage Device DC Direct Current DIMM Dual Inline Memory Module DIP Dual Inline Package DMA Direct Memory Access DMI Desktop Management Interface DVD Digital Versatile Disk ECC Errror Checking and Correcting ECP Extended Capabilities Port ...

Page 133: ...onic Industries Alliance EMC Electromagnetic Compatibility EMP Emergency Management Port EPP Enhanced Parallel Port EPROM Erasable Programmable Read Only Memory ESD ElectroStatic Discharge FAT File Allocation Table FPC Front Panel Controller FRU Field Replaceable Unit FSB Front Side Bus GAM Global Array Manager GUI Graphical User Interface ...

Page 134: ...p Controller HU Height Unit I C Inter Integrated Circuit I O Input Output ICM Intelligent Chassis Management ID Identification IDE Integrated Drive Electronics IEC International Electrotechnical Commission IME Integrated Mirroring Enhanced IPMI Intelligent Platform Management Interface IRQ Interrupt Request Line IXA Internet Exchange Architecture LAN Local Area Network ...

Page 135: ...iode LP Low Profile LUN Logical Unit Number LVD Low Voltage Differential SCSI MRL Manual Retention Latch MMF Multi Mode Faser NMI Non Maskable Interrupt NTFS New Technology File System NVRAM Non Volatile Random Access Memory OS Operating System PAM Promise Array Management PCI Peripheral Component Interconnect ...

Page 136: ...re Analysis PHY Physical Layer Protocol Physical Layer Device POST Power ON Self Test PS 2 Personal System 2 PSU Power Supply Unit PXE Preboot Execution Environment RAID Redundant Arrays of Independent Disks RAM Random Access Memory RoHS Restriction of the Use of Certain Hazardous Substances Waste from Electric and Electronic Equipment EU Directive ROM Read Only Memory RoMB RAID on Mother Board RS...

Page 137: ...ched SCSI SATA Serial Advanced Technology Attachment SBE Single Bit Error SCA Single Connector Attachment SCSI Small Computer System Interface SCU System Configuration Utility SDR Sensor Data Record SDRAM Synchronous Dynamic Random Access Memory SEL System Event Log S M A R T Self Monitoring Analysis and Reporting Technology SMI System Management Interrupt ...

Page 138: ...Symmetrical Multiprocessor SP Service Processor SPD Serial Presence Detect SSU System Setup Utility SVGA Super Video Graphics Adapter UPS Uninterruptible Power Supply USB Universal Serial Bus VGA Video Graphics Adapter VPD Vital product data WEEE Waste from Electric and Electronic Equipment EU Directive WOL Wakeup on LAN ZCR Zero Channel RAID ...

Page 139: ... showing the online documen tation available on the Internet can be found via the URL http manuals fujitsu siemens com choose industry standard servers 1 Safety Technical Manual 2 Ergonomics Technical Manual 3 Warranty Technical Manual 4 PRIMERGY RX800 S2 Options Guide 5 Quickstart Hardware PRIMERGY RX800 S2 Poster 6 Quickstart Software PRIMERGY ServerView Suite Poster 7 PRIMERGY RX800 S2 RemoteVi...

Page 140: ...PRIMERGY RX800 S2 BA rx800s2us lit 10 PRIMERGY ServerView Suite RemoteView User Manual 11 PRIMERGY ServerView Suite ServerView S2 Server Management User Manual 12 PRIMERGY ServerView Suite ServerView Server Management User Manual 13 19 Zoll Rack 19 inch rack Technical Manual 14 DataCenter Rack Technical Manual ...

Page 141: ...ols 45 CPU options 59 D date and time setting 57 dimensions 14 documents related to this manual 3 drive defective 101 drive features 11 E electrical data 14 electromagnetic compatibility 15 23 EMC regulations 109 124 environmental conditions 15 environmental protection 26 error controls 90 display drifts 100 drive defective 101 flickering stripes on screen 99 indication 90 screen remains dark 98 s...

Page 142: ... LED amber 46 HDD status LED green 46 information light 91 LED card 92 locator light 91 operator information panel 91 power on indicator 98 power on light 47 system error light 91 information light 91 installing operating system 71 server 29 31 K keyboard port 48 L LED card 92 LED diagnostic path 6 light emitting diode LED 21 lithium battery 20 locator light 91 logs error logs 61 low voltage direc...

Page 143: ...ing 66 settings 59 S SAS configuration utility program 66 saving energy 26 scalability 4 screen error message 101 flickering stripes 99 remains dark 98 server installing 31 mounting 31 on off 51 ports 37 switches itself off error 98 transport 24 unpacking 30 ServerStart 7 ServerView 7 supported functions 8 setup advanced 58 standards 15 start options 57 startup sequence 58 sticker 26 system securi...

Page 144: ......

Page 145: ...ing Manual U41621 J Z156 1 76 Comments Suggestions Corrections Submitted by Fujitsu Siemens Computers GmbH User Documentation 33094 Paderborn Germany Fax 49 700 372 00001 email manuals fujitsu siemens com http manuals fujitsu siemens com ...

Page 146: ... cognitas Gesellschft für Technik Dokumentation mbH 2005 Pfad H GS PRIMERGY RX800 S2 BA rx800s2us nac ...

Page 147: ...ing Manual U41621 J Z156 1 76 Comments Suggestions Corrections Submitted by Fujitsu Siemens Computers GmbH User Documentation 33094 Paderborn Germany Fax 49 700 372 00001 email manuals fujitsu siemens com http manuals fujitsu siemens com ...

Page 148: ... cognitas Gesellschft für Technik Dokumentation mbH 2005 Pfad H GS PRIMERGY RX800 S2 BA rx800s2us nac ...

Page 149: ...tsu com Copyright Fujitsu Technology Solutions 2009 Hinweise zum vorliegenden Dokument Zum 1 April 2009 ist Fujitsu Siemens Computers in den alleinigen Besitz von Fujitsu übergegangen Diese neue Tochtergesellschaft von Fujitsu trägt seit dem den Namen Fujitsu Technology Solutions Das vorliegende Dokument aus dem Dokumentenarchiv bezieht sich auf eine bereits vor längerer Zeit freigegebene oder nic...

Reviews:

No comments

Brands by name

Popular brands

Load more brands