manualshive.com logo in svg

HP Integrity rx4640, User'S & Service Manual

The HP Integrity rx4640 Operation and Maintenance Manual is a comprehensive guide that empowers users to effectively operate and maintain their HP Integrity rx4640 system. This invaluable manual is available for free download at manualshive.com, ensuring easy access to essential information for optimal product performance.

Share
Download
background image

Appendix C

Utilities

Specifying SCSI Parameters

180

Operation

If specified alone, sysmode displays the system mode. If a mode is specified as a parameter, then the system 
mode is changed. This new mode takes effect immediately. The system mode is retained on successive boots. 
Interaction with sysmode in a variety of scenarios is outlined below.

Example C-18

sysmode

 Command

Shell> sysmode

System Mode: NORMAL

Shell> sysmode admin

You are now in admin mode.

Shell> sysmode service

You are now in service mode.

Shell> sysmode normal

You are now in normal mode

Specifying SCSI Parameters

The following SCSI parameters may be configured for the SCSI board:

•

SCSI ID (SCSI initiator ID)

•

Maximum data transfer rate (SCSI rate)

•

Bus  width

•

Whether the HBA is bootable (driver support)

•

Avoid bus resets (secondary cluster server)

Using the SCSI Setup Utility

Step 1.

At the EFI shell prompt, enter the following command to map the parameters for all PCI cards 
installed in the server:

info io

A list of all the devices that are installed in the HP Integrity rx4640 server and managed by EFI 
drivers is displayed. The output may look like this:

Summary of Contents for Integrity rx4640

Page 1: ...User Service Guide HP Integrity rx4640 Server Manufacturing Part Number A6961 96013 ed2 Second Edition November 2008 Copyright 2006 2008 Hewlett Packard Development Company L P ...

Page 2: ...onal warranty HP shall not be liable for technical or editorial errors or omissions contained herein Intel Pentium Intel Inside Itanium and the Intel Inside logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries Linux is a U S registered trademark of Linus Torvalds Microsoft and Windows are U S registered trademarks of Microso...

Page 3: ...ment Processor 23 Hard Disk Drives 23 Supported Operating Systems 24 2 Controls Ports and LEDs Front Panel Controls Ports and LEDs 26 Hard Disk Drive LED Indicators 27 DVD DVD R DVD RW Drives 28 Rear Panel Controls Ports and LEDs 28 Power Supply Status LEDs 29 Management Processor LAN LEDs 29 Locator LED and Button 30 Gigabit Ethernet Card LAN Ports Core I O 30 Internal Controls Ports and LEDs 31 ...

Page 4: ... DIMM Memory Extender Board Layout 49 32 DIMM Memory Extender Board Layout 50 Removing and Replacing the Processor Extender Board 52 Removing the Processor Extender Board 52 Replacing the Processor Extender Board 54 Removing and Replacing a Processor 55 Processor Load Order 55 Removing a Processor 56 Replacing a Processor 58 Removing and Replacing Hot Swap Chassis Fans 63 Removing a Hot Swap Chass...

Page 5: ...d 100 Replacing the Power Distribution Board 101 Removing and Replacing the DVD Drive 102 Removing the DVD Drive 102 Replacing the DVD Drive 103 Removing and Replacing the DVD I O Board 104 Removing the DVD I O Board 104 Replacing the DVD I O Board 106 Removing and Replacing the Display Board 107 Removing the Display Board 107 Replacing the Display Board 108 Removing and Replacing the QuickFind Di...

Page 6: ...ng System Operating Systems Supported on HP Integrity Servers 142 Configuring System Boot Options 142 Booting and Shutting Down HP UX 143 Adding HP UX to the Boot Options List 144 Standard HP UX Booting 145 Single User Mode HP UX Booting 146 LVM Maintenance Mode HP UX Booting 148 Shutting Down HP UX 148 Booting and Shutting Down HP OpenVMS 149 Adding HP OpenVMS to the Boot Options List 149 Booting...

Page 7: ...mode 179 Specifying SCSI Parameters 180 Using the SCSI Setup Utility 180 Using the Boot Configuration Menu 186 Boot From File 186 Add Boot Entry 187 Edit Boot Entry 187 Remove Boot Entry 188 BootNext Configuration 188 AutoBoot Configuration 189 Driver Configuration 189 Driver Configuration 190 Console Configuration 191 System Reset 192 Using the System Configuration Menu 193 Using the Security Con...

Page 8: ...Contents 8 ...

Page 9: ...ed Slots 75 Table 5 1 Front Control Panel LED Definitions 117 Table 5 2 Hot Swap Disk Drive LED Definitions 118 Table 5 3 DVD Drive LED Definitions 118 Table 5 4 QuickFind Diagnostic Panel LED Definitions 119 Table 5 5 I O Baseboard LEDs Buttons and Sensors 122 Table 5 6 Power Supply Status LED 123 Table 5 7 iLO MP LED Status Descriptions 124 Table 5 8 iLO MP LED Status Descriptions 124 Table 5 9 ...

Page 10: ...Tables 10 ...

Page 11: ...the Memory Extender Board 45 Figure 4 8 Inserting DIMM into Extender Board Slot 48 Figure 4 9 16 DIMM Extender Board Slot IDs 49 Figure 4 10 32 DIMM Extender Board Slot IDs 50 Figure 4 11 Opening the Processor Extender Board Latches 53 Figure 4 12 Removing and Replacing the Processor Extender Board 53 Figure 4 13 Processor Slot Locations on the Processor Extender Board 56 Figure 4 14 Removing the ...

Page 12: ...e Riser Board 96 Figure 4 40 Removing and Replacing the Hot Swap Power Supply 99 Figure 4 41 Removing and Replacing the Power Distribution Board 101 Figure 4 42 Removing and Replacing the DVD Drive 103 Figure 4 43 Removing and Replacing the DVD I O Board 105 Figure 4 44 Removing and Replacing the Display Board 108 Figure 4 45 Removing and Replacing the QuickFind Diagnostic Board 110 Figure 5 1 Fro...

Page 13: ...Figures 13 ...

Page 14: ...Figures 14 ...

Page 15: ...ersonnel This document is not a tutorial New and Changed Information in This Edition This guide has been updated as follows iLO 2 MP LAN Port link activity LED display Removing and replacing a processor deleted caution regarding dip switch information Removing an I O board dip switch information Added replacement battery part number Publishing History The publishing history below identifies the ed...

Page 16: ...g system on the server Appendix C Utilities Use this appendix for information regarding the utilities available for the server Appendix D Console Setup and Connection Use this appendix to learn about the process for setting up a console session and connecting to the server Typographic Conventions This document uses the following conventions WARNING A warning lists requirements that you must meet t...

Page 17: ...her information on HP server hardware management Microsoft Windows and diagnostic support tools in the following publications Website for HP Technical Documentation http docs hp com Server Hardware Information http docs hp com hpux hw Windows Operating System Information You can find information about administration of the Microsoft Windows operating system at the following websites among others h...

Page 18: ...om hpbooks prentice ptr_0130352128 html HP Books are available worldwide through bookstores online booksellers and office and computer stores HP Encourages Your Comments HP encourages your comments concerning this document We are committed to providing documentation that meets your needs Send errors suggestions for improvement or compliments to http docs hp com en feedback html web or http docsfee...

Page 19: ... OpenVMS The server accommodates up to 32 DIMMs and internal peripherals including two hard disk drives and a DVD Its high availability features include hot swap fans and 200 240 VAC power supplies hot plug disk drives and hot plug PCI X cards This chapter addresses the following topics Server Overview on page 20 Server Dimensions and Weight on page 21 Server Components on page 22 Supported Operat...

Page 20: ...drives accessible from the front as well as a slim line optical drive for a CD R CD RW DVD R or DVD RW There are N 1 redundant hot swappable server fans all clearly identified and easily accessible Server status indication a power switch server locator switch and LED are located in the front within the control panel access door on the bezel There is also a server locator switch and LED located on ...

Page 21: ...ed Figure 1 3 HP Integrity rx4640 Server rear view Server Dimensions and Weight Table 1 1 shows the dimensions and weight of the HP Integrity rx4640 server Table 1 1 Server Dimensions Dimensions Value Height 17 46 cm 6 87 in Width 44 cm 17 32 in Depth 63 8 cm 25 1 in Weight Unloaded 40 kg 95 lb Fully loaded 100 kg 220 lb ...

Page 22: ...tandard 184 pins 2 5V DDR 200 CL2 registered ECC 200 MHz memory bus frequency 400 MTransfers s data 12 8 GB s peak data bandwidth DIMMs loaded by quads enable interleaved mode and chip spare PCI Riser Two dedicated PCI slots LAN and SCSI Four hot plug PCI X 66 MHz 64 bit 3 3V 25W slots with shared busses and I O Slots 3 and 4 share a PCI X bus and slots 5 and 6 share a PCI X bus Two hot plug PCI X...

Page 23: ... diagnostics by BMC displayed by diagnostic panel LED IPMI protocol for communication between BMC server MP card Locator front rear LEDs Field replacement units monitoring by BMC Enhanced Server Manageability Using Management Processor LAN telnet and SSH console Web GUI Serial port for local console Serial port for modem console Duplication of console screen content across all consoles Hard Disk D...

Page 24: ...operating systems are supported on the entry class HP Integrity servers HP UX 11i Version 2 B 11 23 HP OpenVMS I64 Microsoft Windows Server 2003 Red Hat Enterprise Linux 4 SuSE Linux Enterprise Server 10 For more operating system information see Appendix B Booting the Operating System on page 141 ...

Page 25: ...and LEDs found on the front panel rear panel and internal locations of the HP Integrity rx4640 server This chapter addresses the following topics Front Panel Controls Ports and LEDs on page 26 Rear Panel Controls Ports and LEDs on page 28 Internal Controls Ports and LEDs on page 31 ...

Page 26: ...s The front panel of the HP Integrity rx4640 server provides the controls and indicators commonly used for operation Figure 2 1 Figure 2 2 and Figure 2 3 show the controls ports and LEDs on the front panel and control panel Figure 2 1 Front View with Bezel Figure 2 2 Accessing the Control Panel Control Panel ...

Page 27: ...rive LEDs Status LED The drive status LED displays green when disk power is on and is off when disk power is off Activity LED The drive activity LED is green and indicates disk drive activity This LED is controlled by the disk drive directly and turns on when a drive is accessed Figure 2 4 Hard Disk Drive LED Indicators NOTE For troubleshooting information regarding the hard disk drive LEDs see Ha...

Page 28: ...cators on page 118 Rear Panel Controls Ports and LEDs The HP server rear panel includes communication ports I O ports ac power connectors two power supply bays attention LED indicators for the hot plug PCI boards and the locator LED button Figure 2 6 shows the LEDs located on the rear panel of the HP server They include the Power supplies MP LAN 2 port Gigabit ethernet card LAN PCI slots 3 8 Figur...

Page 29: ...Power Supply Status LED Indicators on page 123 Management Processor LAN LEDs The internal Management Processor MP LAN uses an RJ 45 type connector This connector has two LEDs LAN link and LAN activity that signal status and activity Figure 2 8 shows the MP LAN LEDs and USB ports on the rear panel of the server NOTE Two versions of the iLO MP card exist for this server Depending on which version of...

Page 30: ... provided on the rear panel of the server Another single blue LED and button is on the front control panel that enables disables the locator function See Figure 2 8 for the location of the locator button Gigabit Ethernet Card LAN Ports Core I O The 2 Port core I O Gigabit ethernet card uses two RJ 45 LAN connectors These connectors have no LEDs Figure 2 9 shows the two core I O LAN ports Figure 2 ...

Page 31: ... Panel The QuickFind diagnostic panel has 58 single color LEDs and one multi color LED for temperature The LEDs are normally off The appropriate LED is turned on when an error is detected or a replacement part is required You can access the QuickFind diagnostic panel by removing the top cover See Removing the Top Cover on page 43 Figure 2 10 shows the QickFind diagnostic panel LEDs Figure 2 10 Qui...

Page 32: ...n in Figure 2 11 Figure 2 11 I O Baseboard LEDs Buttons and Sensors NOTE For a complete description of the baseboard LEDs see I O Baseboard LED Indicators on page 121 PCI attention LED 6X PCI attention button doorbell 6X PCI power LED 6X PCI attention LED 6X 3 3VSB power LED BMC reset button 12V VRM LED 3 3V VRM LED locator button LED 5V VRM LED MP soft reset button MP self test LED MP heartbeat L...

Page 33: ...On the Server This chapter provides information and procedures for powering off and powering on the server This chapter addresses the following topics Power States on page 34 Powering Off the Server on page 34 Powering On the Server on page 35 ...

Page 34: ...e server automatically powers on to the full power state Powering Off the Server Power off the server using the following methods if the server is in either the standby or full power state iLO MP PC command Power button Powering Off the Server Using the iLO MP To power off the server through the iLO MP follow these steps Step 1 Gracefully shut down the operating system See Appendix B Booting the O...

Page 35: ...e server IMPORTANT The main dc voltage is now removed from the server however ac voltage for standby power is still present in the server Step 3 Unplug all power cables from the receptacles on the rear panel of the server Powering On the Server Power on the server to full power using the following methods if the server is in the standby power state iLO MP PC command Power button Powering On the Se...

Page 36: ...he power restore feature is set to Always On through the iLO MP PR command the server may automatically power on to the full power state To manually power on the server follow these steps Step 1 Plug all power cables into the receptacles on the rear panel of the server Step 2 Press the power button to start the server Step 3 Start the operating system See Appendix B Booting the Operating System on...

Page 37: ...oving and Replacing a Processor on page 55 Removing and Replacing Hot Swap Chassis Fans on page 63 Removing and Replacing the I O Baseboard on page 66 Removing and Replacing Hot Plug PCI X Cards on page 71 Removing and Replacing OLX Dividers on page 81 Removing and Replacing Core I O Cards on page 85 Removing and Replacing the Server Battery on page 89 Removing and Replacing Hard Disk Drives on pa...

Page 38: ...sociated assemblies while working inside the unit Serious injury may result if this warning is not observed Service Tools Required Service of this product may require one or more of the following tools Electrically conductive field service kit P N 9300 1155 1 4 inch flat blade screwdriver ACX 15 torx screwdriver ACX 25 torx screwdriver Accessing a Rack Mounted Server The HP Integrity rx4640 server...

Page 39: ... Torx Screws Step 2 Flip out the two pull handles at either end of the front bezel and slowly pull the unit forward by the handles The server is fully extended when the rail clips are locked in place When fully extended the front and top covers are fully accessible Figure 4 1 Accessing 25MM Torx Screws Inserting the Server into the Rack To insert the server into the rack follow these steps Step 1 ...

Page 40: ...m the HP server to gain access to internal components The front bezel front cover and top cover may be removed with the pedestal attached to the HP server WARNING Ensure that the HP server is properly grounded when performing remove and replace procedures Use an antistatic wrist strap and grounding mat similar to those found in the HP Electrically Conductive Field Service Kit Figure 4 2 Pedestal M...

Page 41: ...e 4 3 shows how to remove the front bezel Figure 4 3 Removing and Replacing the Front Bezel Removing the Front Bezel To remove the front bezel perform the following step Step 1 Grasp the front bezel at the outer edges and pull straight out Replacing the Front Bezel To replace the front bezel perform the following step Step 1 Push the front bezel straight into the chassis until it snaps into place ...

Page 42: ...ced at the end of the operation the chassis fans return to normal speed Figure 4 4 Removing and Replacing the Front Cover Removing the Front Cover To remove the front cover follow these steps Step 1 If rack mounted slide the HP server out from the rack until it stops See Extending the Server from the Rack on page 39 Step 2 Remove the front bezel See Removing the Front Bezel on page 41 Step 3 Using...

Page 43: ...t bezel See Replacing the Front Bezel on page 41 Step 4 If rack mounted slide the HP server into the rack until it stops See Inserting the Server into the Rack on page 39 Removing the Top Cover To remove the top cover follow these steps Step 1 If rack mounted slide the HP server out from the rack until it stops See Extending the Server from the Rack on page 39 Figure 4 5 Removing and Replacing the...

Page 44: ... all power sources have been disconnected from the server prior to removing or replacing a memory extender board Voltages are present at various locations within the server whenever an ac power source is connected This voltage is present even when the main power switch is in the off position Failure to observe this warning could result in personal injury or damage to equipment CAUTION Observe all ...

Page 45: ...shows how to unlatch the memory extender board Figure 4 6 Opening the Memory Extender Board Latches Step 5 Pull on the extraction levers to unplug the memory extender board from the socket located on the midplane riser board and remove the memory extender board from the chassis Figure 4 7 shows how to remove the memory extender board from the server Figure 4 7 Removing and Replacing the Memory Ext...

Page 46: ... HP server into the rack until it stops See Inserting the Server into the Rack on page 39 Removing and Replacing Server Memory DIMMs Use these procedures to remove and replace server memory DIMMs server memory DIMMs are located on the memory extender board WARNING Ensure that the server is powered down and all power sources have been disconnected from the server prior to removing or replacing serv...

Page 47: ...like sized DIMMs in the next available quad DIMMs must be loaded in quads with qualified modules Memory is protected by data ECC and the hardware implementation supports chip spare Supported DIMM Sizes Supported DIMM sizes are 256 MB 512 MB 1 GB 2 GB or 4 GB Dissimilar DIMM sizes may be used across the entire extender board but all four DIMMs in each quad must match For cooling purposes DIMM fille...

Page 48: ...ce the front cover See Replacing the Front Cover on page 43 Step 5 Replace the front bezel See Replacing the Front Bezel on page 41 Step 6 If rack mounted slide the HP server into the rack until it stops See Inserting the Server into the Rack on page 39 Figure 4 8 Inserting DIMM into Extender Board Slot ...

Page 49: ... DIMM memory extender board Figure 4 9 shows the slot locations on the 16 DIMM extender board Figure 4 9 16 DIMM Extender Board Slot IDs Table 4 1 details the quads on the 16 DIMM memory extender board Table 4 1 Quads on the 16 DIMM Memory Extender Board Quad Slots Quad 0 Slots 0A 0B 0C 0D Quad 1 Slots 1A 1B 1C 1D Quad 2 Slots 2A 2B 2C 2D Quad 3 Slots 3A 3B 3C 3D 0C 0D 2C 2D 2A 2B 0B 0A 3B 3A 1B 1...

Page 50: ...tender board Figure 4 10 32 DIMM Extender Board Slot IDs Table 4 2 DIMM Filler Requirements for 16 DIMM Extender Board 16 DIMM Extender Board DIMMs Loaded Fillers Requireda a One DIMM filler board covers two adjacent DIMM slots 4 DIMMs in quad 0 6 fillers total 2 fillers in quads 1 2 and 3 all quads filled 8 DIMMs in quads 0 and 1 4 fillers total 2 fillers in quads 2 and 3 all quads filled 12 DIMM...

Page 51: ...32 DIMM Extender Board 32 DIMM Extender Board DIMMs Loaded Fillers requireda a One DIMM filler board covers two DIMM adjacent slots 4 DIMMs in quad 0 12 fillers total 2 fillers in quads 1 3 4 5 6 and 7 quad 2 remains unfilled 8 DIMMs in quads 0 and 1 8 fillers total 2 fillers in quads 4 5 6 and 7 quads 2 and 3 remain unfilled 12 DIMMs in quads 0 1 and 2 8 fillers total 2 fillers in quads 4 5 6 and...

Page 52: ...ning could result in personal injury or damage to equipment CAUTION Failure to properly complete the steps in this procedure will result in erratic server behavior or server failure For assistance with this procedure contact your local HP Authorized Service Provider Observe all ESD safety precautions before attempting this procedure Failure to follow ESD safety precautions could result in damage t...

Page 53: ...r board Figure 4 11 shows how to open the processor extender board latches Figure 4 11 Opening the Processor Extender Board Latches Step 5 Pull out on the extraction levers to unplug the processor extender board from the socket located on the midplane riser board Figure 4 12 shows how to remove the extender board from the server Figure 4 12 Removing and Replacing the Processor Extender Board ...

Page 54: ...guides Step 3 Slide the processor extender board down until it begins to seat in the socket located on the midplane riser board Step 4 Push the extraction levers inward to the locked position in order to fully seat the processor extender board into the socket on the midplane riser board Step 5 Replace the front cover See Replacing the Front Cover on page 43 Step 6 Replace the front bezel See Repla...

Page 55: ...This voltage is present even when the main power switch is in the off position Failure to observe this warning could result in personal injury or damage to equipment Processor Load Order Processor modules are housed on the processor extender board located under the top cover in the top service bay The processor extender board can hold between one and four processor modules CPU 0 and CPU 1 are loca...

Page 56: ...cedure is CPU 1 This procedure applies to all the processors on the processor extender board Step 1 If rack mounted slide the HP server out from the rack until it stops See Extending the Server from the Rack on page 39 Step 2 Remove the front bezel See Removing the Front Bezel on page 41 Step 3 Remove the front cover See Removing the Front Cover on page 42 Step 4 Remove the processor extender boar...

Page 57: ...s that attach the sequencer frame on the heatsink in the order specified in Figure 4 14 until the sequencer frame is free Figure 4 14 Removing the Processor Sequencer Step 6 Remove the sequencer frame from the heatsink Step 7 Unplug the processor power cable from its socket on the extender board 3 4 5 6 2 1 Sequencer Shoulder screws Processor power cable ...

Page 58: ...ocessor extender board and place in an antistatic bag Replacing a Processor To install a processor on the extender board perform the following steps If you have already removed the processor extender board from the server proceed to step 6 CAUTION Ensure that the cache size is identical for all processors Failure to observe this caution will result in server failure Ensure that all processors are ...

Page 59: ...tatic wrist strap place the extender board on a grounding mat Electrically Conductive Field Service Grounding Kit HP 9300 1155 Step 6 Ensure the cam on the processor socket lock is in the unlocked counterclockwise position Figure 4 16 shows the CPU 1 ZIF socket in the unlocked position Figure 4 16 CPU 1 Socket Unlocked Step 7 Carefully lower the processor without the sequencer clamp onto the proce...

Page 60: ...r hand you should feel little or no sideplay However because the assembly is not yet tightened it may tilt slightly towards the center of the extender board this is acceptable CAUTION Before locking the processor assembly into its socket ensure that the power cable is not pinched between the heatsink and sheet metal frame of the extender board See Figure 4 17 for the correct placement of the proce...

Page 61: ...ys flush and level to the socket while it is being tightened Figure 4 18 Locking the Processor to the Processor Extender Board Step 10 Plug in the processor cable to its socket on the extender board Step 11 Place the sequencer frame over the processor Step 12 Using the ACX 15 torx screwdriver tighten the six shoulder screws until they just bottom out Follow the tightening sequence shown in Figure ...

Page 62: ...ing a Processor 62 CAUTION Do not overtighten the six shoulder screws they may shear off if overtightened Stop tightening the shoulder screws when you feel them just bottom out Figure 4 19 Installing Sequencer on Extender Board 1 2 3 4 5 6 Sequencer Shoulder screws ...

Page 63: ...d result in damage to the server CAUTION When the server is running the top cover must be replaced within two minutes to prevent components from overheating If the top metal cover is not replaced within five minutes the server automatically shuts down NOTE A hot swap device does not require interaction with the operating system before the device is removed from or installed into the server The ac ...

Page 64: ...the fan unit locking handle tilt it up and pull out the fan from the chassis Figure 4 20 Removing and Replacing the Chassis Fans 0 and 1 NOTE When one fan unit is removed from the server the remaining fan units operate at full speed for two minutes After two minutes the server goes into soft shutdown mode ...

Page 65: ...g the appropriate icon on the fan unit handle to the identical icon on the chassis wall Fan units 0 and 1 have triangle icons and fan unit 2 has a square icon Step 2 Push the fan unit firmly into the housing and close the handle until flush to the top of the chassis the fan unit plugs into the power outlet on the I O baseboard CAUTION If the fan unit handle does not close completely it is misalign...

Page 66: ...er source is connected This voltage is present even when the main power switch is in the off position Failure to observe this warning could result in personal injury or damage to equipment CAUTION Failure to properly complete the steps in this procedure results in erratic server behavior or server failure For assistance with this procedure contact your local HP Authorized Service Provider Observe ...

Page 67: ... match each cable with its appropriate socket on the SCSI HBA If the cables are mismatched your server may not reboot Both cables and sockets are clearly marked with the correct channel Step 6 Lift up on the locking lever attached to the side of the Power Supply cage to unplug the I O baseboard from the socket on the midplane riser board Figure 4 22 shows the locking lever Figure 4 22 I O Baseboar...

Page 68: ...chassis Figure 4 23 shows how to remove the I O baseboard NOTE The I O baseboard assembly is large so be careful when lifting it out of the server Figure 4 23 Removing the I O Baseboard Replacing the I O Baseboard To replace the I O baseboard follow these steps Step 1 Depending on the type of processor you have installed set the I O baseboard dip switch SW1503 position 4 Figure 4 24 as follows Ita...

Page 69: ...gainst the midplane riser board socket CAUTION Ensure the I O baseboard locking lever is in the up position or the I O baseboard hangs up before engaging the midplane riser board socket Step 3 With the I O baseboard flush against the midplane riser board socket push down firmly on the locking lever until the I O baseboard plugs all the way into the midplane riser board socket Step 4 Replace the th...

Page 70: ... the Rack on page 39 Step 9 Power up and boot to EFI Step 10 Respond YES to prompts regarding copying information onto the new I O baseboard Step 11 Enter SERVICE mode Shell sysmode service Current System Mode ADMIN You are now in SERVICE mode Step 12 Use the sysset command to enter the product data Shell sysset prodname server rx4640 Step 13 Use the sysset command to verify all values are set She...

Page 71: ...age 77 Online Addition OL A You can install new PCI X expansion cards in previously empty slots without powering down the server Online Replacement OL R You can replace a previously occupied slot with a new PCI X expansion card by suspending the driver This operation combines removing an active card and replacing it with an equivalent capability card The existing driver for the old card must be co...

Page 72: ... available through the command line or web interface Windows Server 2003 Enterprise Edition Windows Server 2003 Enterprise Edition supports only OL A and OL D hot plug PCI X operations In OL D Windows Server 2003 Enterprise Edition will delete the device object after the card s successful removal from the slot You do not have to re install drivers for the deleted device on subsequent insertions or...

Page 73: ...3 Enterprise Edition Linux Red Hat Enterprise Advanced Server 4 Update 3 Hardware interface comprised of Attention Button Manual Retention Latch Power LED Attention LED PCI X card lock Yes Yes No Graphical User Interface Yes Yes You can use the Safely Remove Hardware icon in the tool tray or device manager to remove a device OL D OL A is only possible through the hardware interface No Command Line...

Page 74: ...ill be rejected If the new card has a faster capability than the current bus configuration it will only run at the bus mode and frequency of the current bus configuration slower 1 If you have a 66 MHz card in slot 3 and you hot plug insert a 33 Mhz card into slot 4 then the operation will not succeed The new 33 MHz card will not initialize and the slot will power down because you cannot change bus...

Page 75: ...nt PCI Bus Mode and Frequency for the Shared Slot Cards to be installed PCI 33 PCI 66 PCI X 66 PCI X 133 PCI 33 MHz Compatibleb b Compatible card is accepted and runs at frequency shown Compatible note b New card running at PCI 33 Compatible note b New card running at PCI 33 Compatible note b New card running at PCI 33 PCI 66 MHz Incompatible Frequencyc c Incompatible Frequency card is rejected Th...

Page 76: ...slots on your HP Integrity rx4640 server Server power limitations restrict the use of more than 3 RAID cards per server Figure 4 25 Slot ID Numbering PCI X Bus 1 PCI X Bus 2 PCI X Bus 3 PCI X Bus 4 PCI X Bus 5 Slot ID Number Amber attention LEDs 6x Green power LEDs 6x Amber attention LEDs 6x 1 2 3 4 5 6 7 8 Core I O PCI X Public I O PCI X Hot Plug ...

Page 77: ...hassis See Removing the Top Cover on page 43 Step 3 If the power LED is steady on power to slot is on go to step 4 If the power LED is steady off power to slot is off go to step 5 Step 4 To turn off power to the slot pull up on the manual retention latch MRL located on the OLX divider The power LED goes to steady off Figure 4 26 shows the layout of the card divider CAUTION Do not pull up on the MR...

Page 78: ...ration by pushing the attention button again Step 9 Replace the top cover Step 10 Push the HP server all the way back into the rack until it stops Figure 4 26 PCI X OLX Divider Layout PCI X card latch closed position Manual retention latch closed PCI X card latch open position Manual retention latch open Power LED light pipe Attention button Attention LED light pipe ...

Page 79: ...m the rack until it stops See Extending the Server from the Rack on page 39 Step 2 Remove the top cover from the chassis See Removing the Top Cover on page 43 Step 3 Press the attention button located on the OLX divider that controls the affected slot the power LED starts to blink Wait until the power LED goes from blinking to steady off NOTE After pushing the attention button you have 5 seconds t...

Page 80: ...from the chassis See Removing the Top Cover on page 43 Step 3 Press the attention button located on the OLX divider controls the affected slot the power LED starts to blink Wait until the power LED goes from blinking to steady off NOTE After pushing the attention button you have 5 seconds to cancel the operation by pushing the attention button again Step 4 Turn the PCI X card lock on the chassis u...

Page 81: ...low the LED status to be easily viewed when the top cover is removed WARNING Ensure that the server is powered down and all power sources have been disconnected from the server prior to removing or replacing a PCI card divider Voltages are present at various locations within the server whenever an ac power source is connected This voltage is present even when the main power switch is in the off po...

Page 82: ...2 Step 3 Remove the top cover See Removing the Top Cover on page 43 Step 4 Slide open the latch on the rear PCI cage wall to unlock the rear edge of the PCI divider Figure 4 28 shows how to open the OLX divider latch Figure 4 28 Opening and Closing the OLX Divider Latch CLOSED OPEN ...

Page 83: ... removing the entire OLX divider rack remove the four T15 fasteners holding the rack to the I O baseboard Step 7 Using your fingers push the two tabs that attach the OLX divider to the I O baseboard and pull the OLX divider up sharply to disengage it from the I O baseboard CAUTION When extracting the OLX divider ensure that you release the locking tabs completely or you may damage them If you dama...

Page 84: ... the I O baseboard replace the four torx T15 fasteners Step 3 Slide the latch on the rear OLX divider wall closed to lock the rear edge of the PCI divider Figure 4 28 shows how to close the OLX divider latch Step 4 Push down on the manual retention latch until it locks into the chassis wall Step 5 Replace the top cover See Replacing the Top Cover on page 44 Step 6 Replace the front bezel See Repla...

Page 85: ... on the I O baseboard PCI Slot Locations and Configurations The following describes configuration requirements for slots 1 and 2 PCI slot 1 is dedicated for use by a SCSI HBA card Slot 1 is not hot plug capable Additional PCI expansion cards may not be placed in slot 1 PCI slot 2 is dedicated for use by a LAN card Slot 2 is not hot plug capable Additional PCI expansion cards may not be placed in s...

Page 86: ...n cards may not be placed in slot 1 PCI slot 2 is dedicated for use a LAN card Slot 2 is not hot plug capable Additional PCI expansion cards may not be placed in slot 2 Removing the SCSI Core I O Card To remove the SCSI core I O card in slot 1 follow these steps Step 1 If rack mounted slide the HP server out from the rack until it stops See Extending the Server from the Rack on page 39 Step 2 Remo...

Page 87: ...ard Ensure that you fully seat the card into the slot or the card may be damaged when power is re applied to the slot Figure 4 32 Inserting SCSI I O Card Step 7 Close the blue PCI card latch for slot 1 by twisting it counter clockwise Step 8 Reconnect the internal and external SCSI cable s to the SCSI core I O card Step 9 Replace the top cover See Replacing the Top Cover on page 44 Step 10 Push th...

Page 88: ... O Card Latch Location Step 5 Remove LAN I O card by pulling up carefully on the LAN I O card Step 6 Install replacement LAN I O card Figure 4 32 shows how to install the LAN I O card correctly CAUTION Always handle I O cards by their edges Failure to comply with this precaution may result in damage to the card Ensure that you fully seat the card into the slot or the card may be damaged when power...

Page 89: ... slide the HP server out from the rack until it stops See Extending the Server from the Rack on page 39 Step 2 Remove the top cover from the chassis See Removing the Top Cover on page 43 Step 3 Remove the I O baseboard assembly from the chassis See Removing the I O Baseboard on page 66 Step 4 Locate the battery on the I O baseboard Remove the battery by lifting the retaining clip and pull the batt...

Page 90: ...ot support this feature shut down the operating system before attempting this procedure Failure to observe this caution results in server failure NOTE The replacement disk drive must be the same product ID as the disk drive that is being replaced HP often uses different manufacturers for disks that have the same product number Since they have the same product number the replacement disk drive has ...

Page 91: ... Close the drive ejector handle by pushing it down until it clicks Step 3 The hot plug disk drive is now correctly installed Figure 4 35 Hard Disk Drive and Slot Locations on the Front of the Server Figure 4 36 Removing and Replacing a Hard Disk Drive in Slot 2 Slot 2 SCSI ID 1 Slot 1 SCSI ID 0 ...

Page 92: ...isk Drives 92 NOTE If you are only removing a hard disk drive and not replacing it with another one you must install a volume filler into the empty slot Figure 4 37 shows how to install a volume filler in slot 2 of the server Figure 4 37 Installing a Volume Filler in Slot 2 ...

Page 93: ...dure Failure to follow ESD safety precautions could result in damage to the server Removing the SCSI Backplane Board To remove the SCSI backplane follow these steps Step 1 If rack mounted slide the HP server out from the rack until it stops See Extending the Server from the Rack on page 39 Step 2 Remove the front bezel See Removing the Front Bezel on page 41 Step 3 Remove the front cover See Remov...

Page 94: ...ive cage See Replacing a Hard Disk Drive on page 90 Step 3 Plug in the SCSI backplane to midplane cable back into the SCSI backplane Step 4 Plug in the internal SCSI cable into the SCSI back plane Step 5 Replace the processor extender board See Replacing the Processor Extender Board on page 54 Step 6 Replace the memory extender board See Replacing the Memory Extender Board on page 46 Step 7 Replac...

Page 95: ...sult in damage to the server Removing the Midplane Riser Board To remove the midplane riser board follow these steps Step 1 If rack mounted slide the HP server out from the rack until it stops See Extending the Server from the Rack on page 39 Step 2 Remove the front bezel See Removing the Front Bezel on page 41 Step 3 Remove the front cover See Removing the Front Cover on page 42 Step 4 Remove the...

Page 96: ...screws attaching the midplane riser board to the chassis Step 14 Grasp the top edge of the midplane riser board and lift straight up to release it from the keyway slots on the chassis Then pull straight out and up to remove the midplane riser board from the chassis Figure 4 39 shows how to remove the midplane riser board Figure 4 39 Removing and Replacing the Midplane Riser Board 2 4 1 5 3 Midplan...

Page 97: ... the power distribution board power cable and signal cable to the midplane riser board Step 6 Replace the SCSI backplane board See Replacing the SCSI Backplane Board on page 94 Step 7 Replace the I O baseboard assembly See Replacing the I O Baseboard on page 68 Step 8 Replace the three chassis hot swap fan units See Replacing a Hot Swap Chassis Fan Unit on page 65 Step 9 Replace the processor exte...

Page 98: ...Each PSU requires a separate power cord The left side viewing from the rear hot swap PSU is identified as P 0 the second hot swap power supply is identified as P 1 Each hot swap PSU requires a separate power cord be installed in the appropriate power cord receptacle and attached to a power cord support bracket CAUTION The empty hot swap PSU slot P 1 must remain closed with the supplied metal cover...

Page 99: ...pply Step 1 Supporting the PSU with both hands slide it into the empty slot until it plugs into the socket on the internal power distribution board Tighten the thumbscrew hand tight Step 2 Install the power cord into the PSU socket Step 3 Apply power to the new PSU and the LED should immediately turn on Step 4 If rack mounted slide the HP server back into the rack until it stops Inserting the Serv...

Page 100: ...perly complete the steps in this procedure results in erratic server behavior or server failure For assistance with this procedure contact your local HP Authorized Service Provider Observe all ESD safety precautions before attempting this procedure Failure to follow ESD safety precautions could result in damage to the server Removing the Power Distribution Board To remove the power distribution bo...

Page 101: ...he keyway slots and push it towards the side of the chassis to lock it onto the studs Step 2 Reattach the power distribution board to the chassis bulkhead by replacing the one torx 15 screw Tighten hand tight Step 3 Plug the power and signal cables back into the midplane riser board Step 4 Replace the hot swap power supply s into the chassis See Replacing a Hot Swap Power Supply on page 99 Step 5 ...

Page 102: ...n when the main power switch is in the off position Failure to observe this warning could result in personal injury or damage to equipment CAUTION Failure to properly complete the steps in this procedure will result in erratic server behavior or server failure For assistance with this procedure contact your local HP Authorized Service Provider Observe all ESD safety precautions before attempting t...

Page 103: ...2 Removing and Replacing the DVD Drive Replacing the DVD Drive To replace a DVD drive follow these steps Step 1 Grasp the front of the DVD drive and squeeze in on the locking tab to release the drive Step 2 Push the drive straight into the drive bay until the locking tab clicks into place Figure 4 42 shows how to replace the DVD drive Step 3 Replace the front bezel See Replacing the Front Bezel on...

Page 104: ...te the steps in this procedure results in erratic server behavior or server failure For assistance with this procedure contact your local HP Authorized Service Provider Observe all ESD safety precautions before attempting this procedure Failure to follow ESD safety precautions could result in damage to the server Removing the DVD I O Board To remove the DVD I O board follow these steps Step 1 If r...

Page 105: ...over plate to the chassis and remove the cover plate Figure 4 43 Removing and Replacing the DVD I O Board Step 8 Unfasten the release clip attaching the DVD I O board to the chassis and remove the I O board from the chassis Step 9 Lift out the DVD I O board and remove the midplane riser board connector cable and remove the DVD I O board from the chassis Cover DVD I O board ...

Page 106: ...e using the two torx 15 screws and a torx 15 driver Step 4 Replace the processor extender board See Replacing the Processor Extender Board on page 54 Step 5 Replace the memory extender board See Replacing the Memory Extender Board on page 46 Step 6 Replace the top cover See Replacing the Top Cover on page 44 Step 7 Replace the front cover See Replacing the Front Cover on page 43 Step 8 Replace the...

Page 107: ...position Failure to observe this warning could result in personal injury or damage to equipment CAUTION Failure to properly complete the steps in this procedure will result in erratic server behavior or server failure For assistance with this procedure contact your local HP Authorized Service Provider Observe all ESD safety precautions before attempting this procedure Failure to follow ESD safety ...

Page 108: ...ing the Display Board To replace the display board follow these steps Step 1 Gently plug in the midplane riser board cable into the display board Step 2 Hold the display board in position near the chassis and rotate it into the retaining clip until it clicks into place Step 3 Replace the front cover Replacing the Front Cover on page 43 Step 4 Replace the front bezel Replacing the Front Bezel on pa...

Page 109: ...lt in personal injury or damage to equipment CAUTION Failure to properly complete the steps in this procedure will result in erratic server behavior or server failure For assistance with this procedure contact your local HP Authorized Service Provider Observe all ESD safety precautions before attempting this procedure Failure to follow ESD safety precautions could result in damage to the server Re...

Page 110: ...e QuickFind Diagnostic Board To replace the QuickFind diagnostic board follow these steps Step 1 Gently plug the cable into the QuickFind diagnostic board connector Step 2 Replace the QuickFind diagnostic board into the cover by snapping it into place Step 3 Turn the assembly over and snap into place on top of the power supply cage Step 4 Replace the top cover See Replacing the Top Cover on page 4...

Page 111: ... for the HP Integrity rx4640 server This chapter addresses the following topics Troubleshooting Tips on page 112 Possible Problems on page 113 Troubleshooting Using LED Indicators on page 116 Diagnostics on page 128 Recommended Cleaning Procedures on page 131 Where to Get Help on page 132 ...

Page 112: ... Methodology Step 1 This is the entry point to the troubleshooting process Here you pick from a set of symptoms ranging from very simple server LED is blinking to the most difficult Machine Check Abort MCA has occurred The following is a list of symptom examples Server LED blinking System Alert present on console Server will not power up Server will not boot Event Error Message received Machine Ch...

Page 113: ...perating The fans will operate off the dc voltage generated by the power supply Step 5 Check that the Power LED on Front Control Panel is illuminated See Front Control Panel LED Indicators on page 117 Step 6 Check all connections from the power supply to the power distribution module Step 7 Verify that all cables and modules are correctly connected Especially check the display panel connection Ste...

Page 114: ...y by engaging the retaining latches and closing them fully Step 10 Check that the processors are installed in the correct sockets on the processor extender board See Figure 4 13 on page 56 for the correct processor load order Step 11 Verify the processors are of the same type Step 12 Check the boot order with the SCSI configuration utility Step 13 Check the switch settings on the I O baseboard The...

Page 115: ... turn the server back on to see if the failure can be cleared Step 5 Make sure that all boards are installed properly and the processors are installed in the correct slot They must be seated firmly in their slots and any cables must be connected firmly Step 6 If the server stopped working after you installed a new board remove the board and turn on the server If your server now works check the ins...

Page 116: ... The server should have at least three inches of space around the front and rear for proper airflow when installed in a rack NOTE Temperature problems may be caused by a fluctuating power supply Step 5 Check the server specifications and make sure the environmental temperature and voltage are in the specified guidelines Step 6 Monitor the server to make sure you are not experiencing further temper...

Page 117: ...rver Attention Flashing at 1 Hz Yellow Flashing yellow Warning server needs attention Redundancy lost component failure pending Server Fault Flashing at 2 Hz Red Flashing red hard fault server halted Server Off Off N A Off server off Power On Steady Green Green power normal Power On Steady Yellow Flashing yellow Housekeeping voltage present Power Off Off Off Off Power off Disk LED Flashing at rate...

Page 118: ... and turns on when a drive is accessed Figure 5 2 Hot Swap Disk Drive LED Indicators DVD DVD R DVD RW Drive LED Indicators The HP server is delivered with one DVD RM drive DVD R and DVD RW optional Each of these devices has one activity LED as shown and described in Figure 5 3 and Table 5 3 Figure 5 3 DVD ROM Drive Table 5 2 Hot Swap Disk Drive LED Definitions LED Color Description Status LED Gree...

Page 119: ...component Figure 5 4 QuickFind Diagnostic Label Table 5 4 QuickFind Diagnostic Panel LED Definitions Item LED 0 LED 1 LED 2 LED3 Details Processor Socket 0 Socket 1 Socket 2 Socket 3 If the Server LED on front panel is in the attention or fault state and the processor LED is on then the processor or voltage regulator has failed the processor module in the specified socket needs to be replaced If t...

Page 120: ...Ms in the specified rank are mismatched replace mismatched DIMM Check Power Supply n a n a n a One of the power supply or power supply fans have failed replace the power supply The faulty power supply LED located on Power supply will be lit Memory Config Error n a n a n a The DIMMs in a rank are mismatched All the DIMMs in the specified rank 0 7 will be lit Processor Config Error n a n a n a The p...

Page 121: ...eboard Table 5 5 describes the status of the various LEDs on the I O baseboard Figure 5 5 I O Baseboard LEDs Buttons and Sensors PCI Attention LED 6X PCI Attention Button Doorbell 6X PCI Attention LED 6X 3 3VSB Power LED 12V VRM LED 3 3V VRM LED 5V VRM LED MP Heartbeat LED Battery BMC Reset Button MP Soft Reset Button MP Self Test LED BMC Heartbeat LED Locator Button LED PCI Power LED 6X ...

Page 122: ...n 3 3 V VRM is functioning iLO MP Heartbeat Green Blinking The management processor is functioning correctly iLO MP Self Test LED Amber On Off The management processor is executing the internal self test The management processor has passed the internal self test BMC Heartbeat Green Blinking The baseboard management controller is functioning correctly 3 3 VSB Power LED Green On Standby power is ava...

Page 123: ...AN activity that signal status and activity Two versions of the iLO MP card exist for this server Depending on which version of the card is installed in the server the iLO MP LAN port LEDs display differently Table 5 6 Power Supply Status LED Power LED Green Predict Fail LED Amber Fail LED Amber Status Off Off Off No ac power applied to all PSUs Off Off On No ac power applied to this PSU only Blin...

Page 124: ...ber Blinking Linked at 100MBps Activity present 10M green On Linked at 10MBps No activity 10M green Blinking Linked at 10MBps Activity present Table 5 8 iLO MP LED Status Descriptions LED Condition Status 100M green On Linked at 100MBps No activity 100M green Blinking Linked at 100MBps Activity present 10M amber On Linked at 10MBps No activity 100M Link Activity Amber LED 10M Link Activity Green L...

Page 125: ... on the rear panel of the server Another single blue LED and button is on the front control panel that enables disables the locator function See Figure 5 7 for the locator LED and button location 10M amber Blinking Linked at 10MBps Activity present Table 5 8 iLO MP LED Status Descriptions Continued LED Condition Status ...

Page 126: ...hat you wait the full duration of the 5 second operation cancellation window before taking further action 2 Hardware Operation Fault If the PCI X card cannot be powered on during a hot plug addition operation the attention LED turns steady on and the power LED turns steady off CAUTION If your card does not power up the power loss may be due to the existing PCI X expansion cards using all the avail...

Page 127: ...ing a hot plug removal operation the attention button turns steady on and the power LED remains steady on CAUTION If your slot does not power off during a hot plug removal operation do not open the manual retention latch MRL on the OLX divider This action may cause a server failure or an operating system crash ...

Page 128: ... Support Tool Manager STM tools and the additional Web Based Enterprise Management WBEM features added by SysFaultMgmt The STM suite of tools includes verifiers diagnostics exercisers information modules and expert tools Verifiers quickly determine whether or not a specific device is operational by performing tasks similar in nature to the way applications use the device No license is required to ...

Page 129: ... the HP website Offline Support Tools List The following offline support tools are available Table 5 10 Online Support Tools List Functional Area Information Verify Exercise Diagnose Expert System Yes No No No No CPU FPU No No Yes No Yes Memory Yes No Yes No No Graphics Yes Yes Yes No No Core I O LAN Yes Yes Yes Yes No Disk Arrays Yes Yes Yes No No Tape Yes Yes Yes Yes Yes M O Yes No No No Yes Add...

Page 130: ...ders as well as by the Event Management Service EMS The Event Management Service and WBEM provide frameworks for monitoring and reporting events SysFaultMgmt WBEM indication providers and the EMS Hardware Monitors allow users to monitor the operation of a wide variety of hardware products and alert them immediately if any failure or other unusual event occurs By using hardware event monitoring use...

Page 131: ...n off power to the server when cleaning it Table 5 13 details the components and procedures that need cleaning for the server CAUTION DO NOT use petroleum based cleaners such as lighter fluid or cleaners containing benzene trichlorethylene ammonia dilute ammonia or acetone These chemicals could damage all plastic and painted surfaces Table 5 13 Cleaning Component Time Frame Procedure Keyboard Regu...

Page 132: ...tep 2 Collect the following information The model number of your server for example rx4640 The product number of your server This can be found on the identification label which is found on the pull tab at the front of the server The serial number of your server This can be found on the identification label Step 3 Be familiar with your server configuration Are you using the LAN RS 232 or web interf...

Page 133: ...the field The following information is available on this HP website Software and firmware updates The latest drivers and utilities Additional documentation Phone Support To contact HP customer support by phone go to the HP IT Resource Center ITRC near you at http www itrc hp com Local phone numbers are listed in your native language for help ...

Page 134: ...Chapter 5 Troubleshooting Where to Get Help 134 ...

Page 135: ...mation This appendix provides server part information such as Description Manufacturing part number Replacement part number Exchange part number This appendix addresses the following topics Field Replaceable Parts List on page 136 ...

Page 136: ...essor Extender RoHS A6961 60207 A6961 67207 A6961 69207 PCA I O baseboard includes VRMs A6961 60201 A6961 67401 A6961 69401 PCA I O baseboard includes VRMs RoHS A6961 60401 A6961 67501 A6961 69501 PCA I O baseboard includes VRMs RoHS dual core processors only A6961 60401 A6961 67411 A6961 69511 PCA 16 slot Memory Board A6961 60204 A6961 67204 A6961 69204 PCA 16 slot Memory Board RoHS A6961 60804 A...

Page 137: ...D041A AB475 69001 Internal disks removable media 36 GB 15K RPM SCSI Disk A6981A AB420 2101A AB420 2101A AB420 69001 73 GB 15K RPM SCSI Disk A6983A AB421 2101A AB421 2101A AB421 69001 146 GB 10K RPM SCSI Disk A6984A AB422 2101A AB422 2101A AB422 69001 300 GB 10K RPM SCSI Disk A6984A AB423 2101A AB423 2101A AB423 69001 DVD R CD R Drive A7163 2100A A7163 67002 n a DVD R CD RW Drive AB349 2100A AB349 ...

Page 138: ... Amer 250 V Japan 8121 0875 n a Power Cord Israel 8120 6800 n a Power Cord Argentina 8120 8390 n a Power Cord Chile 8120 8389 n a Power Cord China 8120 8376 n a Power Cord S America 8121 0668 n a Power Cord 8120 1351 8120 1351 C13 C14 Jumper cord 8120 6514 n a Miscellaneous Power Supply 0950 4428 A6961 67125 n a PCI Card OL Divider doorbell and latch included A6961 04047 A6961 67020 n a PCI Retent...

Page 139: ...oard Mouse 18 1 LCD Flat panel Display Prod P9021Y 303486 003 303486 003 20 LCD Flat panel Display Prod P4831Y 303102 003 303102 003 19 CRT Color Monitor Prod P9009A 302268 003 302268 003 21 CRT Color Monitor Prod P4819A 302270 003 302270 003 24 CRT Color Monitor Prod P7217A A7217 60001 A7217 60001 Serial Console Prod C1099A C1099 62000 C1099 67001 Serial Console ROM Replacement Kit Prod C1099A C1...

Page 140: ...Parts Information Field Replaceable Parts List Appendix A 140 ...

Page 141: ... B 11 23 HP OpenVMS Microsoft Windows Server 2003 Red Hat Enterprise Linux and SuSE Linux Enterprise Server This chapter addresses the following topics Operating Systems Supported on HP Integrity Servers on page 142 Configuring System Boot Options on page 142 Booting and Shutting Down HP UX on page 143 Booting and Shutting Down HP OpenVMS on page 149 Booting and Shutting Down Microsoft Windows on ...

Page 142: ...ptions list and the autoboot setting for the server Boot Options List The boot options list is a list of loadable items available for you to choose from the EFI Boot Manager menu Ordinarily the boot options list includes the EFI Shell and one or more operating system loaders The following example includes boot options for HP OpenVMS Microsoft Windows HP UX and the EFI Shell The final item in the E...

Page 143: ...artup whether a server automatically loads the first item in the boot options list or remains at the EFI Boot Manager menu When autoboot is enabled EFI loads the first item in the boot options list after a designated timeout period Configure the autoboot setting for an HP Integrity server using either the autoboot EFI Shell command or the Set Auto Boot TimeOut menu item from the EFI Boot Configura...

Page 144: ... access the EFI Shell environment Step 2 Access the EFI System Partition fsX where X is the file system number for the device from which you want to boot HP UX For example enter fs2 to access the EFI System Partition for the bootable file system number 2 The EFI Shell prompt changes to reflect the file system currently accessed The full path for the HP UX loader is EFI HPUX HPUX EFI and it should ...

Page 145: ...Enter to initiate booting using the chosen boot option Step 4 Exit the console and iLO MP interfaces when finished using them Press Ctrl B to exit the system console and return to the iLO MP Main Menu To exit the iLO MP enter X at the Main Menu Booting HP UX EFI Shell From the EFI Shell environment boot HP UX on a device by first accessing the EFI System Partition for example fs0 for the root devi...

Page 146: ...0222F0 269 Pci 0 0 Scsi Pun8 Lun0 HD Part1 Sig72550000 blk0 Acpi 000222F0 269 Pci 0 0 Scsi Pun8 Lun0 blk1 Acpi 000222F0 269 Pci 0 0 Scsi Pun8 Lun0 HD Part1 Sig72550000 blk2 Acpi 000222F0 269 Pci 0 0 Scsi Pun8 Lun0 HD Part2 Sig72550000 blk3 Acpi 000222F0 2A8 Pci 0 0 Scsi Pun8 Lun0 blk4 Acpi 000222F0 2A8 Pci 0 1 Scsi Pun2 Lun0 Shell fs0 fs0 hpux c Copyright 1990 2002 Hewlett Packard Company All righ...

Page 147: ...the HPUX EFI interface the HP UX Boot Loader prompt HPUX launches For help using the HPUX EFI loader enter the help command To return to the EFI Shell enter exit fs0 hpux c Copyright 1990 2002 Hewlett Packard Company All rights reserved HP UX Boot Loader for IA64 Revision 1 723 Press Any Key to interrupt Autoboot efi hpux AUTO boot vmunix Seconds left till autoboot 9 User Types A Key to Stop the H...

Page 148: ...UX EFI loader on the device you are accessing Step 4 Press any key within the 10 seconds given for interrupting the HP UX boot process This stops the boot process at the HPUX EFI interface the HP UX Boot Loader prompt HPUX Step 5 At the HPUX EFI interface enter the boot lm vmunix command to boot HP UX the stand vmunix kernel in LVM maintenance lm mode Step 6 Exit the console and iLO MP interfaces ...

Page 149: ...VMS see Shutting Down HP OpenVMS on page 152 Adding HP OpenVMS to the Boot Options List On HP Integrity servers you can use the following procedures to manage boot options list entries for HP OpenVMS You can add the efi vms vms_loader efi loader to the boot options list from the EFI Shell or EFI Boot Configuration menu or in some versions of EFI the Boot Option Maintenance Menu NOTE On HP Integrit...

Page 150: ...ves the item number specified by a to the position specified by b in the boot options list bcfg boot add file efi Description Adds a new boot option to the position in the boot options list specified by The new boot option references file efi and is listed with the title specified by Description For example bcfg boot add 1 efi vms vms_loader efi HP OpenVMS adds an HP OpenVMS item as the first entr...

Page 151: ...enu choose the EFI Shell menu option to access the EFI Shell environment Step 2 At the EFI Shell environment issue the map command to list all currently mapped bootable devices The bootable file systems of interest typically are listed as fs0 fs1 and so on Step 3 Access the EFI System Partition fsX where X is the file system number for the device from which you want to boot HP OpenVMS For example ...

Page 152: ...UTDOWN command and specify the shutdown options in response to the prompts given SYS SYSTEM SHUTDOWN SHUTDOWN Perform an Orderly System Shutdown on node RSNVMS How many minutes until final shutdown 0 Reason for shutdown Standalone Do you want to spin down the disk volumes NO Do you want to invoke the site specific shutdown procedure YES Should an automatic system reboot be performed NO yes When wi...

Page 153: ...em console When accessing the console confirm that you are at the EFI Boot Manager menu the main EFI menu If you are at another EFI menu choose the Exit option from the submenus until you return to the screen with the EFI Boot Manager heading From the EFI Boot Manager menu choose the EFI Shell menu option to access the EFI Shell environment Step 2 Access the EFI System Partition fsX where X is the...

Page 154: ...the EFI Boot Manager to choose the appropriate Windows item from the boot options list See Shutting Down Microsoft Windows on page 155 for details on shutting down the Windows operating system Step 1 From the EFI Boot Manager menu choose an item from the boot options list to boot Windows using the chosen boot option Step 2 Access the EFI Boot Manager menu for the server on which you want to boot W...

Page 155: ...nu or the shutdown command to shut down gracefully To shut down Windows use either of the following methods Choose Shut Down from the Start menu and choose either Restart or Shut down from the pull down menu The Restart menu item shuts down and restarts the server The Shut down menu item shuts down the server You can use this method when using a graphical interface to the server Issue the shutdown...

Page 156: ...iate options to shut down the Windows Server 2003 on the server You have the following options when shutting down Windows To shut down Windows and reboot shutdown r or choose the Start Shut Down action and choose Restart from the pull down menu To shut down Windows and halt power off server hardware shutdown s or choose the Start Shut Down action and choose Shut down from the pull down menu To reb...

Page 157: ...onfiguration menu or in some versions of EFI the Boot Option Maintenance Menu NOTE On HP Integrity servers the operating system installer automatically adds an entry to the boot options list Step 1 Access the EFI Shell environment Log in to the management processor and enter CO to access the system console When accessing the console confirm that you are at the EFI Boot Manager menu the main EFI me...

Page 158: ...rise Linux operating system on HP Integrity servers using either of these methods Choose a Red Hat Enterprise Linux entry from the EFI Boot Manager menu To load the Red Hat Enterprise Linux operating system at the EFI Boot Manager menu choose its entry from the list of boot options Choosing a Linux entry from the boot options list boots the operating system using ELILO EFI loader and the elilo con...

Page 159: ... Server 10 operating system on HP Integrity servers using either of these methods Choose a SuSE Linux Enterprise Server entry from the EFI Boot Manager menu To load the SuSE Linux Enterprise Server operating system at the EFI Boot Manager menu choose its entry from the list of boot options Choosing a Linux entry from the boot options list boots the operating system using ELILO EFI loader and the e...

Page 160: ... command to shut down Red Hat Enterprise Linux or SuSE Linux Enterprise Server The Red Hat Enterprise Linux and SuSE Linux Enterprise Server shutdown command has the following options h Halts power off after shutdown Use the PC command at the management processor Command menu to manually power on or power off server hardware as needed r Reboots after shutdown c Cancels an already running shutdown ...

Page 161: ... Integrity rx4640 server These include the EFI boot manager and EFI POSSE This appendix addresses the following topics Extensible Firmware Interface Boot Manager on page 162 EFI POSSE Commands on page 166 Specifying SCSI Parameters on page 180 Using the Boot Configuration Menu on page 186 ...

Page 162: ...ervers such as the Boot Console Handler BCH and platform firmware into a single platform firmware EFI allows the selection of any EFI OS loader from any boot medium that is supported by EFI boot services An EFI OS loader supports multiple options on the user interface EFI supports booting from media that contain an EFI OS loader or an EFI defined server partition An EFI defined server partition is...

Page 163: ...nu see Using the Boot Configuration Menu Boot From File Allows the user to explore the EFI file system and to choose a file to boot The selected file will not be added to the boot option list Add Boot Entry Adds a boot option to the EFI boot manager You select the boot option by exploring the available file systems for the EFI file you wish to add After selecting the file you will be prompted for ...

Page 164: ...omplex exit at EFI shell MAin Return to the main menu MAin EFI boot manager change boot order PAth PRI HAA ALT CON KEY path Display or modify a path bcfg SEArch ALL Search for boot devices bcfg SEArch DIsplay IPL path Search for boot devices many commands offer a b parameter to cause 25 line breaks ScRoll ON OFF Display or change scrolling capability COnfiguration autoboot AUto BOot SEarch STart O...

Page 165: ...RU information info fw FwrVersion Display firmware version for PDC ICM and complex info io IO Display firmware version for PDC ICM and complex lanaddress LanAddress Display core LAN station address info mem Memory Display memory information info cpu PRocessor Display processor information SERvice errdump clear CLEARPIM Clear zero the contents of PIM mm MemRead addr len type Read memory locations s...

Page 166: ... initiated with no parameters it displays a list of shell command categories To list all of the commands within a category the user should enter help category see examples If initiated with the b switch any output longer than one page pauses after each page is displayed If a shell command name is used as a parameter verbose help is displayed for that command If help is initiated with the bch optio...

Page 167: ... bch in PAth help bch pa ScRool help bch sr SEArch help bch sea SERvice help bch ser BOot help bch bo HElp help bch he RESET help bch reset MAin help bch ma For more help on one of the commands above at the prompt type help bch bchcmd Example C 3 help configuration Command Shell help configuration Configuration commands cpuconfig Deconfigure or reconfigure cpus date Display or set date err Display...

Page 168: ...ART is part of processor dependent hardware PDH space and is initialized by the core firmware this command communicates the settings to core firmware so the UART can be initialized with the new settings on the next boot Server default is 9600 baud Other Communication parameters are listed in Table C 2 boottest Interacts with the speedy boot variable allowing it to be set appropriately Syntax boott...

Page 169: ...fault Variable Selftest Setting booting_valid On OS speedy boot aware early_cpu Run this test late_cpu Run this test platform Run this test chipset Run this test io_hw Run this test mem_init Run this test mem_test Run this test Example C 6 boottest early_cpu off Command Shell boottest early_cpu off BOOTTEST Settings Default Variable Selftest Setting booting_valid On OS speedy boot aware early_cpu ...

Page 170: ...configure a feature or component Operation The ioconfig file is used to retain information on the server I O configuration across reboots The ioconfig file is created by insf at install time and is modified by insf rmsf and ioscan when devices are added or removed The only purpose of the ioconfig file to maintain configuration information when the system is not running Example C 8 ioconfig Command...

Page 171: ...ory NVM to default values and clear NVM storage values Syntax default efi sal default clear bmc efi sal Parameters clear clears NVM storage values Operation Default sets NVM and stable store values to predefined default values To the normal user only a subset of values are available for default Executing default clear resets the server errdump Displays the contents of processor internal memory log...

Page 172: ...ation chiprev display information on chip revisions fw display firmware version information sys display system information warning display warning and stop boot information Example C 9 info all Command Shell info all SYSTEM INFORMATION Date Time Sep 24 2004 17 27 17 20 04 09 24 17 27 17 Manufacturer hp Product Name server rx4640 Product Number AB333A Serial Number USR0418201 UUID 336B81EE A9AF 11D...

Page 173: ...60 01 00 0x1077 0x2312 02 Acpi HWP0002 300 Pci 1 0 00 60 01 01 0x1077 0x2312 02 Acpi HWP0002 300 Pci 1 1 00 80 01 00 0x1000 0x000F 01 Acpi HWP0002 400 Pci 1 0 00 80 01 01 0x1000 0x000F 01 Acpi HWP0002 400 Pci 1 1 00 C0 01 00 0x1000 0x0021 04 Acpi HWP0002 600 Pci 1 0 00 E0 01 00 0x103C 0x1290 XX Acpi HWP0002 700 Pci 1 0 00 E0 01 01 0x103C 0x1048 XX Acpi HWP0002 700 Pci 1 1 00 E0 02 00 0x1002 0x5159...

Page 174: ...9 XX Acpi HWP0002 0 Pci 2 0 00 20 01 00 0x1000 0x0030 XX Acpi HWP0002 100 Pci 1 0 00 20 01 01 0x1000 0x0030 XX Acpi HWP0002 100 Pci 1 1 00 20 02 00 0x8086 0x1079 XX Acpi HWP0002 100 Pci 2 0 00 20 02 01 0x8086 0x1079 XX Acpi HWP0002 100 Pci 2 1 00 40 01 00 0x1000 0x0021 03 Acpi HWP0002 200 Pci 1 0 00 60 01 00 0x1077 0x2312 02 Acpi HWP0002 300 Pci 1 0 00 60 01 01 0x1077 0x2312 02 Acpi HWP0002 300 Pc...

Page 175: ...rop 14 62 EFI Build 86 10 SAL Spec 3 01 SAL_A 2 00 SAL_B 86 10 POSSE 0 10 ACPI 7 00 SMBIOS 2 3 2a BMC Revision 3 42 IPMI 1 00 Management Processor Revision E 03 02 Updatable EFI Drivers Floating Point Software Assistance Handler 00000118 LSI Logic Ultra320 SCSI Driver 01030000 Broadcom Gigabit Ethernet Driver 00070003 Intel R PRO 1000 Ethernet Driver 00002160 WARNING AND STOP BOOT INFORMATION Erro...

Page 176: ... 0 256MB Active 256MB Active 1 256MB Active 256MB Active 2 3 4 5 Active Memory 1024 MB Installed Memory 1024 MB Example C 12 info io Command Shell info io I O INFORMATION BOOTABLE DEVICES Order Media Type Path 1 CDROM Acpi HWP0002 0 Pci 2 0 Ata Primary Master CDROM Entry0 Seg Bus Dev Fnc Vendor Device Slot ID ID Path 00 00 01 00 0x1033 0x0035 XX Acpi HWP0002 0 Pci 1 0 00 00 01 01 0x1033 0x0035 XX ...

Page 177: ...002 0x5159 XX Acpi HWP0002 700 Pci 2 0 System Wake On LAN Enabled Example C 13 info boot Command Shell info boot BOOT INFORMATION Monarch CPU Current Preferred Monarch Monarch CPU CPU Module Module Logical Logical Warnings 0 0 0 0 AutoBoot ON Timeout is 10 sec Boottest BOOTTEST Settings Default Variable OS is not speedy boot aware Selftest Setting early_cpu Run this test late_cpu Run this test pla...

Page 178: ...eters cpu specifies a cpu Operation If specified with no parameters monarch displays the Monarch processor for the server Specifying a processor number alters the preferred Monarch processor None of these changes takes affect until after a reboot Example C 15 monarch Command Shell monarch Current Preferred Monarch Monarch Possible Warnings 0 0 0 0 To view monarch fs0 monarch Processor current stat...

Page 179: ...e SBE entries in PD PDT 0 Number of permanent uncorrectable MBE entries in PD PDT 0 Address of first uncorrectable error in PD 0x0000000000000000 Example C 17 pdt clear Command Shell pdt clear Are you sure you want to clear the PDT y N y Shell Shell pdt PDT Information Last Clear time 10 21 01 5 00p Number of total entries in PDT 50 Number of used entries in PDT 0 Number of free entries in PDT 50 ...

Page 180: ...l sysmode service You are now in service mode Shell sysmode normal You are now in normal mode Specifying SCSI Parameters The following SCSI parameters may be configured for the SCSI board SCSI ID SCSI initiator ID Maximum data transfer rate SCSI rate Bus width Whether the HBA is bootable driver support Avoid bus resets secondary cluster server Using the SCSI Setup Utility Step 1 At the EFI shell p...

Page 181: ...erface is shown in bold for highlighting purposes For each channel of the SCSI board you need to note certain information As an example look at the information for the SCSI interface the first two bold lines For each channel of this SCSI interface note the following information Bus identifies the bus the device is on for the SCSI interface this is the same for both channels In this example the bus...

Page 182: ... Usb Open Host Controller Ctrl 17 Acpi HWP0002 0 Pci 1 2 Ctrl 18 PCI IDE ATAPI Controller Ctrl 56 DV 28E C Ctrl 91 FAT File System FAT32 118 MB Ctrl 0C Acpi HWP0002 100 Ctrl 1C LSI Logic Ultra320 SCSI Controller Ctrl 1D LSI Logic Ultra320 SCSI Controller Ctrl 1E Acpi HWP0002 100 Pci 2 0 Ctrl 57 Acpi HWP0002 100 Pci 2 0 Mac 000E7F7E07FA Ctrl 1F Acpi HWP0002 100 Pci 2 1 Ctrl 58 Acpi HWP0002 100 Pci ...

Page 183: ... 3F Ctrl 19 Lang eng Drv 45 Ctrl 17 Lang eng Drv 45 Ctrl 18 Lang eng This listing shows which driver controls which device controller In the above example the SCSI interface information is shown highlighted bold You can tell the information is for this SCSI interface because the values shown for Ctrl 17 and 18 are the controller s handles for the SCSI interface two channels from the information di...

Page 184: ...he main menu TIP To move the cursor in the EFI SCSI Setup Utility you can use these keys Arrow keys Alternate keys H left J down K up L right I home O end Step 6 The Adapter Properties screen for this channel of the SCSI interface is displayed If you like you can make sure the utility is running for the channel of the SCSI interface by comparing the values shown for PCI Bus PCI Device and PCI Func...

Page 185: ... in the Adapter Properties screen for the channel of the SCSI interface Save the changes you made and then exit the screen Discard the changes you made and then exit the screen Step 11 Move the cursor to the action cancel save or discard you want to take press Enter If you selected cancel you remain in the Adapter Properties screen for the channel of the SCSI interface You can still change the cha...

Page 186: ...tions shown here are examples Your server may have different options available based on the server configuration and installed hardware components Boot From File Use this option to manually run a specific application or driver NOTE This option boots the selected application or driver one time only When you exit the application you return to this menu This option displays the file systems that are ...

Page 187: ... must manually add its boot options list if you want to make it a bootable device When adding a boot option that already exists in the Boot Manager list of boot options you can choose whether to create a new option or modify the existing one If you Choose to modify an existing option you may change the boot option name and or add boot option arguments to the existing option Create a new boot optio...

Page 188: ... by the hard drive boot option The menu lists boot options that currently exist in the main Boot Manager menu You can change the priority of the items by moving them up or down in the list Press U to move an option up Press D to move an option down Select Save Settings to NVRAM to modify the order in the Boot Manager menu which modifies the order that the Boot Manager will attempt to boot the opti...

Page 189: ... When this option is selected the server does not automatically boot The server stops at the EFI boot menu and waits for user input Driver Configuration Use this option to define the devices that display output from the system console This list normally includes the VGA monitor and a serial port for directing output to a terminal emulation package NOTE If you install a modem in your server make su...

Page 190: ...rent emulation type several different terminal emulation protocols are supported see list above Only one terminal emulation type PcAnsi Vt100 etc can be selected for each serial console but multiple serial consoles can be selected at a time Driver Configuration Use this option to define the devices that display output from the system console This list normally includes the VGA monitor and a serial...

Page 191: ...d rate of the serial device can be changed with the EFI shell baud command VenMsg Vt100 is the current emulation type several different terminal emulation protocols are supported see list above Only one terminal emulation type PcAnsi Vt100 etc can be selected for each serial console but multiple serial consoles can be selected at a time Console Configuration Use this option to define the devices t...

Page 192: ... models On both serial device examples UART 9600 indicates the current baud rate of the serial device can be changed with the EFI shell baud command VenMsg Vt100 is the current emulation type several different terminal emulation protocols are supported see list above Only one terminal emulation type PcAnsi Vt100 etc can be selected for each serial console but multiple serial consoles can be select...

Page 193: ...operation Each option is identified with an EFI device path Not all options will be available depending on the configuration of the server and the options purchased Device paths may differ slightly on different product models On both serial device examples UART 9600 indicates the current baud rate of the serial device can be changed with the EFI shell baud command VenMsg Vt100 is the current emula...

Page 194: ...ake On_LAN settings Set System Defaults Set System Defaults lets you select system default settings Using the Security Configuration Menu The Security Configuration Menu on servers with EFI firmware version 2 0 or higher includes the following options Administrator Password options User Password options Administrator Password Options Administrator Password Options lets the user set and clear the a...

Page 195: ...le determining 183 core I O external 22 internal 22 core I O slots 85 86 core PCI cards installing 85 86 covers front and top removing and replacing 42 customer support 132 D devtree command controller handle determining 183 EFI capable devices and controller handles displaying 182 diagnostic tools QuickFind diagnostic panel 119 diagnostics 128 DIMMs 16 DIMM extender board 49 32 DIMM extender boar...

Page 196: ...hard disk drive 27 I O baseboard 32 iLO MP 29 locations and functions 25 locator 30 power supply 29 QuickFind panel 31 lighter fluid 131 M management processor See iLO MP memory extender board 16 DIMM layout 49 32 DIMM layout 50 removing and replacing 44 memory See also DIMMs memory DIMM description 22 midplane riser board removing and replacing 95 MP See iLO MP O online support 132 online support...

Page 197: ...9 service tools 38 shut down HP UX 148 Linux 160 OpenVMS 152 Windows 155 from command line 156 slot number of adapter determining with info command 181 specifications dimensions and weights 21 starting up HP UX 143 LVM maintenance mode 148 single user mode 146 Linux 157 OpenVMS 149 Red Hat Linux 158 SuSE Linux 159 from EFI shell 159 Windows 153 support online 132 phone 132 supported DIMM sizes 22 ...

Reviews:

No comments

Related manuals for Integrity rx4640

IBM QS21 - BladeCenter - 0792 Installation And User Manual preview
QS21 - BladeCenter - 0792
Brand: IBM Pages: 110
Vicon VALERUS SERIES Quick Start User Manual preview
VALERUS SERIES
Brand: Vicon Pages: 2
Omega DPi8 User Manual preview
DPi8
Brand: Omega Pages: 49
Iwatsu ENTERPRISE 5.0 Owner'S Manual preview
ENTERPRISE 5.0
Brand: Iwatsu Pages: 338
Exsys EX-6112PoE Manual preview
EX-6112PoE
Brand: Exsys Pages: 24
Digital Equipment DIGITAL Server 9100 Series User Manual preview
DIGITAL Server 9100 Series
Brand: Digital Equipment Pages: 68
IBM 9131-52A Quick Start Manual preview
9131-52A
Brand: IBM Pages: 16
IBM System x3650 M5 Installation And Service Manual preview
System x3650 M5
Brand: IBM Pages: 1010
Intergraph InterServe 600 Series System Reference Manual preview
InterServe 600 Series
Brand: Intergraph Pages: 104
xFusion Digital Technologies FusionServer G8600 V7 Manual preview
FusionServer G8600 V7
Brand: xFusion Digital Technologies Pages: 112
Blackberry ENTERPRISE SERVER FOR NOVELL GROUPWISE Installation And Configuration Manual preview
ENTERPRISE SERVER FOR NOVELL GROUPWISE
Brand: Blackberry Pages: 73
ESI 60 Business Phone User Manual preview
60 Business Phone
Brand: ESI Pages: 2
OSD Audio BLACK SRT4 User Manual preview
BLACK SRT4
Brand: OSD Audio Pages: 4
Zte ZXCLOUD iBox CT220 Quick Start Manual preview
ZXCLOUD iBox CT220
Brand: Zte Pages: 16
Neat D-SERVER Technical Handbook preview
D-SERVER
Brand: Neat Pages: 124
IBM 71412RU Brochure & Specs preview
71412RU
Brand: IBM Pages: 4
7th Sense VIOSO User Manual preview
VIOSO
Brand: 7th Sense Pages: 24
3onedata NP308T-8D User Manual preview
NP308T-8D
Brand: 3onedata Pages: 4

Brands by name

Popular brands

Load more brands