manualshive.com logo in svg

HP Integrity rx2660, Руководство пользователя и обслуживания

Сервер HP Integrity rx2660 - надежное и мощное устройство для вашего бизнеса. Получите бесплатные руководства и технические характеристики (Quickspecs) для этой модели на manualshive.com. Скачайте руководства и управляйте вашим сервером без проблем!

Поделиться
Скачать
background image

I/O Backplane (LBAs/Ropes/PDH/PCI-X/PCIe Slots)

This subsection provides information on troubleshooting issues with the three public PCI-X/PCIe
slots.

I/O Subsystem Behaviors

The main role of the I/O subsystem is to transfer blocks of data and instruction words between
physical shared memory and virtual memory (system disks / disk array). The system boot is the
first time blocks of data and instructions words are transferred into physical shared memory
from a local disk / DVD or from a remote disk on another server through multiple LAN transfers.
This process is referred to as Direct Memory Access (DMA) and is initiated by I/O devices located
in I/O or on Host Bus Adapter (HBA) I/O cards and does not involve any logical CPUs.

A secondary role of the I/O subsystem is to transfer data between the internal registers within
each CPU core and the internal control/store registers within the zx2 / PDH / Local Bus Adapters
(LBA) and HBA chips. This process is referred to as programmed I/O and is initiated by logical
CPUs executing external LOAD / STORE instructions. Both system firmware and OS kernel both
use this method to initiate DMA transfers.

Customer Messaging Policy

•

Always refer to the SEL for any action from low level I/O subsystem faults as there may not
be any lighted LEDs on the System Insight Display. IPMI events in SEL / FPL provide the
logical ACPI path of suspect I/O subsystem CRU. Use

Table 5-23

to determine the physical

PCI slot number.

•

For configuration style errors, for example, no iLO 2 MP / core I/O HBAs installed or working,
see Supported Configurations subsection for actions.

•

Some diagnostic messages are reported for high level I/O subsystem errors; all fatal I/O
subsystem errors cause global MCAs. HP-UX provides its own path with the physical rope
number of the suspect I/O subsystem CRU. Use

Table 5-23

to determine the physical PCI

slot number.

Table 5-21 I/O Subsystem Events That Light System Insight Display LEDs

Notes

Source

Cause

Sample IPMI Events

Diagnostic
LED(s)

Likely a short on
I/O card or I/O
slot.

BMC

Over-current on PCI slot

Type 02h, 03h:05h:01h

CURRENT_LIMIT_EXCEEDED

I/O Card

A voltage on the
I/O backplane is

BMC

Voltage on CRU is
inadequate

Type 02h, 02h:07h:03h

VOLTAGE_DEGRADES_TO_NON_RECOVERABLE

I/O Backplane

out of range
(likely too low)

A voltage on the
I/O backplane is

BMC

Voltage on CRU is
inadequate

Type 02h, 02h:07h:03h

VOLTAGE_DEGRADES_TO_NON_RECOVERABLE

Disk
Backplane

out of range
(likely too low)

Table 5-22 I/O Card Events That May Light System Insight Display LEDs

Notes

Source

Cause

Sample IPMI Events

Diagnostic
LED(s)

Disallow O/S
boot and display

SFW

A non hot plug I/O
slot power

Type E0h, 4658d:26d

IO_PCI_POWER_OVERLOAD_ERR

I/O Card

the following EFI

consumption

error message,

increases the total I/O

“I/O

power consumption

132

Troubleshooting

Содержание Integrity rx2660

Страница 1: ...HP Integrity rx2660 Server User Service Guide User Service Guide HP Part Number AB419 9002C ed4 Published August 2008 ...

Страница 2: ...ing herein should be construed as constituting an additional warranty HP shall not be liable for technical or editorial errors or omissions contained herein Printed in U S A Intel Pentium Intel Inside Itanium and the Intel Inside logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries Linux is a U S registered trademark of Linu...

Страница 3: ... Power 25 Office Friendly Server Power 25 Mass Storage 26 Firmware 26 User Interface 26 Event IDs for Errors and Events 27 Controls Ports and LEDs 27 Front Panel Controls Ports and LEDs 27 System Insight Display 29 Storage and Media Devices 30 SAS Disk Drive LEDs 30 DVD Drive 31 Rear Panel Controls Ports and LEDs 31 iLO 2 MP 32 iLO 2 MP Reset Button 33 iLO 2 MP Ports 33 iLO 2 MP LAN LEDs 33 iLO 2 ...

Страница 4: ...IMM Sizes 51 Memory Pairs 51 Memory Loading Rules and Guidelines 52 Installing Memory 52 Installing a Processor 52 Processor Load Order 53 Required Tools 53 Replacing the Airflow Guide 57 Installing Additional PCIe PCI X Cards 58 Removing the I O Backplane from the Server 58 Installing a PCIe PCI X Card 60 Replacing the I O Backplane Card Cage 61 Installing the SAS Smart Array and PCIe Expansion B...

Страница 5: ...ion Troubleshooting 83 Troubleshooting Methodology 83 Troubleshooting Using the Server Power Button 84 Server Does Not Power On 84 EFI Menu is Not Available 85 Operating System Does Not Boot 85 Operating System Boots with Problems 85 Intermittent Server Problems 85 DVD Problems 85 Hard Drive Problems 86 Console Problems 86 Downloading and Installing the Latest Version of the Firmware 86 Downloadin...

Страница 6: ...lth LED 114 System Health LED 115 Locator Switch LED Unit Identifier or UID 116 System Insight Display LEDs 116 Field Replaceable Unit Health LEDs 117 Diagnostics 117 Online Diagnostics Exercisers 117 Online Support Tool Availability 117 Online Support Tools List 118 Linux Online Support Tools 118 Offline Support Tools List 118 General Diagnostic Tools 119 Fault Management Overview 119 HP UX Fault...

Страница 7: ...rt 139 Phone Support 139 Information to Collect Before you Contact Support 139 6 Removing and Replacing Server Components 141 Service Tools Required 141 Safety Information 141 Server Component Classification 142 Hot Swappable Components 142 Hot Pluggable Components 142 Cold Swappable Components 143 Accessing a Rack Mounted Server 143 Extending the Server from the Rack 143 Inserting the Server into...

Страница 8: ...eplacing the I O Backplane Assembly 169 Removing and Replacing a PCI X PCIe Card 170 Removing a PCI X PCIe Card 170 Installing a PCI X PCIe Card 170 Removing and Replacing the Fan Display Board 171 Removing the Fan Display Board 172 Replacing the Fan Display Board 173 Removing and Replacing System Memory 174 Removing System Memory 174 Memory Installation Conventions 175 Supported DIMM Sizes 175 Me...

Страница 9: ...ols 207 Safety Information 207 Upgrading the I O Backplane 208 Performing a Server Backup 208 Powering Off the Server 208 Accessing the Server 208 Removing the I O Backplane Assembly From the Server 209 Removing the PCI X I O Backplane Board from the I O Backplane Assembly 210 Installing the PCI X PCIe I O Backplane Board Into the I O Backplane Assembly 211 Replacing the I O Backplane Assembly Int...

Страница 10: ...ddress 232 Syntax 232 Parameters 232 monarch 232 Syntax 233 Parameters 233 Operation 233 pdt 233 Syntax 233 Parameters 233 Operation 233 sysmode 234 Syntax 234 Parameters 234 Operation 234 Option ROM Configuration for Arrays Utility 235 Creating a Logical Drive Using ORCA 235 CFGGEN Utility 236 Starting CFGGEN 236 CFGGEN Operation 236 Rules for creating IM volumes and hot spare disks 237 CFGGEN Ut...

Страница 11: ... s 245 Change Boot Order 245 Manage BootNext Setting 245 Set AutoBoot TimeOut 246 Select Console Configuration 246 Select Active Standard Error Devices 247 Using the System Configuration Menu 247 Security Password Menu 248 Resetting Passwords 248 Advanced System Information 248 Set System Time 248 Set System Date 248 Set User Interface 248 Set System Wake On LAN 248 Set System Defaults 248 Integra...

Страница 12: ...O Backplane Assembly Screw Locations 59 3 16 I O Backplane Assemblies 60 3 17 SAS Smart Array P400 Controller and PCIe Expansion Board Slots 62 3 18 Board Lock 62 3 19 Installing the RAID battery 63 3 20 Replacing the Top Cover 64 3 21 Rear Panel Control Port and LED Locations 66 3 22 iLO 2 MP Setup Flowchart 69 3 23 Web Login Page 77 3 24 Status Summary Page 77 5 1 System Insight Display LEDs 116...

Страница 13: ...gnment Holes and Posts 180 6 32 ZIF Socket 181 6 33 Removing the Power Supply Housing 183 6 34 Power Supply Housing Removed From the Server 184 6 35 Power Supply Riser Board 185 6 36 System and iLO 2 MP Battery Locations 187 6 37 Battery and Holder 188 6 38 Inserting the Battery Clip 188 6 39 Installed Battery Clip 189 6 40 TPM Location on System Board 190 6 41 Smart Array P400 Controller Location...

Страница 14: ...guration Methods 71 3 8 ARP Ping Commands 72 3 9 Power States 78 3 10 Server Power Button Functions When Server is On and at EFI 84 3 11 Server Power Button Functions When Server is On and OS is Running 84 3 12 Server Power Button Functions When Server is Off 84 5 1 Troubleshooting Entry Points 108 5 2 Front Panel LED States 109 5 3 Basic Low End Troubleshooting 109 5 4 Advanced Low End Troublesho...

Страница 15: ... 28 Gb LAN 1 Connector LEDs 136 5 29 Gb LAN 2 Connector LEDs 136 5 30 Normal Boot Process LED States 136 5 31 rx2660 Environmental Specifications 139 6 1 Memory Load Order 175 6 2 Supported Processor Configurations 176 6 3 Processor Load Order 177 A 1 Customer Self Repair Information 204 A 2 HP Integrity rx2660 CRU List 204 B 1 Slot Speed Comparison 207 B 2 Processor Upgrades 213 C 1 EFI Commands ...

Страница 16: ...ommand 224 C 9 ioconfig command 225 C 10 conconfig command 226 C 11 conconfig 2 primary command 226 C 12 conconfig 3 off command 226 C 13 conconfig 3 on command 226 C 14 info all command 228 C 15 info cpu command 230 C 16 info mem command 231 C 17 info io command 231 C 18 info boot command 232 C 19 lanaddress command 232 C 20 monarch command 233 C 21 pdt command 234 C 22 pdt clear command 234 C 23...

Страница 17: ...s intended to provide technical product and support information for authorized service providers customer system administrators and HP support personnel Publishing History Table 1 lists the publishing history details for this document Table 1 Publishing History Details Publication Date Supported Product Versions Operating Systems Supported Document Manufacturing Part Number December 2006 rx2660 AB...

Страница 18: ...f a keyboard key Return and Enter both refer to the same key Emphasis Text that is emphasized Bold Text that is strongly emphasized or the defined use of an important word or phrase ComputerOut Text displayed by the computer UserInput Commands and other text that you type Command A command name or qualified command phrase Variable The name of a variable that you may replace in a command or functio...

Страница 19: ...ation of the Microsoft Windows operating system at the following websites among others http docs hp com windows_nt http www microsoft com technet Diagnostics and Event Monitoring Hardware Support Tools Complete information about HP hardware support tools including online and offline diagnostics and event monitoring tools is available on the HP website at http docs hp com hpux diag This site has ma...

Страница 20: ... provides different fans a minimum of two power supplies and can only be configured as a pedestal mounted server When reading fan cooling or power information there is Data Center server information as well as Office Friendly server information throughout this document This chapter addresses the following topics Server Subsystems page 20 Server Block Diagram page 20 I O Subsystem page 21 Processor...

Страница 21: ...Figure 1 1 Server Block Diagram I O Subsystem Figure 1 2 shows a block diagram of the I O subsystem Server Subsystems 21 ...

Страница 22: ...rnal battery The battery is mounted on top of the plastic CPU airflow guide and is connected to the RAID HBA by a power cable When the RAID HBA is installed the SAS cables are connected to the HBA instead of the LSI 1068 controller on the system board PCIe MPS Optimization For PCIe based systems each PCIe device has a configurable MPS maximum payload size parameter Larger MPS values can enable the...

Страница 23: ...s The processor subsystem consists of the following features zx2 chipset front side bus memory and I O controller MIOC System clock generation and distribution Circuitry for manageability and fault detection The zx2 MIOC and the processors are located on the system board Each processor connects to the board through a zero insertion force ZIF socket Memory The eight server DIMMs attach directly to ...

Страница 24: ...ver has 12 fans but can operate with 9 fans running one fan failure per zone See Figure 6 7 page 150 for the Data Center fan locations and cooling zones The power supplies have built in fans and are not controlled by the Baseboard Management Controller BMC Office Friendly Server Cooling Six fans cool the Office Friendly server The server fans have two rotors per fan Four fans cool the eight DIMMs ...

Страница 25: ...its maximum load Each power supply receives ac power through integrated ac inlets The system can operate at 100 or 240 VAC and achieve 1 1 redundancy The power supplies are power factor corrected and the maximum dc power output of each power supply is 900 watts at 120 VAC and 1000 watts at 240 VAC Office Friendly Server Power The Office Friendly server has two power supplies in the standard config...

Страница 26: ...ce between the operating system and the platform firmware EFI uses data tables that contain platform related information and boot and runtime service calls that are available to the operating system and its loader to provide a standard environment for booting Advanced Configuration and Power Interface ACPI ACPI provides a standard environment for configuring and managing server systems ACPI moves ...

Страница 27: ...he following topics Front Panel Controls Ports and LEDs page 27 Rear Panel Controls Ports and LEDs page 31 Front Panel Controls Ports and LEDs The front panel of the server provides the controls ports and LEDs commonly used when the server is operational Figure 1 5 page 27 shows the control port and LED locations on the server front panel Figure 1 5 Front Panel Controls Ports and LEDs 7 SAS disk d...

Страница 28: ...ealth LED 1 UID button LED 2 Init ToC button 5 External health LED 6 3 Power LED and button System health LED Table 1 2 lists the server status LEDs Table 1 2 Front Control Panel LEDs States Name UID LED Off UID button is not activated Blue UID button is activated There is an additional UID LED and button located on the rear panel of the server Both the front and rear UID LEDs illuminate when you ...

Страница 29: ...ealth LED is illuminated the LED of the corresponding failed component illuminates External health LED The following are LED states Off system is off Green system health is good Flashing amber system health is degraded Flashing red system health is critical Power LED Off no ac power Green full power is on Yellow standby power is on System Insight Display The System Insight Display enables you to m...

Страница 30: ...hen a drive is accessed Drive Status LED The drive status LED is bi color and can display amber or blue Amber indicates a warning or failure condition Blue is a locator LED that identifies a particular disk drive The locator LED is activated through various software utilities such as online diagnostics and SAS disk drive configuration tools Figure 1 8 shows the SAS disk drive LEDs Figure 1 8 Hot P...

Страница 31: ...Flashing green at 1 Hz DVD Drive The server has one DVD drive or one DVD RW drive This device has one activity LED Figure 1 9 Figure 1 9 DVD LED 1 DVD activity LED Rear Panel Controls Ports and LEDs The server rear panel includes communication ports I O ports ac power connectors and the locator LED and button LEDs located on the rear panel of the server signal the operational status of the followi...

Страница 32: ... Array P400 controller slot NOTE The Office Friendly server is shown in Figure 1 10 page 32 The Data Center server may only have one power supply installed iLO 2 MP The server contains an iLO 2 MP on the system board to enable local and remote management of the server As long as ac power is present the iLO 2 MP is active regardless of whether the front panel power switch is off or on Figure 1 11 s...

Страница 33: ...1 11 Table 1 4 iLO 2 MP Ports Description Port LAN port dedicated for remote access to the iLO 2 MP 10 Base T 100 Base T LAN Local serial port Auxiliary serial Local serial port that provides a console connection to the server Console serial iLO 2 MP Two public USB 2 0 ports used primarily to connect to a keyboard and mouse for console input functions Windows and Linux operating systems only USB V...

Страница 34: ...tate Link Status Solid orange 1000 Mb Solid green 100 Mb Off 10 Mb Power Supply The server is equipped with one or two power supplies labeled PS1 and PS2 Each power supply has an ac input receptacle and an LED that shows the power state of the server See Figure 1 10 page 32 for the LED location The server has three power states standby power full power and off To achieve the standby power state pl...

Страница 35: ...r UID LEDs illuminate when you activate the front or rear UID button PCI X PCIe Card Slots The server has three public PCI X PCIe slots on the I O backplane assembly The I O backplane assembly is located on the system board Depending on what options you purchased you have one of the following I O backplane assemblies with the included riser board PCI X riser board Three full length PCI X public sl...

Страница 36: ...re processor 1 6 GHz 18 MB cache dual core processor 1 6 GHz 12 MB cache single core processor 1 42 GHz 12 MB cache dual core processor 1 67 GHz 18 MB cache dual core processor Supports up to eight Double Data Rate 2 DDR2 DIMMs mounted on the system board Memory Supported DIMM sizes are as follows 512 MB 1 GB 2 GB 4 GB 8 GB Minimum memory configuration is 1 GB 2 x 512 MB DIMMs Maximum memory confi...

Страница 37: ... feet 12 7 cm 5 in w o feet Width 50 8 cm 20 in Height Minimum configuration 30 kg 66 lb Maximum configuration 37 kg 81 lb Office Friendly Server Weight Grounding The site building shall provide a safety ground protective earth for each ac service entrance to all cabinets Install a PE protective earthing conductor that is identical in size insulation material and thickness to the branch circuit su...

Страница 38: ...an overload occurs twice there is an undetected short circuit somewhere When you use the front panel power button to turn off the server power consumption falls below the low power consumption but doesn t reach zero To reach zero power consumption in off mode either unplug the server or use a power block with a switch Power Consumption and Cooling The power consumptions listed in Table 2 4 are val...

Страница 39: ...rature 38 C 100 F Over temperature shutdown 20 to 80 relative non condensing Operating humidity 90 relative non condensing at 65 C Storage humidity Office Friendly Server Data Center Server Acoustic Noise Emission ISO 9296 LwAd 5 9 B LwAd 6 8 B Typical configuration disk idle 1 Sound Power Level LwAd 5 9 B LwAd 6 8 B Maximum configuration disk idle 2 LwAd 5 9 B LwAd 7 0 B Maximum configuration dis...

Страница 40: ... 134 79 782 W 782 W Maximum Config with feet W 5 0 in w o feet H 20 0 in in W 19 in H 3 4 in 70 lb 190 112 104 61 483 W 483 W Typical Config Two 4 GB DDR2 DIMMs n o PCIe PCI X public cards or RAID card on private I O slot Min config Airflow cooling scheme front to rear ASHRAE Class 1 Eight 4 GB DDR2 DIMMs three PCIe PCI X cards on public I O slots and RAID card in private slot Max Config Four 4 GB...

Страница 41: ... 8 in 66 lb 81 lb 275 162 76 45 782 W 782 W Maximum Config with feet W 5 0 in w o feet H 20 0 in 275 162 76 45 483 W 483 W Typical Config Two 4 GB DDR2 DIMMs no PCIe PCI X public cards or RAID card on private I O slot Min Config Airflow cooling scheme front to rear ASHRAE Class 1 Eight 4 GB DDR2 DIMMs three PCIe PCI X cards on public I O slots and RAID card in private slot Max Config Four 4 GB DDR...

Страница 42: ...all the server cover immediately to prevent overheating If installing a hot pluggable component complete the required software intervention prior to removing the component If installing an assembly that is neither hot swappable nor hot pluggable disconnect the power cable from the external server power receptacle before starting the installation WARNING Ensure that the system is powered off and al...

Страница 43: ...nd its containers are in good condition after shipment This section addresses the following topics Verifying Site Preparation page 43 Inspecting the Shipping Containers for Damage page 44 Unpacking the Server page 44 Checking the Inventory page 44 Returning Damaged Equipment page 44 Unloading the Server With a Lifter page 44 Verifying Site Preparation Verifying site preparation is an essential fac...

Страница 44: ... representative immediately The service representative initiates appropriate action through the transport carrier or the factory and assists you in returning the equipment Unloading the Server With a Lifter WARNING Use caution when using a lifter Because of the weight of the HP Integrity rx2660 server you must center the server on the lifter forks before lifting it off the pallet to avoid injury N...

Страница 45: ...t are accessed by removing the top cover The externally accessible components are as follows SAS hard drives Power supplies The internal components are as follows System memory Processors PCIe PCI X cards WARNING Ensure that the system is powered off and all power sources are disconnected from the server prior to removing or installing server hardware unless you are removing or installing a hot sw...

Страница 46: ...rive filler for future use For airflow purposes always place hard drive fillers in slots that do not contain SAS disk drives Installing a SAS Hard Drive Figure 3 2 page 47 shows how to install a SAS hard drive To install a SAS hard drive follow these steps 1 Insert the hard drive into the slot guides and slide the drive into the slot until it seats into the socket on the disk backplane 1 46 Instal...

Страница 47: ...ice Friendly server you have two power supplies already installed You do not need to perform this procedure CAUTION Observe all ESD safety precautions before attempting this procedure Failure to follow ESD safety precautions can result in damage to the server NOTE The power supply is a hot swappable device It does not require interaction with the operating system before the it is removed from or i...

Страница 48: ...wer supply To install a power supply follow these steps 1 Remove the metal slot filler by pulling it straight out of the server using the finger holes 1 2 Support the power supply with both hands and slide it into the empty slot until it clicks into place 2 IMPORTANT Ensure the power supply is flush with the adjacent power supply Figure 3 4 Installing a Power Supply Removing the Top Cover When ins...

Страница 49: ...erver until the tabs release from the slots in the chassis 3 4 Lift the cover off the chassis 4 Figure 3 5 Removing the Top Cover Removing the Airflow Guide The airflow guide in the rx2660 server directs airflow from eight of the system fans to the processors and the system memory on the system board To install an additional processor or system memory you must remove the airflow guide and optional...

Страница 50: ...he server to disengage it from the airflow guide 2 c Pull straight up on the RAID battery to remove it from the airflow guide Figure 3 6 Removing the Airflow Guide 3 Lift up on the fan carrier handle approximately 5 cm 2 in to allow the airflow guide to be lifted out of the server 1 4 Lift the airflow guide straight up and out of the server 2 Figure 3 7 page 50 shows the Data Center fan carrier Fi...

Страница 51: ...emory pair group of two DIMMs The supported DIMM sizes for the server are as follows 512 MB 1 GB 2 GB 4 GB 8 GB Memory Pairs When installing memory use a minimum of one pair of like sized DIMMs You can install additional DIMMs later Install DIMMs into the appropriate slots on the system board each slot has a unique ID Figure 3 8 page 51 shows the DIMM slot IDs Figure 3 8 Memory Location and Slot I...

Страница 52: ...nstall each DIMM a Align the DIMM with the slot located on the memory board and align the key in the connector with the notch in the DIMM b Firmly and evenly push on each end of the DIMM until it seats into the slot c Ensure the extraction levers are in the fully closed position 5 Replace the airflow guide if you are finished installing additional components See Replacing the Airflow Guide page 57...

Страница 53: ...ety precautions can result in damage to the server Processor Load Order The server holds up to two single or dual core processors on the processor board The slots on the processor board are labeled Module 0 and Module 1 If the server has only one processor it is installed in slot Module 0 Install the second processor in slot Module 1 Table 3 3 lists the processor load sequence Table 3 3 rx2660 Pro...

Страница 54: ...proximately 90 degrees toward the front of the assembly until it stops Figure 3 10 page 54 shows the processor cage fully open Figure 3 10 Processor Cage Open IMPORTANT Ensure the processor slot is entirely exposed The processor must clear the cage enclosure for proper installation 4 Locate the slot Module 1 on the system board for the processor installation Figure 3 11 page 55 shows the slot loca...

Страница 55: ...4 Alignment hole on the processor 9 Alignment post on the system board 5 Alignment post on the system board 10 Module 1 label on the system board 5 Remove the plastic airflow blocker covering the processor slot if installed 6 Remove the protective dust cover from the processor socket if installed 7 Ensure the cam on the ZIF socket is in the unlocked counterclockwise position Figure 3 12 page 56 sh...

Страница 56: ...rocessor socket Figure 3 11 page 55 shows the alignment holes and posts on the processor and system board CAUTION Do not press the processor into the socket When properly aligned the processor pins seat into the socket No additional pressure is required Damage to the pins may occur if pressure is applied 11 Lock the processor into the socket on the processor board a Remove the processor install to...

Страница 57: ...top cover if you are finished installing additional components See Replacing the Top Cover page 63 Replacing the Airflow Guide Use this procedure to replace the airflow guide in the server when you are finished installing additional equipment into the server To replace the airflow guide follow these steps 1 Ensure the fan carrier handle is raised approximately 5 cm 2 in to allow clearance for the ...

Страница 58: ... the following I O backplane assemblies with the included riser board PCI X riser board Three full length PCI X public slots PCIe PCI X riser board Two PCIe x8 public slots and one full length PCI X public slot NOTE Wake on LAN is not enabled on any of the PCIe PCI X slots PCIe PCI X hot plugging is not supported on the rx2660 server Removing the I O Backplane from the Server To install an additio...

Страница 59: ...s a Press the blue button to release the black knob Figure 3 15 page 59 shows the location of the I O backplane assembly captive screws b Turn the black knob counterclockwise until the captive screw is free from the server Figure 3 15 I O Backplane Assembly Screw Locations Installing Additional Components 59 ...

Страница 60: ...t 1 top PCIe bottom PCI X 2 Slot 2 top PCIe bottom PCI X 6 Gate latches for full length cards 7 Bulkhead fillers 3 Slot 3 PCI X 4 8 I O backplane riser board top PCIe bottom PCI X Sheet metal enclosure Installing a PCIe PCI X Card To install a PCIe PCI X card follow these steps 1 Select an empty slot that is appropriate for the card you are installing X shows both a PCI X and PCIe PCI X riser boar...

Страница 61: ... and release the blue button to lower the black knob to the locked position 3 If you are done installing additional components replace the top cover See Replacing the Top Cover page 63 If you have more components to install continue on to the next section Installing the SAS Smart Array and PCIe Expansion Boards The rx2660 server has two slots dedicated for the SAS Smart Array P400 controller and P...

Страница 62: ...t Array P400 controller and the battery into the server follow these steps 1 Open the blue SAS Smart Array P400 controller board lock on the rear panel of the server SeeFigure 3 18 page 62 shows the location of the board lock 2 Install the SAS Smart Array P400 controller into the slot on the system board as shown in Figure 3 18 page 62 3 Close the board lock over the tab on the SAS Smart Array P40...

Страница 63: ...her end of the RAID battery cable to the SAS Smart Array P400 controller CAUTION When disconnecting the SAS cables note the labeling on the cables When reconnecting these cables match each cable with the appropriate socket on the SAS Smart Array P400 controller board If the cables are mismatched the server may not reboot Both cables and sockets are clearly marked with the correct channels Replacin...

Страница 64: ...steps in this installation guide to determine where and how to install the server into the rack Non HP Rack The Mounting in non HP racks guide enables you to evaluate the installation of HP equipment into non HP racks Use this guide when you need to qualify whether you can install maintain and service any HP equipment in a non HP rack The guide is located on the HP website at http www hp com racks...

Страница 65: ...capability For the Office Friendly server two power supplies are required to power the server The office friendly server can run on one power supply but runs quieter and more efficiently with two power supplies installed Power States The server has three power states Standby power Full power Off Table 3 4 lists the server power states Table 3 4 Power States dc Voltage Applied Standby dc Voltage Ap...

Страница 66: ...nd of the power cord into an appropriate outlet NOTE The LED on the power supply does not illuminate in the standby power state The LED illuminates green when the server is powered on to full power If the power restore feature is set to Always On through the iLO 2 MP PR command the server automatically powers on to the full power state when the power cord is plugged into the server 2 If the server...

Страница 67: ...AN Using the RS 232 Serial Port page 73 Logging In to the iLO 2 MP page 74 Additional Setup page 75 Setting Up the Console Setting up the console includes the following steps Determine the physical access method to connect cables There are two physical connections to the iLO 2 MP RS 232 LAN Configure the Integrity iLO 2 MP and assign an IP address if necessary Though there are several methods to c...

Страница 68: ... LAN 2 DHCP with DNS ARP Ping RS 232 serial port Log in to the iLO 2 MP from a supported web browser or command line using the default user name and password Log on to the iLO 2 MP 3 Change the default user name and password on the administrator account to your predefined selections Change default user name and password 4 Set up the user accounts if you are using the local accounts feature Set up ...

Страница 69: ...Setup Flowchart Use this flowchart as a guide to assist in the iLO 2 MP setup process Figure 3 22 iLO 2 MP Setup Flowchart Connecting and Setting Up the Console 69 ...

Страница 70: ...sole device for example a laptop or ASCII terminal 10 100 LAN cable LAN port Local RS 232 serial port Remote modem port Linux 1 RS 232 DB 9F to DB 9F modem eliminator cable 2 Console device for example a laptop or ASCII terminal 10 100 LAN cable LAN port Local RS 232 serial port Remote modem port OpenVMS 1 RS 232 DB 9F to DB 9F modem eliminator cable 2 Console device for example a laptop or ASCII ...

Страница 71: ...ess only if the following conditions apply DHCP must be enabled DHCP is enabled by default You are using a DHCP server that provides the domain name and the primary DNS server IP address The primary DNS server accepts dynamic DNS DDNS updates The primary DNS server IP address has been configured through the DHCP server To configure the iLO 2 MP using DHCP and DNS follow these steps 1 Obtain the fa...

Страница 72: ...sting server on the network log into it and run the ARP Ping commands from the server Table 3 8 lists the ARP Ping commands Table 3 8 ARP Ping Commands Description Command This command assigns an IP address to the iLO 2 MP MAC address This ARP table entry maps the MAC address of the iLO 2 MP LAN interface to the static IP address designated for that interface arp s This command tests network conne...

Страница 73: ... console connection through the RS 232 serial port or a network connection through the LAN to access the iLO 2 MP and use the LC command To assign a static IP address using the LC command follow these steps 1 Ensure the emulation software device is properly configured The terminal emulation device runs software that interfaces with the server The software emulates console output as it would appear...

Страница 74: ...nd enter CM at the MP prompt 13 Enter LS to confirm that DHCP is disabled and display a list of updated LAN configuration settings Logging In to the iLO 2 MP To log in to the iLO 2 MP follow these steps 1 Access the iLO 2 MP using the LAN RS 232 serial port telnet SSH or web method The iLO 2 MP login prompt appears 2 Log in using the default the iLO 2 MP user name and password Admin Admin The MP M...

Страница 75: ... Main Menu b Enter CM at the MP prompt c Enter UC at the MP CM prompt and follow the prompts to modify default passwords 3 To set up user accounts follow these steps a Access the MP Main Menu b Enter CM at the MP prompt c Enter UC at the MP CM prompt and follow the prompts to modify user accounts Setting Up Security For greater security and reliability HP recommends that iLO 2 MP management traffi...

Страница 76: ...0 server Accessing the Host Console With the TUI CO Command This section describes the steps to access the host console using the text user interface TUI To access the host console through the iLO 2 MP follow these steps 1 Log in using your user account name and password at the login page 2 At the iLO 2 MP login MP prompt enter the CO command to switch the console terminal from the MP Main Menu to...

Страница 77: ...on the left side of the page 5 Click an option link to display data in the display screen 6 Click Refresh to update the display The iLO 2 MP web interface has a robust help system To launch iLO 2 MP help click the Help tab in the display screen or click the question mark key at the top right corner of each page to display help about that page Accessing the Graphic Console Using VGA VGA is a method...

Страница 78: ...the mouse USB cable to the appropriate USB port on your server 2 Power on the server The EFI Shell prompt appears Powering On and Powering Off the Server This section provides information and procedures for powering on and powering off the server Power States The server has three power states Standby power Full power Off Table 3 9 lists the server power states Table 3 9 Power States dc Voltage App...

Страница 79: ...acles on the rear panel of the server 2 Press the power button to start the server 3 Start the operating system For more information see the operating system documentation Powering Off the Server Power off the server using the following methods if the server is in the standby or full power state iLO 2 MP PC command Power button Powering Off the Server Using the iLO 2 MP To power off the server usi...

Страница 80: ...nts installed in the server are recognized by the server Use the following procedure to verify that the components you have installed into the rx2660 server are recognized by the server NOTE The processor cache information in the Processor Module Information below shows the L3 Cache Size per logical CPU Since there are two logical CPUs per processor dual core a reading of 6 MB for the L3 cache mea...

Страница 81: ...0A03 200 Pci 1 0 Sas Addr5000C500003A05 5 HARDDRIVE Acpi HWP0002 PNP0A03 200 Pci 1 0 Sas Addr5000C500003A05 6 HARDDRIVE Acpi HWP0002 PNP0A03 200 Pci 1 0 Sas Addr500000E0119F9C 7 HARDDRIVE Acpi HWP0002 PNP0A03 200 Pci 1 0 Sas Addr500000E0119F9C Seg Bus Dev Fnc Vendor Device Slot ID ID Path 00 00 01 00 0x103C 0x1303 XX Acpi HWP0002 PNP0A03 0 Pci 1 0 00 00 01 01 0x103C 0x1302 XX Acpi HWP0002 PNP0A03 ...

Страница 82: ... Acpi HWP0002 PNP0A03 700 Pci 1 0 Mac 001560045FE0 Mac 001560045FE1 Acpi HWP0002 PNP0A03 700 Pci 1 1 Mac 001560045FE1 FIRMWARE INFORMATION System Firmware A Revision 1 05 4645 PAL_A 7 31 7 46 PAL_B 8 30 EFI Spec 1 10 EFI Intel Drop 14 62 EFI Build 5 65 SAL Spec 3 20 SAL_A 2 00 SAL_B 1 05 POSSE 0 21 ACPI 7 00 SMBIOS 2 3 2a System Firmware B Revision 1 04 4645 BMC Revision 5 06 IPMI 1 00 Management ...

Страница 83: ...Firmware page 86 Troubleshooting Methodology The server was tested prior to shipping Failures encountered during installation can be due to damage that occurred in transit Re seating connectors can clear problems that result from rough handling If you are installing components or assemblies compatibility problems or incorrect installations can be the cause of the problems If you are installing com...

Страница 84: ...er off 1 3 seconds System power turns off immediately hard power off 5 seconds or longer If the server is off and power is not connected to server power supplies pressing the power button has no effect If the server is off and power is connected to server power supplies the front panel power LED blinks at a 1 Hz rate In this state standby power is available to server circuits but main power is off...

Страница 85: ...d analyze any error messages Offline Diagnostic Environment ODE Operating System Boots with Problems If the operating system is running and you are experiencing problems use the following tools to help solve the problem LEDs Error Messages and event logs Intermittent Server Problems You can usually trace intermittent problems that occur during installation to power source problems a loose connecto...

Страница 86: ... every effort to provide you with the most current version of firmware However there can be instances when this is not the case To ensure you have the latest version of the firmware running on the server download the latest version of the firmware from the web and create a CD to install the firmware on the server Downloading the Latest Version of the Firmware To download the latest version of the ...

Страница 87: ... 5 For details see Booting and Shutting Down Linux page 102 SuSE Linux Enterprise Server 10 For details see Booting and Shutting Down Linux page 102 Configuring System Boot Options This section discusses the configurable server boot options on entry class HP Integrity servers including the boot options list and the autoboot setting for the server The version shown is EFI Boot Manager version 2 00 ...

Страница 88: ... environment NOTE When exiting the Console Configuration screen be sure to save your changes and perform a server reset to activate your configuration changes IMPORTANT When selecting a console as Primary all other consoles must be set to NC to allow the OS console messages to display to the proper device This applies to all operating systems To manage the boot options list for each server use the...

Страница 89: ...etails see the following sections Setting HP UX boot options Setting OpenVMS boot options Setting Windows boot options Setting Linux boot options Autoboot Setting The autoboot setting determines at startup whether a server automatically loads the first item in the boot options list or remains at the EFI Boot Manager menu When autoboot is enabled EFI loads the first item in the boot options list af...

Страница 90: ...ss the server console When accessing the console confirm that you are at the EFI Boot Manager menu the main EFI menu If you are at another EFI menu choose the Exit option from the submenus until you return to the screen with the EFI Boot Manager heading From the EFI Boot Manager menu choose the EFI Shell menu option to access the EFI Shell environment 2 Access the EFI System Partition fsX where X ...

Страница 91: ...em To exit the server console and return to the iLO 2 MP Main Menu press Ctrl B To exit the iLO 2 MP enter X at the iLO 2 MP Main Menu Booting HP UX EFI Shell From the EFI Shell environment boot HP UX on a device by first accessing the EFI System Partition for example fs0 for the root device then entering HPUX to initiate the loader 1 Access the EFI Shell environment for the server on which you wa...

Страница 92: ...8 Lun0 blk4 Acpi 000222F0 2A8 Pci 0 1 Scsi Pun2 Lun0 Shell fs0 fs0 hpux c Copyright 1990 2002 Hewlett Packard Company All rights reserved HP UX Boot Loader for IA64 Revision 1 723 Press Any Key to interrupt Autoboot efi hpux AUTO boot vmunix Seconds left till autoboot 9 5 Exit the server console and iLO 2 MP interfaces when finished To exit the server console and return to the iLO 2 MP Main Menu e...

Страница 93: ...X Boot Loader HPUX prompt enter the boot is vmunix command to boot HP UX the stand vmunix kernel in single user is mode NOTE Due to the type of server you purchased your sysset output may not exactly match the output shown here HPUX boot is vmunix System Memory 4063 MB loading section 0 complete loading section 1 complete loading symbol table loading System Directory boot sys to MFS loading MFSFIL...

Страница 94: ... return to the iLO 2 MP Main Menu To exit the iLO 2 MP enter X at the Main Menu Shutting Down HP UX To shut down HP UX running on a system use the shutdown command You have the following options when shutting down HP UX To shut down and reboot an HP UX system use the shutdown r command To shut down and halt power off an HP UX system use the shutdown h command For details see the shutdown 1M manpag...

Страница 95: ...ger boot_options com OpenVMS I64 Boot Manager Boot Options List Management Utility 1 ADD an entry to the Boot Options list 2 DISPLAY the Boot Options list 3 REMOVE an entry from the Boot Options list 4 MOVE the position of an entry in the Boot Options list 5 VALIDATE boot options and fix them as necessary 6 Modify Boot Options TIMEOUT setting B Set to operate on the Boot Device Options list D Set ...

Страница 96: ...r the server on which you want to boot OpenVMS Log in to the iLO 2 MP and enterCO to choose the system console NOTE When accessing the console confirm that you are at the EFI Boot Manager menu the main EFI menu If you are at another EFI menu choose the Exit option from the submenus until you return to the screen with the EFI Boot Manager heading 3 At the EFI Boot Manager menu choose an item from t...

Страница 97: ...ms_loader efi HP OpenVMS Industry Standard 64 Operating System Version V8 3 Copyright 1976 2006 Hewlett Packard Development Company L P DECnet I LOADED network base image loaded version 05 13 00 SMP I CPUTRN CPU 02 has joined the active set SMP I CPUTRN CPU 03 has joined the active set SMP I CPUTRN CPU 01 has joined the active set SYSINIT I waiting to form or join an OpenVMS Cluster VMScluster I L...

Страница 98: ...Us to the Itanium BIB state Shutdown options NONE REBOOT_CHECK SHUTDOWN I BOOTCHECK performing reboot consistency check SHUTDOWN I CHECKOK basic reboot consistency check completed SHUTDOWN I OPERATOR this terminal is now an operator s console SHUTDOWN I DISLOGINS interactive logins will now be disabled SET I INTSET login interactive limit 0 current interactive value 1 SHUTDOWN I SHUTNET the DECnet...

Страница 99: ... on the device you are accessing However you must only initiate this loader from the EFI Boot Menu and not from the EFI Shell 3 List the contents of the EFI Microsoft WINNT50directory to identify the name of the Windows boot option file Boot00nn that you want to import into the system boot options list fs0 ls EFI Microsoft WINNT50 Directory of fs0 EFI Microsoft WINNT50 09 18 03 11 58a DIR 1 024 09...

Страница 100: ...r EFI menu choose the Exit option from the submenus until you return to the screen with the EFI Boot Manager heading 3 At the EFI Boot Manager menu choose an item from the boot options list Each item in the boot options list references a specific boot device and provides a specific set of boot options or arguments to be used when booting the device 4 Press Enter to initiate booting using the chose...

Страница 101: ...u can issue this command from a command prompt through the Special Administration Console SAC or from any other command line The Windows shutdown command includes the following options s Shuts down and halts power off the server This is the equivalent of Start Shut Down Shut down To power on the server use the iLO 2 MP PC command r Shuts down and restarts the server This is the equivalent of Start...

Страница 102: ...servers use the following procedures See Booting the Red Hat Enterprise Linux Operating System page 103 for details on Red Hat Enterprise Linux See Booting the SuSE Linux Enterprise Server Operating System page 104 for details on SuSE Linux Enterprise Server To shut down either Red Hat Enterprise Linux or SuSE Linux Enterprise Server see Shutting Down Linux page 105 Adding Linux to the Boot Option...

Страница 103: ...E Linux item as the first entry in the boot options list For details see the help bcfg command 4 Exit the console and iLO 2 MP interfaces if you are finished using them Enter Ctrl B to exit the system console and return to the iLO 2 MP Main Menu To exit the iLO 2 MP enter x at the Main Menu Booting the Red Hat Enterprise Linux Operating System You can boot the Red Hat Enterprise Linux operating sy...

Страница 104: ...f these methods Choose a SuSE Linux Enterprise Server entry from the EFI Boot Manager menu To load the SuSE Linux Enterprise Server operating system at the EFI Boot Manager menu choose its entry from the list of boot options Choosing a Linux entry from the boot options list boots the operating system using ELILO EFIloader and the elilo conffile Initiate the ELILO EFI Linux loader from the EFI Shel...

Страница 105: ...e Linux and SuSE Linux Enterprise Server shutdown command has the following options h Halts power off after shutdown Use the PC command at the iLO 2 MP Command menu to manually power on or power off server hardware as needed r Reboots after shutdown c Cancels an already running shutdown time When to shut down Required You can specify time in any of the following ways Absolute time in the format hh...

Страница 106: ...ironment page 138 Reporting Your Problems to HP page 139 Methodology General Troubleshooting Methodology There are multiple entry points to the troubleshooting process dependent upon your level of troubleshooting expertise the tools processes procedures which you have at your disposal and the nature of the system fault or failure Typically you select from a set of symptoms ranging from very simple...

Страница 107: ...very procedures you need to perform to finish the repair For example if the system board is replaced you need to restore customer specific information Should a failure occur the System Insight Display LEDs and the system event log SEL help you identify the problem or CRU LEDs The front panel LEDs and LAN LEDs of the server change color and blink to help identify specific problems The System Event ...

Страница 108: ...Points Subsection or Location Entry Point Basic and Advanced Troubleshooting Tables page 108 and Troubleshooting Tools page 113 Front panel System Insight Display LEDs Errors and Reading Error Logs page 120 System Event Log and Forward Progress Logs Troubleshooting Tools page 113 Offline and Online Diagnostics INIT button Troubleshooting Tools page 113 see also http h18023 ww1 hp com support svcto...

Страница 109: ...Steady green Steady green Off 8a in Table 5 4 Steady green Steady green Steady green Steady green off 5 6 and 7 in Tables 5 3 and 5 4 Steady green Steady green Steady green Steady green Table 5 3 Basic Low End Troubleshooting Action Condition Step Nothing is logged for this condition 1 For new server installations review the install procedures Server appears dead no front panel LEDs are on and no ...

Страница 110: ...130 for details The preceding problem is fixed when iLO 2 MP logs are read and the front panel LED states are as follows system health is off internal health is off steady green external health is steady green power is steady green A warning or critical failure has been detected and logged while booting or running system Both front panel system health LED and internal health LED are flashing amber...

Страница 111: ...et Supported settings are hpterm VT100 default and VTUTF8 2 Verify that the RS 232C configuration matches between the server and the local console or modem See Supported Configurations page 123 for details 3 Look for loose damaged or disconnected power and signal cables on the I O backplane The preceding problem is fixed when iLO 2 MP menu appears on the system console and the system health is ste...

Страница 112: ... Examine the iLO 2 MP logs for entries related to processors processor power modules PPMs shared memory and core I O devices see Errors and Reading Error Logs page 120 for details NOTE Be sure to check the console settings from the Boot Manager for your OS The preceding problem is fixed when OS prompt appears on the system console Table 5 4 Advanced Low End Troubleshooting Action Symptom Condition...

Страница 113: ...ashing amber external health is steady green power is steady green troubleshooting actions for this System firmware is running to gather and log all error data for this MCA event 1 Examine the iLO 2 MP logs for entries related to processors processor power modules PPMs shared memory and core I O devices See Errors and Reading Error Logs page 120 for more details step are identical to those in Step...

Страница 114: ...ort that they are good or on any ac standby power cycle The iLO 2 MP displays the following strings in its Virtual Front Panel for the three states of this LED Table 5 6 VFP External Health Description none Off External parts including fans and power supplies okay On green A redundant externally accessible CRU failed check front back LEDs Flashing amber Internal Health LED The front panel internal...

Страница 115: ...cluding CPUs and memory okay On Green An internally accessible CRU failed check System Insight Display Flashing Amber System Health LED The rx2660 server has this LED for the following reasons To carry forward the ATTENTION functionality of legacy Integrity and HP9000 front panel designs To give the customer an indication of whether the system is up or down external and internal health LEDs do not...

Страница 116: ...d you push it again to turn off the LED Pressing the front panel Switch LED or entering the iLO 2 MP and LOC commands lights the rear panel LED and vice versa Off Off Blue Not flashing Identification System Insight Display LEDs The System Insight Display improves serviceability by allowing you to look in a single location for the LEDs that provide failing CRU locating mapping information These amb...

Страница 117: ... support them are installed on the managed server On HP UX systems the legacy tools within OnlineDiag are supported The online support tools on the HP UX 11 23 and greater operating systems include the Support Tool Manager STM tools and the additional Web Based Enterprise Management WBEM features added by SysFaultMgmt The STM suite of tools includes verifiers diagnostics exercisers information mod...

Страница 118: ... tools are provided through Insight Manager IM7 on Linux hosted systems The exact coverage of these tools is the same as for the current IA 32 implementation The IPF version of Insight Manager IM7 has been re architected to take advantage of current standards for example WBEM WMI CDM CIM XML Offline Support Tools List The following offline support tools are available Table 5 13 Offline Support Too...

Страница 119: ...y occur To diagnose problems automatically at the time of detection To automatically report in understandable text a description of the problem the likely cause s of the problem the recommended action s to resolve the problem and detailed information about the problem To ensure that tools are available to repair or recover from the fault HP UX Fault Management Proactive fault prediction and notifi...

Страница 120: ...logs would only identify the failed CPU as the most likely faulty CRU Following are some important points to remember about events and event logs Event logs are the equivalent of the old server logs for status or error information output Symbolic names are used in the source code for example MC_CACHE_CHECK The hex code for each event log is 128 bits long with an architected format Some enumerated ...

Страница 121: ...rator login and password login oper password oper 2 Press cl to display the console history log This log displays console history from oldest to newest 3 Press sl to display the status logs The status logs consist of System Event Forward Progress Current Boot Previous Boot Live Events Clear SEL FPL Logs 4 For a more information on configuring the iLO 2 MP and using the iLO 2 MP commands see the HP...

Страница 122: ...shold or Q to quit filter setup 3 Alert threshold level 3 filter will be applied Set up alert filter options on this buffer Y N Log Name Entries Full Latest Entry E System Event 410 47 18 Feb 2003 09 38 10 Event Log Navigation Help View next block forward in time e g from 3 to 4 View previous block backward in time e g from 3 to 2 CR Continue to the next or previous block D Dump the entire log for...

Страница 123: ... invalid and has been cleared Logged by System Firmware 0 Data Data field unused 0x60800F8D00E00090 0000000000000000 Log Entry 4 23 Jun 2006 13 39 35 Alert Level 3 Warning Keyword COOLING_UNIT_WARNING Cooling unit warning Logged by Baseboard Management Controller Sensor Cooling Device Fan 11 I O Data1 transition to Non Critical from OK 0x20449BEF17020050 FFFF01072B0A0300 NOTE Due to the type of se...

Страница 124: ...kplane and system board CRUs NOTE In the following steps CRU and FRU are used interchangeably 4 Plug in the ac power cord s and the iLO 2 MP and system console should display and you should have the following CRU IDs listed after executing the MP DF command Your display may not exactly match the display shown FRU IDs 02 Power Converter 03 Power Supply 0 04 Power Supply 1 05 Diagnostic Panel 06 Fro...

Страница 125: ...uld look something like the following Your display may not exactly match the display shown FRU IDs 0001 Memory 0002 Power Converter 0003 Power Supply 0 0004 Power Supply 1 0005 Diagnostic Panel 0006 Front Panel 0007 Disk Management 0008 Disk backplane 0010 Processor Board 0012 Power Pod 0 0013 Power Pod 1 0032 CPU 0 PIROM 0033 CPU 1 PIROM 0036 Processor 0 RAM 0037 Processor 1 RAM 0128 DIMM0A 0136 ...

Страница 126: ...CA events cause the physical CPU core and one or both of its logical CPUs within that IPF processor module to fail while all other physical and their logical CPUs continue operating Double bit data cache errors in any physical CPU core causes a Global MCA event that causes all logical and physical CPUs in the server to fail and reboot the operating system Customer Messaging Policy A diagnostic LED...

Страница 127: ...essors and or Type E0h 2953d 26d BOOT_CPU_LOADING_ERROR Processors termination out of order SFW A logical CPU thread failed late self test Type E0h 36d 26d BOOT_CPU_LATE_TEST_FAIL Processors SFW A logical CPU thread slave Type E0h 677d 26d MC_RENDEZVOUS_SLAVES_FAIL Processors failed to rendezvous SFW A CPU core failed the Type E0h 30d 26d BOOT_CPU_CONFIG_FAIL Processors configuration process SFW A...

Страница 128: ...of pairs is as follows slots 0A and 0B then slots 1A and 1B then 2A and 2B then 3A and 3B Memory Subsystem Behaviors The zx2 chip in the rx2660 server provides increased reliability of DIMMs For example previous low end servers with zx1 chips provided error detection and correction of all memory DIMM single bit errors and error detection of most multi bit errors within a memory DIMM pair or 4 bits...

Страница 129: ...0 of cell 0 SFW No DIMMs installed in rank 0 of cell 0 Type E0h 208d 04d MEM_NO_DIMMS_INSTALLED DIMMs Either EEPROM is misprogrammed SFW A DIMM has a serial presence detect SPD Type E0h 172d 04d MEM_DIMM_SPD_CHECKSUM DIMMs or this DIMM is incompatible EEPROM with a bad checksum Memory rank is about to fail or WIN Agent This memory rank is correcting too many single bit errors Type E0h 4652d 26d WI...

Страница 130: ...status remotely with the iLO MP pc and ps commands respectively Typical power up sequence of the server is as follows Power LED on front panel glows steady amber when one or two bulk power supplies are plugged into nominal ac voltage and the 3 3 VDC housekeeping voltage comes on and stays on whenever ac power is present The BMC iLO 2 MP Flash memory and server intrusion circuits are reset after th...

Страница 131: ...al cooling fan CRU failures are identified visually by a single green LED on the dual fan assembly CRU that is turned on when one or both of the fans fail logged as an IPMI event by fan sensor logic and identified as a fan assembly CRU failure by the BMC turning on the appropriate LEDs on the System Insight Display panel Cooling Subsystem Behavior The BMC chip located on the system board CRU contr...

Страница 132: ...Display IPMI events in SEL FPL provide the logical ACPI path of suspect I O subsystem CRU Use Table 5 23 to determine the physical PCI slot number For configuration style errors for example no iLO 2 MP core I O HBAs installed or working see Supported Configurations subsection for actions Some diagnostic messages are reported for high level I O subsystem errors all fatal I O subsystem errors cause ...

Страница 133: ...h 148d 26d IO_UNKNOWN_PCIXCAP_VAL I O Card SFW PCIXCAP sampling error Type E0h 141d 26d IO_PCIXCAP_SAMPLE_ERROR I O Card SFW Expected I O host bridge Lower Bus Adapter is missing Type E0h 123d 26d IO_CHECK_LBA_MISSING_ERR I O Card SFW Expected I O host bridge Lower Bus Type E0h 619d 26d IO_CHECK_LBA_DECONFIG_ERR I O Card Adapter is deconfigured SFW I O LBA clear error failed Type E0h 133d 26d IO_L...

Страница 134: ...0002 PNP0A08 300 Pci 0 0 4 7 2 public PCI e 333 MHz Acpi HWP0002 PNP0A03 600 Pci 1 0 10 11 3 public PCI X 133 MHz Management Subsystem iLO 2 MP LAN LED on the Rear Panel The iLO 2 MP LAN supports two LEDs viewable from the rear of the system 1 iLO 2 MP LAN LED which indicates link activity status 2 LAN LED which shows the link speed Only 10 Mb and 100 Mb speeds are currently supported on the iLO 2...

Страница 135: ...he manageability status LED indicates the state and health of the iLO 2 MP It is visible from the rear of the server The states are as follows Table 5 27 Manageability Status LED Definition LED State iLO 2 MP is not responding Off Self Test Steady Amber Heartbeat 0 5 Hz Flashing Green ROM Error 1 Hz Flashing Amber I O Subsystem SAS DVD HDD Verifying SAS Disk Drive Operation Each SAS disk drive has...

Страница 136: ...Speed left Green the 100 MHz with Ethernet protocol is enabled Off no link Green link Link right Off No link Table 5 29 shows the 1 Gb LAN 2 LEDs on the rear panel of the server Table 5 29 Gb LAN 2 Connector LEDs Description LED Yellow the 1000 MHz with Ethernet protocol is enabled Speed left Green the 100 MHz with Ethernet protocol is enabled Off no link Green link Link right Off No link Booting ...

Страница 137: ...vailable at this time for example they are not initially configured 5 Firmware code stack is initially in BBRAM in PDH retrieved 4 byes at a time through PDH and DMD buses 5 PAL code configures all CPUs 5 SAL code configures all platform zx2 chips including shared memory and all responding I O devices 5 Firmware code and stack are relocated to shared memory after all x4 DIMM ranks in shared memory...

Страница 138: ... the rx2660 server HP UX uses the RS 232 serial text connection to a dumb terminal or terminal emulator software running on a PC to control server operations locally HP UX alternatively uses the iLO 2 MP LAN connection over a private network to control server operations locally through telnet or SSH and remotely over a public network through web GUI Both the Windows and LINUX operating systems use...

Страница 139: ...ntacting the HP IT Resource Center ITRC near you go to http www itrc hp comhttp www itrc hp com Online Support To contact HP Customer Support online see the Worldwide Limited Warranty and Technical Support Guide or visit us at http www hp com go bizsupport On our web page enter the server model number rx2660 and search the field The following information is available on this website Software and f...

Страница 140: ...n label 3 Be familiar with your system configuration Are you using the LAN RS 232 or web interface to monitor the server How many processors DIMMs and PCI cards have been installed What versions of processor memory and PCI cards are used and where are they installed What accessories are installed 4 Determine the following Which firmware versions are in use When did the problem start Have recent ch...

Страница 141: ... Removing and Replacing the I O Backplane Assembly page 167 Removing and Replacing a PCI X PCIe Card page 170 Removing and Replacing the Fan Display Board page 171 Removing and Replacing System Memory page 174 Removing and Replacing a Processor page 176 Removing and Replacing the Power Supply Housing page 183 Removing and Replacing the System and iLO 2 MP Battery page 186 Removing and Replacing th...

Страница 142: ...he server or on other hardware compoonents Do not wear clothing subject to the buildup of static electricity such as wool or synthetic materials If installing an internal assembly wear an antistatic wrist strap and use a grounding mat such as those included in the Electrically Conductive Field Service Grounding Kit HP 9300 1155 Handle accessory boards and components by the edges only Do not touch ...

Страница 143: ...e Diagnostic board Fan display board SAS backplane System board Accessing a Rack Mounted Server The server is designed for rack mounting The following procedure explains how to gain access to the HP Integrity rx2660 that is mounted in an approved rack For rack installation instructions review the documentation in the universal rack mounting kit included with your server WARNING Ensure that all ant...

Страница 144: ...tion the server fans return to normal speed 15 minutes After 15 continuous minutes of having the chassis cover open the BMC executes a soft shutdown It tells the operating system to gracefully shut the operating system down Once the operating system accomplishes this and communicates it to the BMC system power is turned off 30 minutes After 30 continuous minutes of having the chassis cover open th...

Страница 145: ...rresponding slots in the server and insert the tabs into the slots 1 3 Slide the cover forward until it is flush with the front of the server 2 4 Push the cover release lever down into the latched position 3 5 Lock the cover release lever if required by turning the cam approximately 90 degrees clockwise 4 6 Replace the allen wrench on the rear panel of the server Removing and Replacing the Top Cov...

Страница 146: ... server directs airflow from the system fans to the processors and the system memory on the system board Use the following procedures to remove and replace the airflow guide Removing the Airflow Guide To remove the airflow guide from the server follow these steps 146 Removing and Replacing Server Components ...

Страница 147: ... the Top Cover page 144 Figure 6 4 shows the airflow guide location in the server Figure 6 4 Airflow Guide Location 2 Lift the fan carrier handle up approximately 3 cm 1 5 in 1 See Figure 6 5 Removing and Replacing the Airflow Guide 147 ...

Страница 148: ...low these steps 1 Ensure the fan carrier handle is raised enough to replace the airflow guide 2 Place the airflow guide on the edge of the fan carrier and push it down into place on the processor cage 1 See Figure 6 6 page 149 3 Push the fan carrier handle down until it is flush against the airflow guide 2 148 Removing and Replacing Server Components ...

Страница 149: ...e fans cool the Data Center server The fans are all redundant hot swappable and interchangeable Fans 1 through 8 are located in a removable fan carrier directly behind the front bezel Fan units 9 through 12 are located in a removable I O fan carrier between the SAS backplane and the I O card cage The server is set up into three cooling zones Fans 1 through 4 cool Zone 1 Fans 5 through 8 cool Zone ...

Страница 150: ...fan carrier between the SAS backplane and the I O card cage The server is set up into three cooling zones Fans 1 and 2 cool Zone 1 Fan 3 and 4 cool Zone 2 Fans 5 and 6 cool Zone 3 Fan redundancy is only supported in Zone 1 and Zone 3 If you lose one fan rotor in either of these zones the rest of the fans in that zone run at maximum speed and the server does not shut down If you lose one fan rotor ...

Страница 151: ...ver NOTE A hot swappable device does not require interaction with the operating system before the device is removed from or installed into the server To remove a server fan unit follow these steps 1 If rack mounted slide the server completely out from the rack See Extending the Server from the Rack page 143 2 Remove the top cover See Removing the Top Cover page 144 Removing and Replacing a Hot Swa...

Страница 152: ...When removing fans from a Data Center server insert thumb and forefinger into the openings on the top of the fan and squeeze until the fan releases from the socket 1 See Figure 6 9 When removing fans from an Office Friendly server use two hands to squeeze the two latches on the server fan 1 See Figure 6 10 4 Pull the fan straight up and out of the server 2 CAUTION Be careful when removing fans If ...

Страница 153: ...ew fan LED to turn off 2 Check the diagnostic LED on the front panel that corresponds to the replaced fan unit If the fan is functioning normally the LED turns off If the fan fails the LED is lit amber 3 Replace the top cover See Replacing the Top Cover page 145 Removing and Replacing a Hot Swappable Power Supply Depending on the server you have the different servers have different power requireme...

Страница 154: ...e left is P2 See Figure 6 11 The supported configuration for the Office Friendly server requires that both power supplies be installed CAUTION When a second power supply is not used Data Center server only the empty power supply slot must remain covered with the supplied metal filler panel Failure to observe this caution can result in damage due to overheating Install the hot swappable power suppl...

Страница 155: ...power cord to the power cord anchor attached to the power supply Removing and Replacing a Hard Drive Filler There are hard drive fillers installed in a vertical orientation for all slots that do not contain a hard drive The slot fillers are hot swappable IMPORTANT For cooling purposes always leave hard drive fillers in slots that do not contain a hard drive Removing a Hard Drive Filler To remove a...

Страница 156: ...es Supported capacities are as follows 36 GB 73 GB 146 GB CAUTION A hot pluggable device might require that you interact with the operating system before you can safely remove it from or install it into the server Verify that the operating system supports removing and replacing disk drives while the operating system is running If the operating system does not support this feature shut down the ope...

Страница 157: ...SAS hard drive filler if required See Removing a Hard Drive Filler page 155 NOTE Save the SAS hard drive filler for future use For cooling purposes always place hard drive fillers in empty drive slots 2 Insert the SAS hard drive into the slot guides and slide the drive into the slot until it seats into the socket on the disk backplane 1 See Figure 6 14 page 157 for installation procedures 3 Close ...

Страница 158: ...er Removing the DVD Drive To remove the DVD drive follow these steps 1 Power off the server and disconnect the power cables See Powering On and Powering Off the Server page 78 2 Insert a tool such as a flat head screwdriver that fits into the release slot to the left of the DVD drive and then push firmly to eject the drive out of the bay 1 3 Pull the DVD drive straight out to remove it from the se...

Страница 159: ...oving the Top Cover page 144 5 Remove the system fans in the fan carrier See Removing a Server Fan page 151 6 Remove the fan carrier See Removing the Fan Carrier Assembly page 162 7 Disconnect the System Insight Display power cable from the fan display board See Figure 6 17 8 Remove the T 10 bezel screw next to the System Insight Display on the inside of the server See Figure 6 17 Figure 6 17 Beze...

Страница 160: ...e system is powered off and all power sources are disconnected from the server prior to performing this procedure Voltages are present at various locations in the server whenever an ac power source is connected This voltage is present even when the main power switch is off Failure to observe this warning can result in personal injury or equipment damage CAUTION Observe all ESD safety precautions b...

Страница 161: ...front bezel on the front of the server See Replacing the Front Bezel page 160 4 Reconnect the System Insight Display power cable to the fan display board 5 Replace the front fan carrier assembly See Replacing the Fan Carrier Assembly page 164 6 Replace the fans into the fan carrier See Replacing a Server Fan page 153 7 Replace the top cover See Replacing the Top Cover page 145 8 Reconnect the powe...

Страница 162: ...t bezel that houses eight of the 12 server fans if you have a Data Center rx2660 server or four of the six fans if you have an Office Friendly Server WARNING Ensure that the system is powered off and all power sources are disconnected from the server prior to performing this procedure Voltages are present at various locations in the server whenever an ac power source is connected This voltage is p...

Страница 163: ...See Removing a Server Fan page 151 5 Lift up on the fan carrier assembly handle and rotate it approximately 90 degrees 1 See Figure 6 19 Figure 6 19 Removing and Replacing the Fan Carrier Assembly Removing and Replacing the Fan Carrier Assembly 163 ...

Страница 164: ...rier Assembly Removed Figure 6 21 Office Friendly Server Fan Carrier Assembly Removed Replacing the Fan Carrier Assembly This procedure applies to the Data Center rx2660 server fan assembly or the Office Friendly server fan assembly To replace the fan carrier assembly follow these steps 164 Removing and Replacing Server Components ...

Страница 165: ...an ac power source is connected This voltage is present even when the main power switch is in the off position Failure to observe this warning can result in personal injury or damage to equipment CAUTION Observe all ESD safety precautions before attempting this procedure Failure to follow ESD safety precautions can result in damage to the server Removing the I O Fan Carrier Assembly This procedure...

Страница 166: ...an Carrier Assembly 2 1 T 15 screws 4 Power cable Figure 6 23 Removing and Replacing the Office Friendly Server I O Fan Carrier Assembly 2 1 T 15 screws 4 Power cable 7 Lift the assembly straight up and out of the server 166 Removing and Replacing Server Components ...

Страница 167: ...ssembly Observe the following warning and cautions before removing the I O backplane assembly WARNING Ensure that the system is powered off and all power sources are disconnected from the server prior to performing this procedure Voltages are present at various locations in the server whenever an ac power source is connected This voltage is present even when the main power switch is in the off pos...

Страница 168: ...ob b Turn the black knob counter clockwise until the captive screw is free from the system board Figure 6 24 Removing the I O Backplane Assembly 6 Lift the assembly straight up and out of the server Figure 6 25 page 169 shows the PCI X and the PCIe PCI X backplane assemblies 168 Removing and Replacing Server Components ...

Страница 169: ...he guide slots in the server and slide the I O backplane assembly into place 3 Tighten the two captive screws See Figure 6 24 a Press the black knob down while turning it clockwise until it is fully tightened b While holding the black knob and pressing down press and release the blue button to lower the black knob to the locked position 4 Replace the top cover See Replacing the Top Cover page 145 ...

Страница 170: ...ent location might require system reconfiguration To remove a PCI X PCIe card follow these steps 1 Power off the server and disconnect the power cables See Powering On and Powering Off the Server page 78 2 If rack mounted slide the server completely out from the rack See Extending the Server from the Rack page 143 3 Remove the top cover See Removing the Top Cover page 144 4 Disconnect all internal...

Страница 171: ...eplace the slotted T 15 screw that attaches the card bulkhead to the server use a T 15 driver to turn the screw clockwise until it tightens to the server 11 Install the I O backplane assembly into the server See Replacing the I O Backplane Assembly page 169 12 Connect all internal and external cables to the PCI cards in the I O backplane assembly 13 Replace the top cover See Replacing the Top Cove...

Страница 172: ...rom the server The procedure for removing the fan display board for the Data Center server is the same for the Office friendly server Removing the Fan Display Board To remove the fan display board follow these steps 1 Power off the server and disconnect the power cables See Powering On and Powering Off the Server page 78 2 If rack mounted slide the server completely out from the rack See Extending...

Страница 173: ... openings on the front bezel and place the fan display board onto the guide pins Shuttle the board toward the front of the server until it locks into place 3 2 Turn the knurled thumb screws clockwise until the board is secured into place 2 3 Reconnect the five cables into the connectors on the fan display board 1 4 Replace the fan carrier See Replacing the Fan Carrier Assembly page 164 5 Replace t...

Страница 174: ...y precautions before attempting this procedure Failure to follow ESD safety precautions can result in damage to the server Removing System Memory To remove system memory follow these steps 1 Power off the server and disconnect the power cables See Powering On and Powering Off the Server page 78 2 If rack mounted slide the server out from the rack until it stops See Extending the Server from the Ra...

Страница 175: ...system degradation or failure Do not mix DIMM sizes or types in a pair Load DIMM pairs in order of size from largest to smallest For example if you are installing a pair of 4 GB DIMMs and a pair of 1 GB DIMMs install the pair of 4 GB DIMMs first Table 6 1 lists the memory load order Table 6 1 Memory Load Order Memory Slots Pair Number 0A 0B 1 1A 1B 2 2A 2B 3 3A 3B 4 Memory Loading Rules and Guidel...

Страница 176: ...n the DIMM b Firmly and evenly push on each end of the DIMM until it seats into the slot c Ensure the extraction levers are in the fully closed position 6 Verify the DIMM installation by using the one of the following system utilities iLO 2 MP DF command EFI info mem command 7 Replace the airflow guide See Replacing the Airflow Guide page 148 8 Replace the top cover See Replacing the Top Cover pag...

Страница 177: ...you must install the second processor in the CPU 1 slot Table 6 3 lists the processor load sequence Table 6 3 Processor Load Order Slot Processor CPU 0 1 CPU 1 2 Required Tools To install and remove processors use the processor install tool fastened to the airflow guide Removing a Processor To remove a processor follow these steps 1 Power off the server and disconnect the power cables See Powering...

Страница 178: ...the locking mechanism more than 180 degrees can severely damage the socket d Refasten the processor install tool 2 5 mm driver to the tool holder on the airflow guide 8 Remove the processor from the processor slot a Carefully grasp the sheet metal that encases the processor b Pull the processor straight up and out of the server 9 Protect the processor from damage a Install the protective pin cover...

Страница 179: ...he processor Figure 6 30 Processor Power Connectors and Cables Figure 6 31 shows the processor ZIF socket location and the alignment holes of an installed processor 3 2 1 Processor Power cable from the system board Power connector on the processor Removing and Replacing a Processor 179 ...

Страница 180: ...rocessor 0 7 ZIF socket for processor 1 8 Processor slot 1 dust cover 3 Processor 0 in slot 0 4 Alignment hole on processor 9 Alignment post on processor cage 10 5 Processor 1 slot label module 1 Alignment post on processor cage Figure 6 32 shows the ZIF socket in the unlocked position 180 Removing and Replacing Server Components ...

Страница 181: ...9 IMPORTANT Ensure the processor slot is entirely exposed The processor must clear the cage enclosure for proper installation 6 Locate the appropriate processor slot CPU 0 or CPU 1 for the processor installation See Figure 6 31 for the slot locations on the system board 7 Remove the plastic airflow blocker covering the processor slot if necessary 8 Remove the protective dust cover from the process...

Страница 182: ...ing to turn the locking mechanism more than 180 degrees can severely damage the socket d Fasten the processor install tool 2 5 mm driver to the tool holder on the airflow guide 14 Connect the processor power cable into the connector cable that attaches directly to the processor board See Figure 6 30 15 Close the processor cage See Figure 6 29 a Grasp the processor cage handle and rotate the cage c...

Страница 183: ...recautions can result in damage to the server Removing the Power Supply Housing To remove the power supply housing follow these steps 1 Power off the server and disconnect the power cables See Powering On and Powering Off the Server page 78 2 If rack mounted slide the server completely out from the rack See Extending the Server from the Rack page 143 3 Remove the top cover See Removing the Top Cov...

Страница 184: ...Tighten the three captive screws a Press the black knob down while turning it clockwise until it is fully tightened b While holding the black knob and pressing down press and release the blue button to lower the black knob to the locked position 3 Replace the top cover See Replacing the Top Cover page 145 4 If rack mounted slide the server completely into the rack See Inserting the Server into the...

Страница 185: ...e power supply riser board follow these steps 1 Power off the server and disconnect the power cables See Powering On and Powering Off the Server page 78 2 Remove the power supplies from the server See Removing a Power Supply page 154 3 If rack mounted slide the server completely out from the rack See Extending the Server from the Rack page 143 4 Remove the top cover See Removing the Top Cover page...

Страница 186: ...this procedure Voltages are present at various locations in the server whenever an ac power source is connected This voltage is present even when the main power switch is in the off position Failure to observe this warning can result in personal injury or damage to equipment CAUTION Observe all ESD safety precautions before attempting this procedure Failure to follow ESD safety precautions can res...

Страница 187: ...using the method you used to back them up 5 Reset the server date and time using the EFI date and time commands Installing the Battery Clip The battery clip installs ONLY on servers that were built with the Lotes battery holder System boards with an EDC of 4739 Tyco battery holder DO NOT require the battery clip and will not work with the battery clip To determine if your server has an EDC earlier...

Страница 188: ...serve all ESD safety precautions before attempting this procedure Failure to follow ESD safety precautions can result in damage to the server 1 Remove the top access cover See Removing the Top Cover page 144 2 Locate the system battery and the MP battery in the Lotes battery holder Figure 6 37 shows a battery in a battery holder Figure 6 37 Battery and Holder 3 Insert the battery clip over the sys...

Страница 189: ...ating system to utilize the TPM security component WARNING Ensure that the system is powered off and all power sources are disconnected from the server prior to performing this procedure Voltages are present at various locations in the server whenever an ac power source is connected This voltage is present even when the main power switch is in the off position Failure to observe this warning can r...

Страница 190: ...n on the male connector on the system board b Push the TPM straight down into the socket until it is fully seated See Figure 6 40 2 Replace the top cover See Replacing the Top Cover page 145 3 If rack mounted slide the server completely into the rack See Inserting the Server into the Rack page 144 4 Reconnect the power cables and power on the server See Powering On and Powering Off the Server page...

Страница 191: ... when the main power switch is off Failure to observe this warning can result in personal injury or equipment damage CAUTION Observe all ESD safety precautions before attempting this procedure Failure to follow ESD safety precautions can result in damage to the server Removing the Optional Smart Array P400 Controller and Battery To remove the optional Smart Array P400 controller follow these steps...

Страница 192: ...arly marked with the correct channels Figure 6 41 Smart Array P400 Controller Location on System Board 4 3 1 RAID battery port on the SAS Smart Array P400 controller SAS Smart Array P400 controller board lock SAS Smart Array P400 controller 2 SAS cable ports on the SAS Smart Array P400 controller 5 Disconnect the battery cable from the Smart Array P400 controller card 6 Grasp the card by the edges...

Страница 193: ...e Removing the PCIe Expansion Board To remove the PCIe expansion board follow these steps 1 Power off the server and disconnect the power cables See Powering On and Powering Off the Server page 78 2 If rack mounted slide the server completely out from the rack See Extending the Server from the Rack page 143 3 Remove the top cover See Removing the Top Cover page 144 4 Pinch the board rail clips to ...

Страница 194: ...S core I O Smart Array P400 controller board lock See Figure 6 41 CAUTION When reconnecting the SAS cables note the labeling on the channel cables Match each cable with the appropriate socket on the SAS core I O board If the cables are mismatched the server will not reboot Both cables and sockets are clearly marked with the correct channels 2 Reconnect the internal SAS cables to the SAS core I O S...

Страница 195: ...ion Board page 195 7 Reconnect the power cables and power on the server unless you continue with replacing the PCIe expansion board See Powering On and Powering Off the Server page 78 or Replacing the PCIe Expansion Board page 195 Replacing the PCIe Expansion Board To replace the PCIe expansion board follow these steps 1 Make sure the board rail clip are in the open position 2 Guide the PCIe expan...

Страница 196: ... a parallel data communication environment multiple devices share one bus all data travels over the same cable and through the same port SAS provides serial or point to point data transfer A point to point architecture means that each device has its own private bus cable and port This architecture improves the reliability and availability of data and greatly enhances data transfer rates Current da...

Страница 197: ...ck mounted slide the server completely out from the rack See Extending the Server from the Rack page 143 3 Remove the top cover See Removing the Top Cover page 144 4 Slide the SAS drives and fillers approximately two inches out of the drive bays See Removing a SAS Hard Drive page 156 CAUTION When disconnecting the SAS cables note the labeling on the cables When reconnecting these cables match each...

Страница 198: ...el cables Match each cable with the appropriate socket on the SAS backplane If the cables are mismatched the server will not function correctly Both cables and sockets are clearly marked with the correct channel 6 Push the release mechanism toward the back of the server to secure the SAS backplane to the server 3 7 Replace the SAS disk drives See Replacing a SAS Hard Drive page 157 8 Replace the t...

Страница 199: ... board record all boot configuration settings find the settings using the INFO ALL EFI command You must reset these values after replacing the battery Use the LS EFI command to gather the LAN configuration information You can also use the non volatile RAM configuration backup NVRAM backup utility to back up and store these values The utility is located on the HP website at http www hp com go bizsu...

Страница 200: ...nect the power cable that attaches the Smart Array P400 controller board to the battery on the airflow guide if necessary 15 Remove the Smart Array P400 controller backplane and the PCIe expansion card if necessary 16 Remove the I O fan carrier See Removing the I O Fan Carrier Assembly page 165 17 Disconnect the cables that attach to the system board 1 See Figure 6 47 18 Pull up on the post in the...

Страница 201: ...an Carrier Assembly page 167 4 Reconnect the power cable that attaches to the SAS backplane 5 Replace the Smart Array P400 controller backplane and PCIe expansion card if necessary 6 Reconnect the power cable that attaches to the Smart Array P400 controller backplane and the PCIe expansion card if necessary 7 Reconnect the internal SAS cables CAUTION When reconnecting the SAS cables match each cab...

Страница 202: ...r See Powering On and Powering Off the Server page 78 18 Restore boot LAN and iLO 2 MP settings recorded in step Step 1 of the procedure see Removing the System Board page 199 when prompted by the server 202 Removing and Replacing Server Components ...

Страница 203: ... designed for customer self repair If however you require that HP replace them for you there may or may not be additional charges depending on the type of warranty service designated for your product No Some HP parts are not designed for customer self repair To satisfy the customer warranty HP requires that an authorized service provider replace the part Based on availability and where geography p...

Страница 204: ...n to ensure you have the latest part numbers associated with this server Table A 2 HP Integrity rx2660 CRU List Customer Self Repair Exchange Part Number Replacement Part Number Description Manufacturing Part Number Processors BY AD252 6900A AD252 2100D CPU module 1 4 GHz 12 MB dual core AD252 2100D AD252AX BY AH237 6900A AH237 2100A CPU module 1 4 GHz 12 MB dual core1 AH237 2100A AH237AX BY AD249...

Страница 205: ...19 Display fan board Office Friendly AB419 60011 AY n a AB419 67009 I O fan board AB419 60009 AY n a AB419 67020 I O fan board Office Friendly AB419 60012 Internal Disks Removable Media AY 376596 001 36 GB SAS hard drive 375863 001 AY 376597 001 72 GB SAS hard drive 375863 002 AY 432320 001 432320 001 146 GB SAS hard drive 431959 B21 AY n a AD142 2100B DVD drive AD142 2100B AY n a AD143 2100B DVD ...

Страница 206: ... filler panel 376383 002 AY n a 229567 001 DVD filler panel 229567 001 AY n a AB419 67016 Airflow guide with hex tool n a AY n a AB463 3440A CPU air blocker AB463 3440A AY n a 234556 001 PDH battery CR2032 234556 001 n a 234556 001 System Battery located on the System board CR2032 234556 001 n a 234556 001 iLO MP Battery located on the System board CR2032 234556 001 1 Required for Office Friendly ...

Страница 207: ...ot 3 of the PCI X PCIe backplane runs at 133 MHz The card runs at the slower speed if used in slot 3 of the PCI X PCIe backplane The hardware path to slot 3 changes from the PCI X backplane to the PCI X PCIe backplane You are required to make configuration changes to enable this card in slot 3 of the PCI X PCIe backplane If disks are attached to a host bus adapter HBA in slot 3 use the HP UX volum...

Страница 208: ...rically Conductive Field Service Grounding Kit Handle accessory boards and components by the edges only Do not touch any metal edge connectors or any electrical components on accessory boards WARNING To reduce the risk of personal injury from hot surfaces allow the internal server components to cool before touching them Upgrading the I O Backplane Use these procedures to upgrade the I O backplane ...

Страница 209: ...To remove the I O backplane assembly follow these steps 1 Disconnect any cables attached to the I O cards in the I O backplane assembly 2 Loosen the two captive screws that hold the I O backplane assembly to the system board See Figure B 1 for the screw locations a Press the blue button to release the black knob b Turn the black knob counterclockwise until the captive screw is free from the system...

Страница 210: ... Backplane Board from the I O Backplane Assembly Use this procedure to remove the I O backplane from the I O backplane assembly 1 Remove the three T 15 screws that attach the PCI X backplane to the I O backplane assembly Figure B 2 page 210 shows the locations of the T 15 screws 2 Slide the PCI X backplane down to release it from the posts on the I O backplane assembly and lift it from the I O bac...

Страница 211: ...ts on the I O backplane assembly Figure B 4 page 211 shows the locations of the posts on the I O backplane assembly 2 Slide the I O backplane up to lock it onto the I O backplane assembly posts Figure B 4 Installing the PCI X PCIe I O Backplane 5 PCI X PCIe I O backplane keyways 1 Slot 1 PCIe x8 2 Slot 2 PCIe x8 6 I O backplane posts 7 3 Slot 3 PCI X 133 MHz Bulkhead T 15 thumbscrews 4 PCI X PCIe ...

Страница 212: ...ing the black knob and pressing down press and release the blue button to lower the black knob to the locked position Replacing the Top Cover For instructions on replacing the top cover see Replacing the Top Cover page 145 Installing the Server Into the Rack For instructions on inserting the server back into the rack see Inserting the Server into the Rack page 144 Installing the Server Into a Pede...

Страница 213: ...grity rx2660 server supports upgrades from Dual Core Intel Itanium 2 processors 9000 series to Intel Itanium Dual Core Intel Itanium 2 processors 9150M CAUTION Intel Itanium Dual Core Intel Itanium 2 processors 9150M cannot be intermixed with similar Dual Core Intel Itanium 2 processors 9000 series Processor speed and cache size must be identical for all processors in a system To ensure compatibil...

Страница 214: ...nd OS updates are performed follow the processor removal and replacement procedures see Removing and Replacing a Processor page 176 Firmware Before upgrading the processor ensure the server is at the required system firmware level Check the system firmware version by executing the info fw command at the EFI Shell prompt NOTE HP recommends using the latest version of firmware System firmware update...

Страница 215: ...nment POSSE are similar EFI is an Intel specification whereas POSSE is the HP implementation that aids HP support EFI consolidates boot utilities similar to those found in PA RISC based servers such as the Boot Console Handler BCH and platform firmware into a single platform firmware EFI enables the selection of any EFI OS loader from any boot medium that is supported by EFI boot services An EFI O...

Страница 216: ...oot directories and the EFI TOOLS directories of all of the EFI system partitions present in the system for the specified EFI application Add Boot Entry Adds a boot entry to the EFI Boot Manager This works similarly to Boot freom File but adds the file to the boot menu as a new entry instead of just booting the file once You must specify a name for the boot entry to be added and you can add ASCII ...

Страница 217: ...configure processor cpu ON OFF CPUCONFIG cpuconfig Deconfigure or reconfigure I O components or settings IOCONFIG fast_init mps_optimize wol on off IOCONFIG ioconfig Display or set boot tests execution ON OFF or test RUN SKIP FastBoot boottest Read or set the date cn yr mo dy hr mn ss Time date Read or set the real time clock cn yr mo dy hr mn ss Time time INformation Display all server informatio...

Страница 218: ...and name on which to provide verbose information bch Display the list of BCH commands and their corresponding EFI bchmenu BCH menu name taken from the top level of the BCH menu bchcmd BCH command on which to display information Operation If help is initiated with no parameters it displays a list of EFI Shell command categories To list all of the commands within a category enter help category If he...

Страница 219: ...cRool help bch sr SEArch help bch sea SERvice help bch ser BOot help bch bo HElp help bch he RESET help bch reset MAin help bch ma For more help on one of the commands above at the prompt type help bch bchcmd Example C 3 help configuration command Shell help configuration Configuration commands cpuconfig Deconfigure or reconfigure cpus date Display or set date err Display or set error level esipro...

Страница 220: ...s To deconfigure CPU 0 fs0 cpuconfig 0 off Cpu will be deconfigured on the next boot To display configuration status of cpus fs0 cpuconfig PROCESSOR MODULE INFORMATION of L3 L4 Family CPU Logical Cache Cache Model Processor Module CPUs Speed Size Size hex Rev State 0 2 1 1 GHz 4MB 32MB 1F 01 B1 Active 1 2 1 1 GHz 4MB 32MB 1F 01 B1 Active To display cpu thread status fs0 cpuconfig threads cpuconfig...

Страница 221: ... Wake On LAN Disabled To display the current device connection policy setting fs0 ioconfig fast_init Fast initialization Enabled To disable fast initialization fs0 ioconfig fast_init off Fast initialization Disabled To enable the System Wake On LAN setting fs0 ioconfig wol on System Wake On LAN Enabled baud Sets the baud rate and communication settings for a universal asynchronous receiver transmi...

Страница 222: ...test Displays status of specific Speedy Boot bit boottest test on off Sets or clears a specific Speedy Boot bit Parameters test Each test can be set or cleared booting_valid Enable disable system firmware response to BOOTING bit If OS Speedy Boot aware set to on early_cpu Enable disable early CPU selftests late_cpu Enable disable late CPU selftests platform Enable disable system board hardware tes...

Страница 223: ...est late_cpu Run this test platform Run this test chipset Run this test io_hw Run this test mem_init Run this test mem_test Run this test cpuconfig Displays the configured or deconfigured state of processors in the system and enables you to configure or reconfigure processors Syntax cpuconfig cpu on off Parameters cpu specify a processor on off state to set the processor to Operation Issuing cpuco...

Страница 224: ...wol on off Parameters fast_init specify device connection policy setting mps_optimize specify PCIe MPS optimization setting wol specify system wake on lan setting on off specify to configure or deconfigure a feature or component Operation The ioconfig file is used to retain information on the server I O configuration across reboots The ioconfig file is created by insf at install time and is modifi...

Страница 225: ...Fast initialization Enabled MPS optimization Disabled System Wake On LAN Disabled To display the current device connection policy setting fs0 ioconfig fast_init Fast initialization Enabled To disable fast initialization fs0 ioconfig fast_init off Fast initialization Disabled To enable the System Wake On LAN setting fs0 ioconfig wol on System Wake On LAN Enabled conconfig Configures the primary con...

Страница 226: ...Acpi HWP0002 0 Pci 4 0 Example C 12 conconfig 3 off command To disable a console Shell conconfig 3 off CONSOLE CONFIGURATION Index Status Type Device Path 1 NC Serial Acpi PNP0501 0 2 P Serial Acpi HWP0002 0 Pci 1 1 3 NC VGA Acpi HWP0002 0 Pci 4 0 Example C 13 conconfig 3 on command To enable a console Shell conconfig 3 on CONSOLE CONFIGURATION Index Status Type Device Path 1 NC Serial Acpi PNP050...

Страница 227: ...nalyzer log clear erases all of the logs mca cpe cmc init la Operation Enter errdump with no parameters to display usage Otherwise the specified error log displays Add n to the clear parameter to disable the confirmation prompt Access the errdump command from the System Configuration menu info Displays most server information Syntax info b target Parameters target valid targets are all display eve...

Страница 228: ...2 Lun0 HD Part1 Sig4258E658 7952 11DB 8002 D6217B60E588 2 HARDDRIVE Acpi HWP0002 PNP0A03 200 Pci 1 0 Sas Addr500000E0119F9C1 2 Lun0 HD Part3 Sig4258E6B2 7952 11DB 8004 D6217B60E588 Seg Bus Dev Fnc Vendor Device Slot ID ID Path 00 00 01 00 0x103C 0x1303 XX Acpi HWP0002 PNP0A03 0 Pci 1 0 00 00 01 01 0x103C 0x1302 XX Acpi HWP0002 PNP0A03 0 Pci 1 1 00 00 01 02 0x103C 0x1048 XX Acpi HWP0002 PNP0A03 0 P...

Страница 229: ...7 46 EFI Spec 1 10 EFI Intel Drop 14 62 EFI Build 5 56 SAL Spec 3 20 SAL_A 2 00 SAL_B 62 01 POSSE 0 20 ACPI 7 00 SMBIOS 2 3 2a System Firmware B Revision 62 05 4628 BMC Revision 75 07 IPMI 1 00 Management Processor Revision F 01 40 Updatable EFI Drivers Floating Point Software Assistance Handler 00000118 Broadcom Gigabit Ethernet Driver 0007000A SCSI Bus Driver 00000021 SCSI Tape Driver 00000020 U...

Страница 230: ... on Shell info cpu PROCESSOR MODULE INFORMATION of L3 L4 Family CPU Logical Cache Cache Model Processor Module CPUs Speed Size Size hex Rev State 0 4 1 4 GHz 6 MB None 20 00 B0 Active 1 4 1 4 GHz 6 MB None 20 00 B0 Active CPU threads are turned on This example has processor hyperthreading turned off Shell info cpu PROCESSOR MODULE INFORMATION of L3 L4 Family CPU Logical Cache Cache Model Processor...

Страница 231: ...0x1095 0x0649 XX Acpi HWP0002 0 Pci 2 0 00 20 01 00 0x1000 0x0030 XX Acpi HWP0002 100 Pci 1 0 00 20 01 01 0x1000 0x0030 XX Acpi HWP0002 100 Pci 1 1 00 20 02 00 0x8086 0x1079 XX Acpi HWP0002 100 Pci 2 0 00 20 02 01 0x8086 0x1079 XX Acpi HWP0002 100 Pci 2 1 00 40 01 00 0x1000 0x0021 03 Acpi HWP0002 200 Pci 1 0 00 60 01 00 0x1077 0x2312 02 Acpi HWP0002 300 Pci 1 0 00 60 01 01 0x1077 0x2312 02 Acpi HW...

Страница 232: ... mem_init Run this test mem_test Run this test LAN Address Information LAN Address Path Mac 000E7F7E07FA Acpi HWP0002 100 Pci 2 0 Mac 000E7F7E07FA Mac 000E7F7E07FB Acpi HWP0002 100 Pci 2 1 Mac 000E7F7E07FB lanaddress Displays the core I O MAC address Syntax lanaddress Parameters none Example C 19 lanaddress command LAN Address Information LAN Address Path Mac 00306E4C4F1A Acpi HWP0002 0 Pci 3 0 Ma...

Страница 233: ...d Monarch Monarch Possible Warnings 0 0 0 0 To view monarch fs0 monarch Processor current status 0 next boot status 0 To set the monarch processor to 1 fs0 monarch 1 Processor current status 0 next boot status 1 pdt Displays or clears the contents of the Page Deallocation Table PDT Syntax pdt clear Parameters clear clears the pdt Operation With no options specified the command displays the PDT inf...

Страница 234: ...y Shell Shell pdt PDT Information Last Clear time 10 21 01 5 00p Number of total entries in PDT 50 Number of used entries in PDT 0 Number of free entries in PDT 50 Number of single bit entries in PDT 0 Number of multi bit entries in PDT 0 Address of first multi bit error 0x0000000000000000 sysmode Displays or modifies the system mode Syntax sysmode normal admin service Parameters normal sets syste...

Страница 235: ... 1 Power on the server POST runs and any array controllers that are in the server are initialized one at a time During each controller initialization process POST halts for several seconds while an ORCA prompt message appears 2 At the ORCA prompt If you are connected using a headless console press the Esc 8 combination Otherwise press F8 The ORCA Main Menu appears allowing you to create view or de...

Страница 236: ...ed through the program status value that is returned when the program exits Use the cfggen utility to create IM storage configurations on SAS controllers Some cfggen commands work only with SAS adapters in the EFI environment Starting CFGGEN The cfggen utility is located on the HP IPF Offline Diagnostic and Utilities CD To use cfggen follow these steps 1 Insert the CD into the drive 2 Boot the ser...

Страница 237: ...he cfggen utility CREATE Command The CREATE command creates IM volumes on the SAS controller Firmware and hardware limitations for this family of cards limit the number of configurations that are possible Syntax cfggen controller create volume type size qsync noprompt Parameters volume type Volume type for the volume to be created Valid value is IM size Size of the IM volume in megabytes or MAX fo...

Страница 238: ...en controller hotspare delete Encl Bay Parameters controller A SAS controller number between 0 and 255 delete Specifies that the hot spare is to be deleted omit the delete keyword to specify hot spare creation Encl Bay Enclosure number and Bay number that identify the disk drive that becomes the hot spare Operation The number of disks in an IM array plus the hot spare cannot exceed three You can c...

Страница 239: ...certain information For example look at the information for the SCSI interface For each channel of this SCSI interface note the following information Bus Identifies the bus the device is on This is the same for both channels In this example the bus number is 20 Dev The ID the device is assigned on the bus This is the same for both channels In this example the SCSI interface is device 01 Fnc Identi...

Страница 240: ...rl 10 Acpi HWP0002 600 Ctrl 26 Acpi HWP0002 600 Pci 1 0 Ctrl 11 Acpi HWP0002 700 Ctrl 27 Acpi HWP0002 700 Pci 1 0 Ctrl 28 Acpi HWP0002 700 Pci 1 1 Ctrl 43 16550 Serial UART Driver Ctrl 44 VT 100 Serial Console Ctrl 3E Primary Console Input Device Ctrl 3F Primary Console Output Device Ctrl 3D Primary Standard Error Device Ctrl 29 Acpi HWP0002 700 Pci 2 0 Ctrl 40 Acpi PNP0501 0 Ctrl 41 16550 Serial ...

Страница 241: ...dle where drvr_handle The handle of the driver that controls the channel with the SCSI ID you want to display or change cntrl_handle The handle of the controller for the channel with the SCSI ID you want to display or change For channel A of this SCSI interface enter Shell drvcfg s 45 18 The EFI SCSI Setup Utility starts and its main menu appears showing a list of all the EFI capable SCSI interfac...

Страница 242: ...se the arrow keys to navigate to the appropriate SCSI parameter 10 Use the plus and minus keys to scroll through the values until the value you want appears 11 Press Esc to exit the Adapter Properties screen 12 Move the cursor to the action cancel save or discard you want to take and press Enter Select one of the following options Cancel the exit to stay on the Adapter Properties screen for the ch...

Страница 243: ...m after using the arrow keys to highlight the item Save Settings to NVRAM Saves your changes Paths All devices in servers are represented by paths in the EFI Shell To identify the correct slot or disk drive use the following tables NOTE The device path might be different depending on which I O riser is installed in your server Table C 3 PCI Slots and Device Path Device Path Slots Acpi HWP0002 400 ...

Страница 244: ...that are on your system and lets you browse these file systems for applications or drivers that are executable Executable files end with the efiextension You can also select remote boot LAN options that have been configured on your network The option you have selected is added to the EFI boot menu If you add a new drive to your system you must manually add its boot options list if you want to make...

Страница 245: ... that are accessed remotely Change Boot Order Use this option to remove boot options entry The order in which options are listed in the EFI boot menu also reflects the order in which the server attempts to boot If the first boot option fails the server tries booting the second then the third and so forth until a boot option succeeds or until all options have failed For example if you normally boot...

Страница 246: ...oading any boot options automatically If there is no countdown set you must select boot options manually To set the auto boot timeout value in seconds select Set Timeout Value and enter the desired value To disable the timeout function select Delete Disable Timeout NOTE When this option is selected the server does not automatically boot The server stops at the EFI boot menu and waits for user inpu...

Страница 247: ...t emulation type several different terminal emulation protocols are supported Only one terminal emulation type can be selected for each serial console but multiple serial consoles can be selected at a time Select Active Standard Error Devices Use this option to define the devices that display error messages from the system console This menu is identical to the Console Output Devices menu The serve...

Страница 248: ...ttings Integrated Lights Out 2 Management Processor The integrated Lights Out 2 Management Processor iLO MP for entry level Integrity servers is an autonomous management subsystem embedded directly on the server It is the foundation of the server High Availability HA embedded server and fault management It also provides system administrators secure remote management capabilities regardless of serv...

Страница 249: ...video redirection technology This new feature gives you a higher performance graphics console redirection experience than with the previous iLO For information on the iLO 2 MP see the HP Integrity Integrated Lights Out 2 Management Processor Operations Guide Integrated Lights Out 2 Management Processor 249 ...

Страница 250: ...43 command mode see CM commands devtree EFI capable devices and controller handles displaying 240 drvcfg EFI configurable components displaying 240 EFI driver handle determining 241 EFI SCSI setup utility starting 241 info adapter path 239 adapter slot number 239 component classification 142 components cold swappable defined 143 hot pluggable defined 142 configurable components EFI capable display...

Страница 251: ...rface see EFI external health LED 29 external health LED definition 114 location 28 F fan cooling zones 149 150 fan display board functionality 171 removing 172 replacing 173 fans introduction 24 introduction office friendly 25 N 1 defined 24 removing 151 replacing 153 firmware defined 26 introduction 26 operating system requirements 26 front control panel LEDs 28 29 front display panel see System...

Страница 252: ...ystem health 28 System Insight Display 29 UID button 28 load order memory 51 175 processor 53 177 logging in to the iLO 2 MP 74 M management processor see iLO 2 MP see iLO 2 MP mass storage 26 see also SAS introduction 26 mass storage subsystem see mass storage memory installation conventions 51 175 installing 52 175 introduction 23 load order 51 175 removing 174 supported DIMM sizes 51 175 midpla...

Страница 253: ...nsion clearance 143 inserting the server into 144 212 rack mount server accessing 143 rackless see tower mount rear panel functional overview 31 Remove and Replace Hard Drive Hot Plug 45 PCI X PCIe Cards 35 PCI PCI X Cards 58 Power Supply Hot Swap 47 reset button MP 33 S safety information 207 safety information general 42 141 SAL defined 26 SAS features and capabilities 196 technology overview 19...

Страница 254: ...sing 144 troubleshooting console problems occur 86 DVD problems occur 85 hard drive problems occur 86 methodology 83 operating system 85 U UID button function 28 LED 28 Unpacking Inspecting for Damage 44 UUID on fan display board 172 V VGA console session 78 viewing warnings 212 W wake on LAN 35 web interface interacting with 76 weight server 37 254 Index ...

Отзывы:

Нет отзывов

Похожие инструкции для Integrity rx2660

TP-Link TX201 User Manual preview
TX201
Бренд: TP-Link Страницы: 16
LM Technologies LM809-0647 User Manual preview
LM809-0647
Бренд: LM Technologies Страницы: 27
Endura A-CA74E Instruction Manual preview
A-CA74E
Бренд: Endura Страницы: 2
LSI Ultra160 User Manual preview
Ultra160
Бренд: LSI Страницы: 54
BeeWi BWA211 User Manual preview
BWA211
Бренд: BeeWi Страницы: 73
StarTech.com DKT30CHPD User Manual preview
DKT30CHPD
Бренд: StarTech.com Страницы: 10
Jabra Link 950 USB-A Quick Start Manual preview
Link 950 USB-A
Бренд: Jabra Страницы: 2
Dynex DX-CR112 User Manual preview
DX-CR112
Бренд: Dynex Страницы: 11
IBM 10/100/1000 Base-TX Ethernet PCI-X Adapter Installation And Using Manual preview
10/100/1000 Base-TX Ethernet PCI-X Adapter
Бренд: IBM Страницы: 32
Asante FriendlyNET Wireless USB Adapter User Manual preview
FriendlyNET Wireless USB Adapter
Бренд: Asante Страницы: 17
HD Rehab 95836-1 User Manual & Assembly Instructions preview
95836-1
Бренд: HD Rehab Страницы: 2
Innoviti Vaayu User'S Manual And Troubleshooting Manual preview
Vaayu
Бренд: Innoviti Страницы: 6
TRENDnet TU-ET100plus Quick Installation Manual preview
TU-ET100plus
Бренд: TRENDnet Страницы: 20
Neumann PA 100 Specification Sheet preview
PA 100
Бренд: Neumann Страницы: 2
3Com 3C509B coax User Manual preview
3C509B coax
Бренд: 3Com Страницы: 56
3Com III User Manual preview
III
Бренд: 3Com Страницы: 78
Steren USB-PAR User Manual preview
USB-PAR
Бренд: Steren Страницы: 6
Steren USB-110 Instruction Manual preview
USB-110
Бренд: Steren Страницы: 3

Бренды по названию

Популярные бренды

Загрузить еще бренды