IBM p5 550 Technical Overview And Introduction Download Page 1

Page: 1 / 110

ibm.com/redbooks

Red

paper

Front cover

IBM System p5 550 and 550Q

Technical Overview and Introduction

Giuliano Anselmi

Charlie Cler

Carlo Costantini

Bernard Filhol

SahngShin Kim

Gregor Linzmeier

Ondrej Plachy

Finer system granulation using
Micro-Partitioning technology to help lower TCO

Outstanding performance based on
processor technology

From Web servers to
integrated cluster solutions

Summary of Contents for p5 550

Page 1: ...on Giuliano Anselmi Charlie Cler Carlo Costantini Bernard Filhol SahngShin Kim Gregor Linzmeier Ondrej Plachy Finer system granulation using Micro Partitioning technology to help lower TCO Outstanding...

Page 2: ......

Page 3: ...International Technical Support Organization IBM System p5 550 and 550Q Technical Overview and Introduction September 2006...

Page 4: ...on or disclosure restricted by GSA ADP Schedule Contract with IBM Corp Second Edition September 2006 This edition applies to the IBM System p5 550Q and 550 product number 9133 55A Linux and AIX 5L Ver...

Page 5: ...onfigurator starting points for Express Product Offerings 12 1 5 System racks 13 1 5 1 IBM 7014 Model T00 Rack 14 1 5 2 IBM 7014 Model T42 Rack 15 1 5 3 IBM 7014 Model S11 Rack 15 1 5 4 IBM 7014 Model...

Page 6: ...DS4000 series 47 2 9 4 IBM TotalStorage DS6000 and DS8000 series 47 2 10 Logical partitioning 48 2 10 1 Dynamic logical partitioning 48 2 11 Virtualization 48 2 11 1 POWER Hypervisor 49 2 12 Advanced...

Page 7: ...1 7 Resource deallocation 81 3 1 8 Serviceability 82 3 2 Manageability 83 3 2 1 Service processor 83 3 2 2 Partition diagnostics 84 3 2 3 Service Agent 85 3 2 4 IBM System p5 firmware maintenance 87 3...

Page 8: ...vi IBM System p5 550 and 550Q Technical Overview and Introduction...

Page 9: ...aterials for this IBM product and use of those Web sites is at your own risk IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obliga...

Page 10: ...Redbooks Redbooks logo RS 6000 Service Director System p System p5 System Storage TotalStorage Virtualization Engine The following terms are trademarks of other companies Internet Explorer Microsoft...

Page 11: ...as an IBM eServer pSeries Systems Product Engineer supporting Web Server Sales Organization in EMEA IBM Sales IBM Business Partners Technical Support Organizations and IBM Dublin IBM eServer Manufactu...

Page 12: ...he Ing academic degree in Computer Science from Czech Technical University CVUT Prague He has worked at Supercomputing Centre of Czech Technical University for four years and has worked for IBM for se...

Page 13: ...his Redpaper or other Redbooks in one of the following ways Use the online Contact us review redbook form found at ibm com redbooks Send your comments in an e mail to redbook us ibm com Mail your comm...

Page 14: ...xii IBM System p5 550 and 550Q Technical Overview and Introduction...

Page 15: ...8 core p5 550Q In addition the optional Advanced POWER Virtualization APV feature enables the support for up to 40 micro partitions on a 4 core p5 550 and up to 80 micro partitions on an 8 core p5 55...

Page 16: ...used to accommodate additional devices Two media bays only accept slim line media devices such as a DVD ROM or DVD RAM and one half height bay is used for a tape drive The p5 550 or p5 550Q also has I...

Page 17: ...em as a deskside version FC 7191 IBM Deskside Cover Set is required The system is designed to be set up by the client and in most cases does not require the use of any tools The system includes full s...

Page 18: ...ount model IBM System p5 550 or 550Q is available as a 4U rack mount model when ordered with FC 7192 Figure 1 2 on page 5 shows the system and Table 1 3 provides a list of physical attributes Table 1...

Page 19: ...nected to a common maintenance console such as the 7316 TF3 Rack Mounted Flat Panel display NEBS environments The rack mount p5 550 and p5 550Q with ac FC 7889 or 48V dc FC 6289 power supplies are NEB...

Page 20: ...o two power regulators Two hot swap cooling fans The system supports 32 bit and 64 bit applications and requires specific levels of the AIX 5L and Linux operating systems For more information see 2 14...

Page 21: ...feature codes 2 1 GHz DCM processor cards Table 1 7 Processor card and processor activation feature codes 1 5 GHz QCM processor cards Processor card feature code Description 8309 Two processors 1 65 G...

Page 22: ...y configurations of mixed memory sized DIMMs and DIMMs installed in pairs 1 3 4 Disk and media features The minimum p5 550 or p5 550Q configuration includes a 4 pack disk drive enclosure A second 4 pa...

Page 23: ...rom the USB port The drive can be attached to the integrated USB ports or to a USB adapter FC 2738 A maximum of one USB diskette drive is supported per integrated controller adapter The same controlle...

Page 24: ...onfiguration the maximum number of I O drawers supported is different Table 1 11 on page 11 summarizes the maximum number of I O drawers supported and the total number of PCI X slots available Note Th...

Page 25: ...7310 CR3 is a 1U 19 inch rack mountable model that has two native Ethernet ports and can be extended with one additional two port 10 100 1000 Gb adapter In HMC managed installations with very high dem...

Page 26: ...or you can choose to purchase the system with no operating system The lower priced AIX 5L or Linux operating system is processed using a feature number on AIX 5L and either Red Hat or SUSE Linux You...

Page 27: ...ne 7877 x 1 7877 x 1 4 pack disk drive enclosure 6592 x 1 6592 x 1 73 4 GB 10 k disk drives 1968 x 2 1968 x 2 Description 1 65 GHz 1 9 GHz 2 1 GHz Configuration 2 core 4 core 2 core 4 core 2 core 4 co...

Page 28: ...U bays see Figure 1 4 on page 18 Additional PDUs can fit inside the rack see 1 5 6 The ac power distribution unit and rack content on page 17 Weights T00 base empty rack 244 kg 535 lb T00 full rack 81...

Page 29: ...pproximately 50 000 Btus hr of heat removed from air exiting the back of a fully populated rack One year limited warranty Physical specifications Approximate height 1945 5 mm 76 6 in Approximate width...

Page 30: ...racks must be installed horizontally in the rear of the rack Each horizontally mounted PDU occupies 1U of space in the rack and therefore reduces the space available for mounting servers and other com...

Page 31: ...e the publication IBM System p5 IBM eServer p5 and i5 and OpenPower Planning SA38 0508 For an online copy select Map of pSeries books to the information center Planning Printable PDFs Planning at the...

Page 32: ...ach outlet is rated up to 10 amps Each group of two outlets is fed from one 15 amp circuit breaker The Universal PDUs are compatible with previous models Figure 1 4 PDU placement and PDU view 1 5 7 Ra...

Page 33: ...g storage drive features Digital Data Storage DDS Gen 5 DAT72 Tape Drive provides a physical storage capacity of 36 GB 72 GB with 2 1 compression per data cartridge VXA 2 Tape Drive provides a media c...

Page 34: ...and 7315 CR3 HMCs The IBM 7316 TF3 flat panel rack mounted console is now available with two console switch options that lets you inexpensively cable monitor and manage your rack servers the new 1x8...

Page 35: ...When selecting the LCM Switch consider the following information The KVM Conversion Option KCO cable FC 4268 is used with systems with PS 2 style keyboard display and mouse ports The USB cable FC 426...

Page 36: ...mounting holes must be 465 mm 0 8 mm 18 3 in 0 03 in apart on center horizontal width between the vertical columns of holes on the two front mounting flanges and on the two rear mounting flanges See F...

Page 37: ...nit The system rack or cabinet must be compatible with drawer mounting rails including a secure and snug fit of the rail mounting pins and screws into the rack or cabinet rail support hole Note The OE...

Page 38: ...24 IBM System p5 550 and 550Q Technical Overview and Introduction...

Page 39: ...x8 B for write DIMM CX JXX Ax DIMM CX JXX Ax DIMM CX JXX Ax DIMM CX JXX Ax DIMM CX JXX Ax DIMM CX JXX Ax DIMM CX JXX Ax DIMM CX JXX Ax 2x8 B 528 MHz Enhanced I O Controller GX 700 MHz Remote I O card...

Page 40: ...in ERAT and TLB Two new pages sizes 64 KB and 16 GB which were recently added in the PowerPC architecture New segment size in SLB One new segment size 1 TB recently added in PowerPC architecture The...

Page 41: ...ew POWER5 quad core module QCM and the local memory storage subsystem for that QCM Two POWER5 dual core chips and their associated L3 cache chips are packaged in the QCM Figure 2 3 shows a layout view...

Page 42: ...as shown in Figure 2 3 on page 27 In the two processor cards configuration 8 core p5 550Q the QCM to QCM communication is implemented using the Horizontal Fabric Bus Figure 2 4 shows a high level lay...

Page 43: ...e p5 550 and p5 550Q available processor capacities and speeds To determine the processor characteristics use one of the following commands lsattr El procX In this command X is the number of the proce...

Page 44: ...ory is accessed by two Synchronous Memory Interface SMI II chips that are located between memory and processor The SMI II supports multiple data flow modes Figure 2 6 Memory placement for the DCM or Q...

Page 45: ...ervice Information label located on the top cover of the system provides memory DIMMs slot location information To determine how much memory is installed in a system use the following command lsattr E...

Page 46: ...GX buses The QCM or DCM provides a GX bus In the past the 6XX bus was the front end from the processor to memory PCI Host bridge cache and other devices The follow on of the 6XX bus is the GX bus con...

Page 47: ...2 8 8 8 1 9 2 21 1 30 4 5 06 1 9 4 42 2 60 8 10 13 2 1 2 21 1 33 6 5 6 2 1 4 42 2 67 2 11 2 System p5 550Q Express 9133 55A 1 5 4 21 1 48 4 1 5 8 42 2 96 8 GX Bus DCM or QCM Memory Processor Card 2 DC...

Page 48: ...PCI X slots and Remote I O expansion cards combinations are Five hot plug PCI X slots Four hot plug PCI X slots plus one Remote I O expansion card occupying PCI X slot 4 Three hot plug PCI X slots pl...

Page 49: ...osure FC 6592 or FC 6593 cannot be installed which limits the maximum number of internal disks to four FC 4273 also requires one PCI X slot For more information about the internal SCSI system see 2 7...

Page 50: ...mats defined by iSCSI protocol and thus enables the creation of IP SANs iSCSI allows an existing network to transfer SCSI commands and data with full location independence and defines the rules and pr...

Page 51: ...ommands over the IP network The software can also provide configuration support and storage management support The underlying target hardware can be a storage appliance that contains embedded storage...

Page 52: ...Gbps Fibre Channel adapter is also available Table 2 7 provides a summary of the available Fibre Channel adapters All of these adapters have LC connectors If you are attaching a device or switch with...

Page 53: ...4x and 12x IB Cables Topspin Server Switch models 120 and 270 Switches are the fundamental components of an InfiniBand fabric An IBM System p5 server proposal might also include the Topspin Server Sw...

Page 54: ...les The firmware for the FC 4764 is available on a separately ordered distributed CD This firmware is an LPO product 5733 CY1 Cryptographic Device Manager The FC 4764 also requires LPP 5722 AC3 Crypto...

Page 55: ...k drives The disk drive backplane docks directly to the system planar The virtual SCSI Enclosure Services VSES hot plug control functions are provided by the Ultra320 SCSI controllers 2 7 1 Internal m...

Page 56: ...moval of the disk You should ensure that the appropriate planning has been given to any operating system related disk layout such as the AIX 5L Logical Volume Manager when using disk hot swap capabili...

Page 57: ...CI X bridges Each Remote I O card supports up to four external I O drawers Two processor cards must be present to support two Remote I O cards 2 8 2 7311 Model D20 I O drawer The 7311 Model D20 I O dr...

Page 58: ...d is capable of passing data in each direction on each cycle of the port Therefore the maximum data rate is 4 GBps per I O drawer in double barrel mode There can be up to two RIO 2 loops in any p5 550...

Page 59: ...2 m FC 3146 Remote I O cable 1 75 m FC 3156 Remote I O cable 2 5 m FC 3168 Remote I O cable 3 5 m FC 3147 Remote I O cable 10 m FC 3148 I O drawer 1 I O drawer 2 I O drawer 3 I O drawer 4 PCI X slots...

Page 60: ...BM System p5 server the internal disks are usually used for the AIX 5L rootvg volume group and paging space Specific client requirements can be satisfied with the several external disk possibilities t...

Page 61: ...ns for your Storage Area Network The IBM TotalStorage DS4000 Storage server family consists of the following models DS4100 DS4300 DS4500 and DS4800 The Model DS4100 Express Model is the smallest model...

Page 62: ...resources such as processors memory and I O components to be added and deleted from dedicated partitions while they are executing AIX 5L Version 5 2 with all the necessary enhancements to enable dyna...

Page 63: ...cal Ethernet adapters for inter partition communication The POWER Hypervisor is always active when the server is running partitioned or not and also when not connected to the HMC It requires memory to...

Page 64: ...n be up to 65394 65390 if VLAN tagging is used The POWER Hypervisor presents itself to partitions as a virtual 802 1Q compliant switch The maximum number of VLANs is 4096 Virtual Ethernet adapters can...

Page 65: ...ing Integrated Virtualization Manager Virtual I O Server Version 1 2 or later only Partition Load Manager AIX 5L Version 5 3 only Automated CPU and memory reconfiguration Real time partition configura...

Page 66: ...e are two physical processors in a 4 core configuration with a QCM quad core module there are four physical processors In dedicated mode physical processors are assigned as a whole to partitions The s...

Page 67: ...is not enough to satisfy its application processing demand in the given processing entitlement When the partition is uncapped the number of defined virtual processors determines the limitation of the...

Page 68: ...llows client partitions to share access to them thus minimizing the number of physical adapters in the system The Virtual I O Server eliminates the requirement that every partition own a dedicated net...

Page 69: ...l Manager NIM Two major functions are provided with the Virtual I O Server a shared Ethernet adapter and Virtual SCSI Note To increase the performance of I O intensive applications use dedicated physi...

Page 70: ...a Virtual I O server partition is limited only by the resource availability as there are no configuration limits For a more detailed discussion about virtual networking see http www ibm com servers ai...

Page 71: ...mber of retries on failure Error log enhancements Virtual I O Server V1 3 also introduced several enhancements for Virtual Ethernet and shared Ethernet adapter support 2 12 4 Partition Load Manager Pa...

Page 72: ...t Download and install updates to device microcode and to Virtual I O Server software Back up and restore logical partition configuration information View application logs and the device inventory The...

Page 73: ...tion owning all physical server resources and four client partitions IVM communicates to Hypervisor to create manage and provide virtual I O for client partitions The dispatch of partitions on physica...

Page 74: ...to communicate over the network to the HMC You should ensure that sufficient Ethernet adapters are available to enable public and private networks if The HMC 7310 Model C05 is a deskside model with on...

Page 75: ...ering managed systems on and off Acting as a service focal point The HMC provides both graphical and command line interfaces for all management tasks Remote connection to the HMC using Web based Syste...

Page 76: ...dware Management Console HMC The SPT is available to assist the user in system planning design validation and to provide a system validation report that reflects the user s system requirements while n...

Page 77: ...specify You can use the SPT before you order a system to determine what you must order to support your workload You can also use the SPT to determine how you can partition a system that you already h...

Page 78: ...ty from a POWER5 system or PC and a reasonable connection speed for downloading large products such as AIX 5L Registration on the ESD Web site For additional information contact your IBM sales represe...

Page 79: ...V shared memory via a new SHM_PAGESIZE command to the shmctl system call An example of using system variables to start a program with 64 KB page size support is LDR_CNTRL DATAPSIZE 64K TEXTPSIZE 64K S...

Page 80: ...systems linux power 2 15 Service information The p5 550 and p5 550Q are customer setup servers CSU and are shipped with materials to assist in the general installation of the server The server cover...

Page 81: ...t into the service position follow these steps 1 If necessary open the front rack door 2 Remove the two thumbscrews A that secure the system or expansion unit B to the rack as shown in Figure 2 19 Fig...

Page 82: ...anagement arm to route all the cables through the hooks along the cable arm and to secure them with the straps that are provided The cable management arm simplifies the cables management in case of a...

Page 83: ...select Manual mode from Function 02 Support service representative Functions 50 through 99 which are available when you select Manual mode from Function 02 then select and enter the customer service...

Page 84: ...puts AIX 5L The current permanent system firmware image is SF220_005 The current temporary system firmware image is SF220_006 The system is currently booted from the temporary image Linux system SF220...

Page 85: ...hat you order from your service provider or from an FTP server on which you previously placed the fixes Neither the HMC nor your server is connected to the Internet server firmware only You need to do...

Page 86: ...ystem Management Interface ASMI options from a client Web browser using the HTTP server integrated into the service processor internal operating system Both Ethernet ports have a default IP address Se...

Page 87: ...e through at the time of writing Microsoft Internet Explorer 6 0 Netscape 7 1 Mozilla Firefox or Opera 7 23 running on a PC or mobile computer connected to the service processor The Web interface is a...

Page 88: ...ent Local HMC A local HMC is any physical HMC that is connected directly to the server it manages through a private service network An HMC in a private service network can be a DHCP server from which...

Page 89: ...partition has its own instance of Open Firmware and has access to all the devices assigned to that partition However each instance of Open Firmware has no access to devices outside of the partition i...

Page 90: ...76 IBM System p5 550 and 550Q Technical Overview and Introduction...

Page 91: ...p5 design features that help lower the total cost of ownership TCO IBM reliability availability and service RAS technology allows you to improve your TCO architecture by reducing unplanned down time T...

Page 92: ...ng sections describe the concepts that form the basis of leadership RAS features of IBM System p5 systems in more detail 3 1 1 Fault avoidance System p5 servers are built on a quality based design tha...

Page 93: ...tion on page 81 3 1 3 Permanent monitoring The service processor SP included in the p5 550 or p5 550Q provides a way to monitor the system even when the main processor is inoperable Mutual surveillanc...

Page 94: ...Single bit error correction using ECC without reaching error thresholds for main L2 and L3 cache memory L3 cache line deletes extended from 2 to 10 for additional self healing ECC extended to inter ch...

Page 95: ...e Partial L2 cache deallocation PCI X bus and slots For dynamic processor deallocation the service processor performs a predictive failure analysis based on any recoverable processor errors that have...

Page 96: ...f intermittent PCI bus parity errors and graceful transition to the I O device available state in the case of a permanent parity error in the PCI bus EEH enabled adapters respond to a special data pac...

Page 97: ...ce Concurrent Maintenance Concurrent Maintenance provides replacement of the following parts while the system remains running Disk drives Cooling fans Power subsystems PCI X adapter cards Operator Pan...

Page 98: ...AIX 5L Online diagnostics when installed are resident with AIX 5L on the disk or server They can be booted in single user mode service mode run in maintenance mode or run concurrently concurrent mode...

Page 99: ...finable threshold levels for error reporting Automatic problem reporting where service calls are placed to IBM without intervention Automatic client notification In addition Service Agent provides the...

Page 100: ...ervice Agent is an integral part of the HMC and if activated collects hardware related information and error messages about the entire system and partitions If software level information such as perfo...

Page 101: ...crocode can be installed either from the HMC or from a running partition for update details see 2 15 6 System firmware on page 70 If you use an HMC to manage your server you can use the HMC interface...

Page 102: ...ver management Simplified use of IT resources Designed for 24x7 access to data applications Business continuity in the event of disaster The POWER processor based AIX 5L and Linux cluster targets scie...

Page 103: ...lable visit the following links IBM System Cluster 1600 http www ibm com servers eserver clusters hardware 1600 html IBM System Cluster 1350 http www ibm com servers eserver clusters hardware 1350 htm...

Page 104: ...90 IBM System p5 550 and 550Q Technical Overview and Introduction...

Page 105: ...A Practical Guide SG24 7071 IBM System p5 505 Express Technical Overview and Introduction REDP 4079 IBM System p5 510 and 510Q Technical Overview and Introduction REDP 4136 IBM System p5 520 and 520Q...

Page 106: ...tion Online resources These Web sites and URLs are also relevant as further information sources AIX 5L operating system maintenance packages downloads http www ibm com servers eserver support unixserv...

Page 107: ...view or download Redbooks Redpapers Hints and Tips draft publications and Additional materials as well as order hardcopy Redbooks or CD ROMs at this Web site ibm com redbooks Help from IBM IBM Support...

Page 108: ...94 IBM System p5 550 and 550Q Technical Overview and Introduction...

Page 109: ......

Page 110: ...ed cluster solutions This IBM Redpaper is a comprehensive guide that covers the IBM System p5 550 and 550Q UNIX servers It introduces major hardware offerings and discusses their prominent functions P...

Search results

Summary of Contents for p5 550

Reviews:

Related manuals for p5 550

Brands by name

Popular brands

IBM p5 550, Technical Overview And Introduction

Search results

Summary of Contents for p5 550

Reviews:

Related manuals for p5 550

Brands by name

Popular brands