IBM Power 770 Technical Overview And Introduction Download Page 90 | Manualshive

Page: 90 / 220

background image

76

IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction

2.8.10 Fibre Channel over Ethernet (FCoE)

FCoE allows for the convergence of Fibre Channel and Ethernet traffic onto a single
adapter and converged fabric.

Figure 2-18 compares an existing Fibre Channel and network connection, and a
FCoE connection.

Figure 2-18 Comparison between existing Fibre Channel and network connection and FCoE connection

Table 2-18 lists the available Fibre Channel over Ethernet adapter. It is a high-performance
Converged Network Adapters (CNA) using SR optics. Each port can provide network
interface card (NIC) traffic and Fibre Channel functions simultaneously.

Table 2-18 Available FCoE adapter

For more information about FCoE, see An Introduction to Fibre Channel over Ethernet, and
Fibre Channel over Convergence Enhanced Ethernet, REDP-4493.

2.8.11 InfiniBand host channel adapter

The InfiniBand architecture (IBA) is an industry-standard architecture for server I/O and
inter-server communication. It was developed by the InfiniBand Trade Association (IBTA) to
provide the levels of reliability, availability, performance, and scalability necessary for present
and future server systems with levels significantly better than can be achieved by using
bus-oriented I/O structures.

InfiniBand (IB) is an open set of interconnect standards and specifications. The main
IB specification is published by the InfiniBand Trade Association and is available at the
following location:

http://www.infinibandta.org/

Ethernet

and Fibre
Channel

Cables

Ethernet

Cable

Fibre Channel

Cable

FC Switch

Ethernet Switch

CEC or I /O Drawer

Et hernet

CEC or I /O Drawer

FC

Rack

Fibre Channel (FC)

Device or FC Switch

Ethernet

C ables

Ethernet

Cable

Fibre Channel

Cable

FCoE Switch

CEC or I/O Drawer

Rack

Fibre Channel (FC)

Device or FC Switch

FCoE

Ethernet Device/

Sw itch

Ethernet Device/

Switch or FCoE

Device/Switch

Feature
code

CCIN

Adapter description

Slot

Size

OS
support

5708

2B3B

10 Gb FCoE PCIe Dual Port adapter

PCIe

Full height
Short

AIX,
Linux

«
...
88
89
90
91
92
...
»

Summary of Contents for Power 770

Page 1: ...0 Technical Overview and Introduction An Ding Chen Dave Freeman Breno Henrique Leitão Features the 9117 MMD and 9179 MHD based on the latest POWER7 processor technology Describes support of up to 20 LPARS per processor core Discusses new I O cards and drawers ...

Page 2: ......

Page 3: ...International Technical Support Organization IBM Power 770 and 780 9117 MMD 9179 MHD Technical Overview and Introduction February 2013 REDP 4924 00 ...

Page 4: ...Rights Use duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp First Edition February 2013 This edition applies to the IBM Power 770 9117 MMD and Power 780 9179 MHD Power Systems servers Note Before using this information and the product it supports read the information in Notices on page vii ...

Page 5: ...ry features 18 1 5 Disk and media features 20 1 6 I O drawers 23 1 6 1 PCI DDR 12X Expansion Drawers FC 5796 23 1 6 2 12X I O Drawer PCIe FC 5802 and FC 5877 23 1 6 3 EXP12S SAS Drawer 24 1 6 4 EXP 24S SFF Gen2 bay Drawer 24 1 6 5 EXP30 Ultra SSD I O Drawer 24 1 6 6 I O drawers and usable PCI slot 24 1 7 Comparison between models 25 1 8 Build to order 26 1 9 IBM editions 26 1 10 Model upgrades 26 ...

Page 6: ...city on Demand 58 2 4 1 Capacity Upgrade on Demand CUoD 58 2 4 2 On Off Capacity on Demand On Off CoD 58 2 4 3 Utility Capacity on Demand Utility CoD 59 2 4 4 Trial Capacity on Demand Trial CoD 60 2 4 5 Software licensing and CoD 60 2 5 CEC drawer interconnection cables 60 2 6 System bus 65 2 6 1 I O buses and GX card 65 2 6 2 Service processor bus 65 2 7 Internal I O subsystem 66 2 7 1 Blind swap...

Page 7: ...9 2 13 Operating system support 109 2 13 1 Virtual I O Server 110 2 13 2 IBM AIX operating system 110 2 13 3 IBM i operating system 111 2 13 4 Linux operating system 111 2 13 5 Java versions that are supported 112 2 13 6 Boosting performance and productivity with IBM compilers 112 2 14 Energy management 113 2 14 1 IBM EnergyScale technology 113 2 14 2 Thermal power management device TPMD card 117 ...

Page 8: ...9 4 2 7 PCI enhanced error handling 169 4 2 8 POWER7 I O chip freeze behavior 171 4 3 Serviceability 171 4 3 1 Detecting 171 4 3 2 Diagnosing 176 4 3 3 Reporting 177 4 3 4 Notifying 179 4 3 5 Locating and servicing 180 4 4 Manageability 184 4 4 1 Service user interfaces 184 4 4 2 IBM Power Systems firmware maintenance 189 4 4 3 Electronic Services and Electronic Service Agent 192 4 5 POWER7 RAS fe...

Page 9: ...do not in any manner serve as an endorsement of those websites The materials at those websites are not part of the materials for this IBM product and use of those websites is at your own risk IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you Any performance data contained herein was determined in a controlled envi...

Page 10: ...tioning POWER Hypervisor Power Systems Power Systems Software POWER6 POWER6 POWER7 POWER7 PowerHA PowerPC PowerVM POWER pSeries PureFlex Rational Team Concert Rational Real time Compression Redbooks Redpaper Redbooks logo RS 6000 Storwize System Storage System x System z Tivoli Workload Partitions Manager XIV The following terms are trademarks of other companies Intel Xeon Intel Intel logo Intel I...

Page 11: ...werVM Live Partition Mobility and PowerVM Active Memory Sharing Active Memory Expansion that provides more usable memory than what is physically installed on the system IBM EnergyScale technology that provides features such as power trending power saving capping of power and thermal measurement Enterprise ready reliability serviceability and availability Dynamic Platform Optimizer High performance...

Page 12: ...Brazil He has 14 years of experience with Linux Breno is also a Master Inventor in Brazil and holds a degree in Computer Science from Universidade de Sao Paulo His areas of expertise include operating systems performance virtualization and networking He has written extensively about Linux mainly about networking and debugging The project that produced this publication was managed by Scott Vetter E...

Page 13: ...on International Technical Support Organization Dept HYTD Mail Station P099 2455 South Road Poughkeepsie NY 12601 5400 Stay connected to IBM Redbooks Find us on Facebook http www facebook com IBMRedbooks Follow us on Twitter http twitter com ibmredbooks Look for us on LinkedIn http www linkedin com groups home gid 2130806 Explore new Redbooks publications residencies and workshops with the IBM Red...

Page 14: ...xii IBM Power 770 and 780 9117 MMD 9179 MHD Technical Overview and Introduction ...

Page 15: ...ability for demanding commercial workloads The innovative IBM Power 770 and Power 780 servers with POWER7 processors are symmetric multiprocessing SMP rack mounted servers These modular built systems use one to four enclosures Each enclosure is four EIA units 4U tall and is housed in a 19 inch rack The 9117 MMD and 9179 MHD servers introduce a processor card that houses four P7 processors The P7 t...

Page 16: ...four CEC enclosures running at frequencies of 3 8 GHz The server can be specified starting with only four active cores and incrementing one core at a time through built in CoD functions to a maximum of 64 active cores A single Power 770 CEC enclosure is equipped with 16 DIMM slots running at 1066 MHz A system configured with four drawers and 64 GB DDR3 DIMMs supports up to a maximum of 4 0 TB of D...

Page 17: ...ne core at a time up to a maximum of 64 or 128 active cores A single Power 780 CEC enclosure is equipped with 16 DIMM slots running at 1066 MHz A system configured with four drawers and 64 GB DDR3 DIMMs supports up to a maximum of 4 0 TB of DDR3 memory All POWER7 DDR3 memory uses memory architecture that provides increased bandwidth and capacity This increase enables operating at a higher data rat...

Page 18: ...er source loading Power 770 1 649 kVA maximum per enclosure with 16 cores active Power 780 1 959 kVA maximum per enclosure with 24 cores active Not applicable Thermal output Power 770 5 461 Btu hr maximum per enclosure with 16 cores active Power 780 6 485 Btu hr maximum per enclosure with 24 cores active Not applicable Maximum altitude 3048 m 10 000 ft Not applicable Noise level for one enclosure ...

Page 19: ...osures can take 4U EIA units of rack space Thus a two enclosure system requires 8U three enclosures require 12U and four enclosures require 16U Table 1 2 Physical dimensions of a Power 770 and Power 780 enclosure Figure 1 2 shows the rear view of the Power 770 and Power 780 Figure 1 2 Rear view of the Power 770 and Power 780 Dimension Power 770 Model 9117 MMD single enclosure Power 780 Model 9179 ...

Page 20: ... FC 1768 Dual 10 Gb Optical and Dual 1 Gb Ethernet FC 1769 One serial port included on each Integrated Multifunction Card Two USB ports included on each Integrated Multifunction Card plus another USB port on each enclosure maximum nine usable per system Two HMC ports per enclosure maximum four per system Additional considerations The Ethernet port of the Integrated Multifunction Card cannot be use...

Page 21: ...awer holding up to 30 SSDs FC EDR1 The EXP30 Ultra SSD I O Drawer is attached directly to the Power 770 9117 MMD and Power 780 9179 MHD GX slot for higher bandwidth IBM Systems Director Active Energy Manager The Power 770 operator interface controls located on the front panel of the primary I O drawer consist of a power ON OFF button with an IBM POWER indicator an LCD display for diagnostic feedba...

Page 22: ...feature FC 5796 Disk only I O drawers Up to 56 EXP24S SFF SAS I O drawers on external SAS controller FC 5887 Up to 110 EXP12S SAS DASD SSD I O drawers on SAS PCI controllers FC 5886 Up to 60 EXP24 SCSI DASD Expansion drawers on SCSI PCI controllers 7031 D24 IBM Systems Director Active Energy Manager Additional considerations The Ethernet ports of the Integrated Multifunction Card cannot be used fo...

Page 23: ...e Dual 10 Gb Copper and Dual 1 Gb Ethernet FC 1768 Dual 10 Gb Optical and Dual 1 Gb Ethernet FC 1769 1x primary operating system one of these AIX FC 2146 Linux FC 2147 IBM i FC 2145 1x Processor Card 0 to 12 core 4 42 GHz processor card FC EPM0 0 to 16 core 3 72 GHz processor card FC EPM2 4x Processor Activations quantity of four for one of these One Processor Activation for processor feature FC E...

Page 24: ... EB96 1x Service Processor FC EU09 1x DASD Backplane FC 5652 2x Power Cords two selected by customer 2x A C Power Supply FC 5532 1x Operator Panel FC EC53 1x Integrated Multifunction Card options one of these Dual 10 Gb Copper and Dual 1 Gb Ethernet FC 1768 Dual 10 Gb Optical and Dual 1 Gb Ethernet FC 1769 1x primary operating system one of these AIX FC 2146 Linux FC 2147 IBM i FC 2145 1x Processo...

Page 25: ...CMs with 120 MB of L3 cache 12 cores per processor card each core with 10 MB of L3 cache at 4 22 GHz FC EPM0 Four 4 core POWER7 SCMs with 160 MB of L3 cache 16 cores per processor card each core with 10 MB of L3 cache at 3 72 GHz FC EPM1 The Power 780 has two types of processor cards note that the TurboCore feature is no longer offered on 780 Four 4 core POWER7 SCMs with 160 MB of L3 cache 16 core...

Page 26: ...mation about CoD is in 2 4 Capacity on Demand on page 58 1 4 6 Summary of processor features Table 1 5 summarizes the processor feature codes for the Power 770 Table 1 5 Summary of processor features for the Power 770 POWER7 POWER7 POWER7 POWER7 Memory Memory Memory TPMD PCIe Slot 1 PCIe Slot 2 PCIe Slot 3 PCIe Slot 4 PCIe Slot 5 PCIe Slot 6 Fans TurboCore TurboCore mode is no longer supported on ...

Page 27: ... then provided to your sales channel The sales channel will place an order for a quantity of On Off Processor Core Day Billing features and bill you One FC EPME must be ordered for each billable processor core day of feature FC EPM0 used by a supported AIX or Linux operating system AIX Linux EPMF One processor day on off billing for FC EPM0 After an On Off Processor Enablement feature is ordered a...

Page 28: ...mpute your billing data is then provided to your sales channel The sales channel will place an order for a quantity of On Off Processor Core Day Billing features and the client will be charged One FC EPMG must be ordered for each billable processor core day of feature FC EPM1 used by a supported AIX or Linux operating system AIX Linux EPMH One processor day on off billing for FC EPM1 After an On O...

Page 29: ... on off usage to IBM at least monthly This information used to compute your billing data is provided to your sales channel The sales channel will place an order on your behalf for the quantity of this feature that matches your reported use One FC EP2M provides 100 days of on off processor billing for POWER7 CoD Processor Book FC EPH0 for IBM i IBM i EPHE One processor day on off billing for FC EPH...

Page 30: ...mation used to compute your billing data is provided to your sales channel The sales channel will place an order on your behalf for the quantity of this feature that matches your reported use One FC EP2P provides 100 days of on off processor billing for POWER7 CoD Processor Book FC EPH2 for IBM i IBM i EPHJ One processor day on off billing for FC EPH2 After an On Off Processor Enablement feature i...

Page 31: ...led you can request processors on a temporary basis You must sign an On Off Capacity on Demand contract before you order this feature Note To renew this feature after the allowed 360 processor days have been used this feature must be removed from the system configuration file and reordered by placing an MES order AIX Linux IBM i Feature code Description OS support ...

Page 32: ...ted to the POWER7 processor memory controller through an advanced memory buffer ASIC For each DIMM there is a corresponding memory buffer Each memory channel into the POWER7 memory controllers is driven at 6 4 GHz Each DIMM except the 64 GB DIMM contains DDR3 x8 DRAMs in a configuration with 10 DRAMs per rank and plugs into a 276 pin DIMM slot connector The 64 GB DIMM is an 8 rank DIMM using x4 pa...

Page 33: ...GB of DDR3 POWER7 memory AIX IBM i Linux FC EMA3 100 GB Activation of 100 GB of DDR3 POWER7 memory Each occurrence of this feature permanently activate 100 GB of DDR3 POWER7 memory AIX IBM i Linux FC 7954 N A On Off Memory Enablement This feature can be ordered to enable your server for On Off Capacity on Demand After it is enabled you can request memory on a temporary basis You must sign an On Of...

Page 34: ...must be purchased with sufficient permanent memory activation features so that the system memory is at least 50 active The minimum activations ordered with MES orders of memory features EM40 EM41 EM42 and EM44 depend on the total installed capacity of features EM40 EM41 EM42 and EM44 This allows newly ordered mem ory to be purchased with less than 50 activations when the currently installed capaci...

Page 35: ...RPM SAS SFF 2 Disk Drive IBM i 1888 139 GB 15 K RPM SFF SAS Disk Drive IBM i 1787 177 GB SFF 1 SSD with eMLC IBM i 1794 177 GB SFF 2 SSD with eMLC IBM i 1996 177 GB SSD Module with eMLC IBM i 1956 283 GB 10 K RPM SAS SFF 2 Disk Drive IBM i 1911 283 GB 10 K RPM SFF SAS Disk Drive IBM i 1879 283 GB 15 K RPM SAS SFF Disk Drive IBM i 1948 283 GB 15 K RPM SAS SFF 2 Disk Drive IBM i ES0B 387 GB SFF 1 SS...

Page 36: ...6 GB 15 K RPM SAS SFF 2 Disk Drive AIX Linux 1869 Quantity 150 of FC 1925 300 GB 10 K RPM SAS SFF 2 Disk Drive AIX Linux 1929 Quantity 150 of FC 1953 300 GB 15 K RPM SAS SFF 2 Disk Drive AIX Linux 1818 Quantity 150 of FC 1964 600 GB 10 K RPM SAS SFF 2 Disk Drive AIX Linux 7578 Quantity 150 of FC 1775 177 GB SAS SFF SSD AIX Linux EQ37 Quantity 150 of 1737 856 GB SFF 2 disk IBM i EQ38 Quantity 150 o...

Page 37: ...le Disk only I O drawers are also supported providing large storage capacity and multiple partition support Feature FC 5886 EXP12S holds a 3 5 inch SAS disk or SSD Feature FC 5887 EXP 24S SFF Gen2 bay Drawer for high density storage holds SAS Hard Disk drives The 7031 D24 holds a 3 5 inch SCSI disk supported but no longer orderable The 7031 T24 holds a 3 5 inch SCSI disk supported but no longer or...

Page 38: ...dapters controllers attached to the I O drawer by SAS X or Y cables The SFF bays of the EXP24S are different from the SFF bays of the POWER7 system units or 12X PCIe I O drawers FC 5802 and FC 5803 The EXP24S uses Gen2 or SFF 2 SAS drives that physically do not fit in the Gen1 or SFF 1 bays of the POWER7 system unit or 12X PCIe I O Drawers or vice versa 1 6 5 EXP30 Ultra SSD I O Drawer The enhance...

Page 39: ...ng as low as four active cores and incrementing one core at a time through built in CoD functions to a maximum of 48 active cores with the 4 22 GHz processor or 64 active cores with the 3 8 GHz processor The Power 780 also offers a four socket POWER7 processor card with one of two processor configurations installed These processor cards have the following specifications Four 4 core SCMs running at...

Page 40: ...o replace your current CEC enclosure The current CEC enclosures are returned to IBM in exchange for the financial consideration identified under the applicable feature conversions for each upgrade Clients taking advantage of the model upgrade offer from a 9117 MMA or 9117 MMB MMC system are required to return all components of the serialized MT model that were not ordered through feature codes Any...

Page 41: ...DIMMS to DDR3 memory DIMMS New trim kits upgrading from 9117 MMA 9117 MMB or 9179 MHB to 9179 MHD existing trim kits are only functional for one drawer configurations or for racks holding only I O and no Power 770 or 780 processor enclosures PowerVM Standard to Enterprise Drawer Bezel PCIe Crypto Gen3 PCIx 1 5 GB RAID The following features that are present on the current system can be moved to th...

Page 42: ...exceed the quantity of feature FC 7942 obtained for the system being upgraded Feature FC 7942 must be migrated to the new configuration report in a quantity that equals feature FC 8018 Additional FC 7942 features can be ordered during the upgrade Features 8527 and 8528 are available to support migration of DDR3 memory activations 1812 or 1813 during the initial order and build of the MHD upgrade M...

Page 43: ...o support more than 254 partitions in total the HMC might require a memory upgrade to 4 GB 1 11 2 IBM SDMC IBM withdrew the SDMC product Customers should migrate to the HMC platform by upgrading their 7042_CR6 server to the latest HMC code See IBM Power Systems SDMC to HMC Migration Guide RAID1 REDP 4872 Type model Availability Description 7310 C05 Withdrawn IBM 7310 Model C05 Desktop Hardware Man...

Page 44: ...t IBM Power systems The features of the T00 rack are as follows It has 36U EIA units of usable space It has optional removable side panels It has an optional highly perforated front door It has optional side to side mounting hardware for joining multiple racks It has standard business black or optional white color in OEM format It has increased power distribution and weight capacity It supports bo...

Page 45: ...nting space that accommodate FC 7188 PDUs All PDUs required for application in these racks must be installed horizontally in the rear of the rack Each horizontally mounted PDU occupies 1U of space in the rack and therefore reduces the space available for mounting servers and other components 1 12 4 IBM 7953 model 94Y rack The 2 0 meter 79 3 inch model 94Y rack has the following features 42U EIA un...

Page 46: ...e included features might differ The FC 0555 is supported but it is no longer orderable 1 12 6 Feature code 0551 rack The 1 8 meter rack FC 0551 is a 36U EIA units rack The rack that is delivered as FC 0551 is the same rack delivered when you order the 7014 T00 rack The included features might differ Several features that are delivered as part of the 7014 T00 must be ordered separately with the FC...

Page 47: ...publib boulder ibm com infocenter systems scope hw index jsp The Base Side Mount Universal PDU FC 9188 feature the optional and additional Universal PDU FC 7188 feature and the Intelligent PDU options FC 7109 support a wide range of country requirements and electrical power specifications The PDU receives power through a UTG0247 power line connector Each PDU requires one PDU to wall power cord Var...

Page 48: ...on 29 A three drawer system cannot be installed above position 25 A four drawer system cannot be installed above position 21 The position number refers to the bottom of the lowest drawer When a system is installed in a model 7014 T00 7014 T42 7014 B42 FC 0551 or FC 0553 rack that has no front door a Thin Profile Front Trim Kit must be ordered for the rack The required trim kit for the 7014 T00 or ...

Page 49: ... two Slim DVD RAM or DVD ROM drives in the right side bay The two bays of the IBM System Storage 7214 Tape and DVD Enclosure can accommodate the following tape or DVD drives for IBM Power servers DAT72 36 GB Tape Drive Up to two drives DAT72 36 GB Tape Drive Up to two drives DAT160 80 GB Tape Drive Up to two drives LTO Ultrium 4 Half High 800 GB Tape Drive Up to two drives DVD RAM Optical Drive Up...

Page 50: ... only support the USB cable that is provided as part of the feature code Additional USB hubs add on USB cables or USB cable extenders are not supported For each RDX Docking Station feature installed in the 7216 the appropriate external USB cable will be included The 7216 RDX Docking Station feature can be connected to the external integrated USB ports on the Power 770 and Power 780 or to the USB p...

Page 51: ...ptions that allow data transfer within similar system archival storage and retrieval technologies installed in existing IT facilities The 7226 offers an expansive list of drive feature options IBM 7226 Multi Media Enclosure options are as follows DAT160 80 GB Tape Drives With SAS or USB interface options and a data transfer rate of up to 24 MBps the DAT160 drive is read write compatible with DAT16...

Page 52: ...ER6 and POWER7 systems and also IBM BladeCenter models PS700 PS701 PS702 PS703 and PS704 that offer current level AIX IBM i and LINUX operating systems The IBM i operating system does not support 7226 USB devices For a complete list of host software versions and release levels that support the 7226 see the following System Storage Interoperation Center SSIC website http www ibm com systems support...

Page 53: ...s This architecture offers a maximum system configuration of 64 or 128 cores depending on the processor option chosen This chapter provides an overview of the system architecture and its major components The bandwidths that are provided are theoretical maximums used for reference The speeds shown are at an individual component level Multiple components and application implementation are key to ach...

Page 54: ...CI e Slot PCI e Slot PCI e Slot PCI e Slot Passthru Card Drawers 3 4 Passthru A Conn I O Backplane GX Buses 4 socket CPU Card Mid Plane PSI 8 SN DIMMs WXZ Buses P7IOC A GX Slot 2 HMC 2 SPCN D2D Conns FSP1 Card Drawers 1 2 TPMD DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN B Buses P7 P7 B Buses 8 SN DIMMs DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM...

Page 55: ...ed systems is one of system wide balance in which the POWER7 processor plays an important role In many cases IBM is innovative to achieve required levels of throughput and bandwidth Areas of innovation for the POWER7 processor and POWER7 processor based systems include but are not limited to the following items On chip L3 cache implemented in embedded dynamic random access memory eDRAM Cache hiera...

Page 56: ...ogy using copper interconnect and implements an on chip L3 cache using eDRAM The POWER7 processor chip is 567 mm2 and is built by using 2 1 billion components transistors Up to eight processor cores are on the chip each with 12 execution units 256 KB of L2 cache per core and access to up to 80 MB of shared on chip L3 cache per SCM For memory access the POWER7 processor includes one double data rat...

Page 57: ...ocessor has a set of 12 execution units Two fixed point units Two load store units Four double precision floating point units One vector unit One branch unit One condition register unit One decimal floating point unit The following caches are tightly coupled to each POWER7 processor core Instruction cache 32 KB Data cache 32 KB L2 cache 256 KB implemented in fast SRAM Technology POWER7 processor D...

Page 58: ... users to select the threading technology that meets an aggregation of objectives such as performance throughput energy use and workload enablement Intelligent Threads The POWER7 processor features Intelligent Threads that can vary based on the workload demand The system either automatically selects or the system administrator can manually select whether a workload benefits from dedicating as much...

Page 59: ...3 cache is critical to a balanced design as is the ability to provide good signaling between the L3 cache and other elements of the hierarchy such as the L2 cache or SMP interconnect The on chip L3 cache is organized into separate areas with differing latency characteristics Each processor core is associated with a Fast Local Region of L3 cache FLR L3 but also has access to other L3 cache regions ...

Page 60: ...ace requirements conserves energy and lowers latency Small physical footprint The performance of eDRAM when implemented on chip is similar to conventional SRAM but requires far less physical space IBM on chip eDRAM uses only a third of the components used in conventional SRAM which has a minimum of six transistors to implement a 1 bit memory cell Low energy consumption The on chip eDRAM uses only ...

Page 61: ... 2 Comparison of technology for the POWER7 processor and the prior generation POWER7 POWER7 POWER6 Technology 32 nm 45 nm 65 nm Die size 567 mm2 567 mm2 341 mm2 Maximum cores 8 8 2 Maximum SMT threads per core 4 threads 4 threads 2 threads Maximum frequency 4 4 GHz 4 25 GHz 5 0 GHz L2 Cache 256 KB per core 256 KB per core 4 MB per core L3 Cache 10 MB of FLR L3 cache per core with each core having ...

Page 62: ...ors This way enables a maximum system configuration of 64 cores built from four CEC enclosures The IBM Power 780 shares the same 4 socket processor card The 780 processor cards are populated with 4 core or 8 core POWER7 processors enabling a maximum system configuration of 128 cores Figure 2 6 illustrates the major components of the 4 socket processor card Figure 2 6 IBM Power 770 or 780 4 socket ...

Page 63: ...ted to the data lines in every DRAM module This effect traditionally degrades either the memory access times or memory density Fully buffered DIMMs overcome this effect by implementing an advanced buffer between the memory controllers and the DRAMs with two independent signaling interfaces This technique decouples the DRAMs from the bus and memory controller interfaces allowing efficient signaling...

Page 64: ...27 P3 C26 P3 C25 P3 C24 P3 C23 P3 C22 A B B B M0 D SN DDR3 DIMM 16 M0 C SN DDR3 DIMM 15 M0 B SN DDR3 DIMM 14 M0 A SN DDR3 DIMM 13 Regulator 8 TPMD Card Regulator 7 Regulator 6 Regulator 5 M0 D SN DDR3 DIMM 8 M0 C SN DDR3 DIMM 7 M0 B SN DDR3 DIMM 6 M0 A SN DDR3 DIMM 5 M0 D SN DDR3 DIMM 12 M0 C SN DDR3 DIMM 11 M0 B SN DDR3 DIMM 10 M0 A SN DDR3 DIMM 9 M0 D SN DDR3 DIMM 4 M0 C SN DDR3 DIMM 3 M0 B SN D...

Page 65: ... follows Quad 1 J1A J2A J5A J6A mandatory minimum for each enclosure Quad 2 J3A J4A J7A J8A mandatory minimum for each enclosure Quad 3 J1B J2B J5B J6B Quad 4 J3B J4B J7B J8B Table 2 3 shows the optimal placement of each DIMM quad within a single enclosure system The enclosure must have at least two DIMM quads installed in slots J1A J2A J5A J6A and J5A J6A J7A and J8A as shown with the highlighted...

Page 66: ...ory controller Memory controller J1A J2A J3A J4A J5A J6A J7A J8A J1B J2B J3B J4B J5B J6B J7B J8B Q1 Q1 Q2 Q2 Q1 Q1 Q2 Q2 Q5 Q5 Q8 Q8 Q5 Q5 Q8 Q8 Enclosure 2 CPU 1 CPU 3 CPU 4 CPU 2 Memory controller Memory controller Memory controller Memory controller J1A J2A J3A J4A J5A J6A J7A J8A J1B J2B J3B J4B J5B J6B J7B J8B Q3 Q3 Q4 Q4 Q3 Q3 Q4 Q4 Q6 Q6 Q7 Q7 Q6 Q6 Q7 Q7 Quads Q1 and Q2 must be identical t...

Page 67: ...sure 2 CPU 1 CPU 3 CPU 4 CPU 2 Memory controller Memory controller Memory controller Memory controller J1A J2A J3A J4A J5A J6A J7A J8A J1B J2B J3B J4B J5B J6B J7B J8B Q3 Q3 Q4 Q4 Q3 Q3 Q4 Q4 Q8 Q8 Q11 Q11 Q8 Q8 Q11 Q11 Enclosure 3 CPU 1 CPU 3 CPU 4 CPU 2 Memory controller Memory controller Memory controller Memory controller J1A J2A J3A J4A J5A J6A J7A J8A J1B J2B J3B J4B J5B J6B J7B J8B Q5 Q5 Q6 ...

Page 68: ...B Q1 Q1 Q2 Q2 Q1 Q1 Q2 Q2 Q9 Q9 Q16 Q16 Q9 Q9 Q16 Q16 Enclosure 2 CPU 1 CPU 3 CPU 4 CPU 2 Memory controller Memory controller Memory controller Memory controller J1A J2A J3A J4A J5A J6A J7A J8A J1B J2B J3B J4B J5B J6B J7B J8B Q3 Q3 Q4 Q4 Q3 Q3 Q4 Q4 Q10 Q10 Q15 Q15 Q10 Q10 Q15 Q15 Enclosure 3 CPU 1 CPU 3 CPU 4 CPU 2 Memory controller 1 Memory controller 0 Memory controller 1 Memory controller 0 J1...

Page 69: ...emory Mirroring AMM is included with all Power 780 systems at no additional charge It can be enabled disabled or re enabled depending on the user s requirements On the Power 770 AMM is optional and must be ordered using feature code 4797 It can be enabled disabled or re enabled depending on the user s requirements The hypervisor code which resides on the initial DIMMs J1A to J8A will be mirrored o...

Page 70: ...tition configuration I O states virtual I O information and partition state P3 C28 P3 C29 P3 C27 P3 C26 P3 C25 P3 C24 P3 C23 P3 C22 A B B B M0 D SN DDR3 DIMM 16 M0 C SN DDR3 DIMM 15 M0 B SN DDR3 DIMM 14 M0 A SN DDR3 DIMM 13 Regulator 8 TPMD Card Regulator 7 Regulator 6 Regulator 5 DIMM Quad 2 DIMM Quad 2 Mirrored Hypervisor code Mirrored Hypervisor code M0 D SN DDR3 DIMM 12 M0 C SN DDR3 DIMM 11 M0...

Page 71: ...modate its data Advanced Memory Sharing Pool Memory used to hold the contents of platform dumps With AMM uncorrectable errors in data that are owned by a partition or application are handled by the existing Special Uncorrectable Error handling methods in the hardware firmware and operating system 2 3 6 Special Uncorrectable Error handling Special Uncorrectable Error SUE handling prevents an uncorr...

Page 72: ...vides a system administrator an interface at the HMC to manage the activation and deactivation of resources A monitor that resides on the server records the usage activity This usage data must be sent to IBM on a monthly basis A bill is then generated based on the total amount of processor and memory resources utilized in increments of Processor and Memory 1 GB Days New to both Power 770 model MMD...

Page 73: ...ssigned to partitions or you are billed for any unreturned processor days Billing The contract signed by the client before receiving the enablement code requires the On Off CoD user to report billing data at least once a month whether or not activity occurs This data is used to determine the proper amount to bill at the end of each billing period calendar quarter Failure to report billing data for...

Page 74: ...or Trial CoD requires you to complete a form including contact information and VPD from your Power 770 or Power 780 system with inactive CoD resources An exception request will activate all inactive processors or all inactive memory or all inactive processor and memory for 30 days An exception request can be made only one time over the life of the machine An HMC is required to manage Trial CoD act...

Page 75: ...es The cables are designed to support hot addition of system enclosure up to the maximum scalability When adding a new drawer existing cables remain in place and new cables are added The only exception is for cable 3711 or 3715 which is replaced when growing from a two drawer to three drawer configuration The cables are also designed to allow the concurrent maintenance of the Power 770 or Power 78...

Page 76: ...in the order of their numbering is extremely important Each cable is numbered as shown in Figure 2 11 Note that the 2 and 3 Drawer cabling has changed in this model Figure 2 11 SMP cables installation Figure 2 12 and Figure 2 13 shows the changed SMP cabling for 2 and 3 drawer configurations There is some overlap of the cables so some are hidden from view ...

Page 77: ...Chapter 2 Architecture and technical overview 63 Figure 2 12 Three link 2 Drawer SMP cabling Figure 2 13 Two link 3 Drawer SMP cabling ...

Page 78: ... 1 and node 2 to node 4 Figure 2 14 FSP flex cables The design of the Power 770 and Power 780 is optimized for use in an IBM 7014 T00 or 7014 T42 rack Both the front cover and the external processor fabric cables occupy space on the front left and right sides of an IBM 7014 rack racks that are not from IBM might not offer the same room When a Power 770 or Power 780 is configured with two or more s...

Page 79: ...igure 2 15 Front view of the rack with SMP cables overlapping the rack rails SMP Cable Drawer 1 BLeft to Drawer 3 ALeft SMP Cable Drawer 2 BLeft to Drawer 3 BLeft SMP Cable Drawer 1 ALeft to Drawer 4 ALeft SMP Cable Drawer 3 ARight to Drawer 4 ARight SMP Cable Drawer 2 ARight to Drawer 4 BRight SMP Cable Drawer 1 BRight to Drawer 2 BRight ...

Page 80: ... Overview and Introduction In the rear of the rack the FSP cables require only some room in the left side of the racks as Figure 2 16 shows Figure 2 16 Rear view of rack with detail of FSP flex cables Four Drawer Cable Three Drawer Cable Two Drawer Cable ...

Page 81: ...ice processor SP communication between the system drawers A SP card FC EU09 is installed in system drawer 1 and system drawer 2 The FSP Clock Pass Through card FC 5665 CCIN 2BBC is installed in system drawers 3 and 4 These cards connect to drawers 1 and 2 through the FSP flex cable The FSP cable was changed to point to point cabling similar to the processor drawer interconnect cable When a system ...

Page 82: ...heat sink height Cassettes can be installed and removed without removing the CEC enclosure from the rack 2 7 2 System ports Each CEC enclosure is equipped with an integrated multifunction card This integrated card provides two USB ports one serial port and four Ethernet connectors for a processor enclosure and does not require a PCIe slot When ordering a Power 770 or Power 780 you may select the f...

Page 83: ...airs of wires are called a lane A PCIe link can consist of multiple lanes In such configurations the connection is labelled as x1 x2 x8 x12 x16 or x32 where the number is effectively the number of lanes Two generations of PCIe interface are supported in Power 770 and Power 780 models Gen1 Capable of transmitting at the extremely high speed of 2 5 Gbps which gives a capacity of a peak bandwidth of ...

Page 84: ...d determine whether there are any existing PTF prerequisites to install See the IBM Prerequisite website for information https www 912 ibm com e_dir eServerPreReq nsf 2 8 4 PCIe adapter form factors IBM POWER7 and POWER7 processor based servers are able to support two form factors of PCIe adapters PCIe low profile LP cards which are used on the Power 710 and Power 730 PCIe slots Low profile adapte...

Page 85: ...5271 5271 4 Port 10 100 1000 Base TX PCI Express adapter 5717 5271 5272 5272 10 Gigabit Ethernet CX4 PCI Express adapter 5732 5732 5273 577D 8 Gigabit PCI Express Dual Port Fibre Channel adapter 5735 577D 5274 5768 2 Port Gigabit Ethernet SX PCI Express adapter 5768 5768 5275 5275 10 Gb ENet Fibre RNIC PCIe 8x adapter 5769 5275 5276 5774 4 Gigabit PCI Express Dual Port Fibre Channel adapter 5774 5...

Page 86: ...ther LAN adapters are supported in the CEC enclosure PCIe slots or in I O enclosures that are attached to the system by using a PCI X or PCIe slot Table 2 13 lists the additional LAN adapters that are available Table 2 13 Available LAN adapters LPARs The integrated multifunction card can be shared by LPARS that use VIOS so each LPAR is able to access it without a dedicated network card Feature cod...

Page 87: ...Short AIX IBM i Linux 5769 5769 10 Gigabit Ethernet SR PCI Express adapter PCIe Full height Short AIX Linux 5772 576E 10 Gigabit Ethernet LR PCI Express adapter PCIe Full height Short AIX IBM i Linux 5899 576F 4 Port 1Gb Ethernet Adapter PCIe Full height AIX IBM i Linux EC28 EC27 2 Port 10Gb Ethernet FCoE SFP Adapter with Optics PCIe Low profile AIX Linux EC30 EC29 2 Port 10Gb Ethernet FCoE SFP Ad...

Page 88: ... 2 16 Available iSCSI adapters Feature code CCIN Adapter description Slot Size OS support 2055 57CD PCIe RAID and SSD SAS Adapter 3 Gb with Blind Swap Cassette PCIe Short AIX IBM i Linux 5805 574E PCIe 380MB Cache Dual x4 3 Gb SAS RAID Adapter PCIe Full height AIX IBM i Linux 5901 57B3 PCIe Dual x4 SAS adapter PCIe Short AIX IBM i Linux 5903a 574E PCIe 380MB Cache Dual x4 3 Gb SAS RAID adapter PCI...

Page 89: ...de CCIN Adapter description Slot Size OS support 5729 a b a A Gen2 PCIe slot is required to provide the bandwidth for all four ports to operate at full speed PCIe2 8 Gb 4 port Fibre Channel Adapter PCIe AIX Linux 5735b b N_Port ID Virtualization NPIV capability is supported through VIOS 577D 8 Gigabit PCI Express Dual Port Fibre Channel Adapter PCIe Short AIX IBM i Linux 5749 576B 4 Gbps Fibre Cha...

Page 90: ...cture IBA is an industry standard architecture for server I O and inter server communication It was developed by the InfiniBand Trade Association IBTA to provide the levels of reliability availability performance and scalability necessary for present and future server systems with levels significantly better than can be achieved by using bus oriented I O structures InfiniBand IB is an open set of ...

Page 91: ... Power Systems Servers SG24 7767 IBM offers the GX 12X DDR Adapter that plugs into the system backplane GX slot There are two GX slots in each CEC enclosure By attaching a 12X to 4X converter cable FC 1828 an IB switch can be attached Table 2 19 lists the available InfiniBand adapters Table 2 19 Available InfiniBand adapters 2 8 12 Asynchronous and USB adapters Asynchronous PCI adapters provide co...

Page 92: ...SI with its point to point high frequency connections SAS physical links are a set of four wires used as two differential signal pairs One differential signal transmits in one direction The other differential signal transmits in the opposite direction Data can be transmitted in both directions simultaneously The Power 770 and Power 780 CEC enclosures have an extremely flexible and powerful backpla...

Page 93: ...oth see all six drives The dual split 3 3 and triple split 2 2 2 configurations are not used with the paired controllers RAID 0 and RAID 10 are supported and you can also mirror two sets of controller drives using the operating system Power 770 and Power 780 with more than one CEC enclosure support enclosures with different internal storage configurations Adding the optional 175 MB Cache RAID Dual...

Page 94: ...must be HDDs IBM i supports configurations that use one set of six bays but does not support logically splitting the backplane into split dual or triple Thus the Dual IOA Enablement card FC 5662 is required if IBM i is to access any of the SAS bays in that CEC enclosure AIX and Linux support configurations using two sets of three bays 3 3 or three sets of two bays 2 2 2 without the dual IOA enable...

Page 95: ...4 SAS adapter FC 5901 CCIN 57B3 Internal SAS port FC 1815 SAS cable for three way split backplane AI cable FC 3679 Adapter to internal drive 1 meter IBM i does not support this combination An I O adapter can be located in another enclosure of the system Dual storage IOA with internal disk Yes None None N A Internal SAS port cable FC 1815 cannot be used with this or high availability RAID configura...

Page 96: ... drives SSDs are supported with a dual split backplane configuration mixing SSDs and hard disk drives HDDs in the same split domain is not supported Also mirroring SSDs with HDDs is not possible or vice versa Figure 2 20 Dual split backplane overview D1 D2 D3 D4 D5 D6 Front view 0 1 0 1 0 1 0 1 0 1 D2 D3 D4 D5 D6 3 way split backplane pin 1 drven 0 Morris and Williams Assembly D1 0 1 Battery card ...

Page 97: ...ng SSDs with HDDs is not possible 2 9 3 Dual storage I O Adapter IOA configurations The dual storage IOA FC 1819 configurations are available with either internal or external disk drives from another I O drawer SSDs are not supported with this mode If this IOA is selected for an enclosure selecting SAS cable FC 3686 or FC 3687 to support RAID internal and external drives is necessary Figure 2 22 o...

Page 98: ...ined within the backplane RAID 0 10 5 and 6 support up to six drives SSDs and HDDs can be used but can never be mixed in the same disk enclosure To connect to the external storage you need to connect to the FC 5886 disk drive enclosure Figure 2 22 shows the topology of the RAID mode Figure 2 22 RAID mode external disk drives option 2 9 4 DVD The DVD media bay is directly connected to the integrate...

Page 99: ... in wide and takes up half the width of the 4U EIA units rack space The 4U enclosure can hold up to two PCI DDR 12X Expansion Drawer drawers mounted side by side in the enclosure The drawer is 800 mm 31 5 in deep and can weigh up to 20 kg 44 lb The PCI DDR 12X Expansion Drawer has six 64 bit 3 3 V PCI X DDR slots running at 266 MHz that use blind swap cassettes and support hot plugging of adapter ...

Page 100: ... on the same 12X loop The 12X I O drawer FC 5877 is the same as this drawer FC 5802 except that it does not support any disk bays Drawer FC 5877 can be on the same loop as drawer FC 5802 Drawer FC 5877 cannot be upgraded to a drawer that contains the disks also that is drawer FC 5802 The physical dimensions of the drawer are 444 5 mm 17 5 in wide by 177 8 mm 7 0 in high by 711 2 mm 28 0 in deep fo...

Page 101: ...Dividing SFF drive bays in 12X I O drawer PCIe Disk drive bays in the 12X I O drawer PCIe can be configured as one two or four sets This way allows for partitioning of disk bays Disk bay partitioning configuration can be done with the physical mode switch on the I O drawer Power cables Disk drives Port cards Service card 10 PCIe cards X2 SAS connectors SPCN Connectors 12X Connectors Mode Switch Mo...

Page 102: ...re code for mode switch setting The SAS ports as associated with the mode selector switch map to the disk bays have the mappings shown in Table 2 24 Table 2 24 SAS connection mappings Tools and CSP The IBM System Planning Tool supports disk bay partitioning Also the IBM configuration tool accepts this configuration from IBM System Planning Tool and passes it through IBM manufacturing using the Cus...

Page 103: ...em The drawer SAS disk drive enclosure can hold up 18 disk drives The disks in this enclosure can be organized in several configurations depending on the operating system used the type of SAS adapter card and the position of the mode switch P3 D1 P3 D2 P3 D3 P3 D4 P3 D5 P3 D6 P3 D7 P3 C1 P3 C2 P3 D8 P3 D9 P3 D10 P3 D11 P3 C3 P3 C4 P3 D12 P3 D13 P3 D14 P3 D15 P3 D16 P3 D17 P3 D18 E1 E2 ARECW500 0 P...

Page 104: ...first 12X I O drawer that is attached in any I O drawer loop requires two data transfer cables Each additional drawer up to the maximum allowed in the loop requires one additional data transfer cable Note the following information A 12X I O loop starts at a CEC bus adapter port 0 and attaches to port 0 of an I O drawer The I O drawer attaches from port 1 of the current unit to port 0 of the next I...

Page 105: ... that contains the short range adapter can be mixed in a single loop with I O drawers that contain the long range adapter In Table 2 26 a value of Yes indicates that the 12X cable identified in that column can be used to connect the drawer configuration identified to the left A value of No means that it cannot be used Table 2 26 Supported 12X cable lengths Connection type 12X cable options 0 6 m 1...

Page 106: ...ling loop connect SPCN 1 T2 of the topmost first CEC enclosure to the SPCN 0 T1 of the next second CEC 5 Ensure that a complete loop exists from the topmost CEC enclosure through all attached expansions and back to the next lower second CEC enclosure Figure 2 31 SPCN cabling examples Enclosures Only the first two CEC enclosures of a multi CEC system are included in SPCN cabling with I O expansion ...

Page 107: ...ach physically provide 3 1 GB write cache Working as a pair they provide mirrored write cache data and controller redundancy The cache contents are designed to be protected by built in flash memory in case of power failure If the pairing is broken write cache is not used after existing cache content is written out to the drive and performance will probably be slowed until the controller pairing is...

Page 108: ... sets With proper software if one of the controller fails the other controller can run both sets of bays GX 2 port PCIe2 X8 Adapter The GX 2 Port PCIe Adapter FC 1914 enables the attachment of the EXP30 Ultra SSD I O Drawer The adapter is plugged into a GX slot of the 4U Power 770 or 780 9117 MMD or 9179 MHD Up to two PCIe cables connect the drawer to the GX 2 port adapter The following cable size...

Page 109: ...X cable PCIe Gen2 8X cable FC EDR1 FC 1914 T2 8X 8X T3 PSU P1 T2 T1 T2 ERM C1 T1 ERM C2 PSU P2 FC EDR1 PSU P1 T2 T1 T2 T3 T3 FC 1914 T2 8X 8X T1 FC 1914 T2 8X 8X T1 PCIe Gen2 8X cable Power 770 or Power 780 PCIe Gen2 8X cable T1 Power 770 or Power 780 ERM C1 T 1 ERM C2 PSU P2 FC EDR1 PSU P1 T2 T1 T 2 ERM C1 T1 T3 ERM C2 PSU P2 PCIe Gen2 8X cables PCIe Gen2 8X cables FC EDR1 FC 1914 T2 T1 FC 1914 T...

Page 110: ...X or PCIe adapter or pair of adapters The drawer can either be attached using the backplane providing an external SAS port or using one of the following adapters PCIe 380 MB Cache Dual x4 3 Gb SAS RAID adapter FC 5805 CCIN 574E PCIe Dual x4 SAS adapter FC 5901 CCIN 57B3 PCI X DDR 1 5 GB Cache SAS RAID adapter FC 5904 PCI X DDR Dual x4 SAS adapter FC 5912 CCIN 572A PCIe2 1 8 GB Cache RAID SAS Adapt...

Page 111: ...controller or a single pair of controllers There is a maximum of up to 110 EXP12S Expansion Drawer on SAS PCI controllers The FC 5886 drawer can be directly attached to the SAS port on the rear of the Power 770 and 780 providing a low cost disk storage solution Adding the optional 175 MB Cache RAID Dual IOA Enablement Card FC 5662 to the Power 770 and Power 780 causes the pair of embedded controll...

Page 112: ... 2 Carrier for IBM i FC 1738 An expansion option is available that uses the paired embedded controller configuration with the 175 MB Cache RAID Dual IOA Enablement Card FC 5662 CCIN 2B2 and the SAS expansion port The SAS expansion port can add more SAS bays to the six bays in the system unit A EXP24S disk drawer in mode 1 can be attached by using a SAS port on the rear of the processor drawer and ...

Page 113: ...two or four SAS controllers and provide much configuration flexibility An EXP24S in mode 2 has similar flexibility Up to 24 HDDs can be supported with any of the supported SAS adapters or controllers Include the EXP24S drawer no charge specify codes with any EXP24S orders to indicate to IBM manufacturing the mode to which to set the drawer The drawer will be delivered with this configuration For d...

Page 114: ...TotalStorage EXP24 disk towers FC 5787 2 11 5 IBM TotalStorage EXP24 The IBM 7031 TotalStorage EXP24 Ultra320 SCSI Expandable Storage Disk Enclosure supports up to 24 Ultra320 SCSI Disk Drives arranged in four independent SCSI groups of up to six drives or in two groups of up to 12 drives Each SCSI drive group can be connected by either a Single Bus Ultra320 SCSI Repeater Card or a Dual Bus Ultra3...

Page 115: ...index html IBM Storwize V7000 and Storwize V7000 Unified Disk Systems IBM Storwize V7000 and Storwize V7000 Unified are virtualized storage systems that consolidate workloads into a single storage system for simplicity of management reduced cost highly scalable capacity performance and high availability They offer improved efficiency and flexibility through built in solid state drive SSD optimizat...

Page 116: ...lowing website http www ibm com systems storage disk ds8000 index html 2 12 Hardware Management Console HMC The HMC is a dedicated workstation that provides a graphical user interface GUI for configuring operating and doing basic system tasks for the POWER7 and POWER7 processor based systems and the POWER5 POWER5 POWER6 and POWER6 processor based systems that function in either non partitioned or ...

Page 117: ...ws The HMC user interface also provides powerful table functionality with filtering sorting and customization of views on a per user basis Most HMC management features are also accessible from the IBM Systems Director software IBM Systems Director provides end to end management support for all HMC managed servers and also servers that are not attached to HMCs Customers should upgrade the support l...

Page 118: ...he management of the physical servers under the control of the HMC System password Status bar Power on off Capacity on demand Error management System indicators Error and event collection reporting Dump collection reporting Call Home Customer notification Hardware replacement guided repair SNMP events Concurrent add repair upgrade Redundant service processor Firmware updates Virtualization managem...

Page 119: ...ystem or a partition to remotely perform many HMC operations 2 12 3 HMC code If attaching an HMC to a new server or adding function to an existing server that requires a firmware update the HMC machine code might need to be updated To determine the HMC machine code level that is required for the firmware level on any server go to the following website to access Fix Central and the Fix Level Recomm...

Page 120: ...ovide such connectivity The rack mounted 7042 CR5 HMC default configuration provides four Ethernet ports The deskside 7042 C07 HMC standard configuration offers only one Ethernet port Be sure to order an optional PCIe adapter to provide additional Ethernet ports For any logical partition in a server it is possible to use a Shared Ethernet Adapter that is configured through a Virtual I O Server The...

Page 121: ...ched to two independent HMCs to address availability requirements Both HMCs must have the same level of Hardware Management Console Licensed Machine Code Version 7 and installed fixes to manage POWER7 processor based servers or an environment with a mixture of POWER5 POWER5 POWER6 POWER6 POWER7 and POWER7 processor based servers The HMCs provide a locking mechanism so that only one HMC at a time h...

Page 122: ...ust be on a separate virtual local area network VLAN to protect from any network contention Each HMC can be a DHCP server for its VLAN Redundant service processor connectivity For the Power 770 and Power 780 with two or more CECs two redundant service processors are installed in CEC enclosures 1 and 2 Redundant service processor function requires that each HMC must be attached to one Ethernet port...

Page 123: ...ystem One HMC should connect to the port labeled HMC Port 1 on the first two CEC drawers of each system A second HMC must be attached to HMC Port 2 on the first two CEC drawers of each system This solution provides redundancy for both the HMC and the service processors HMC1 HMC2 CEC 1 CEC 2 1 2 FSP 1 2 FSP LAN 1 LAN 2 LPAR 1 LPAR 2 LPAR 3 eth0 eth1 eth0 eth1 LAN1 Hardware management network for fi...

Page 124: ...e t 2 HUB 0 Configuration 1 Single drawer and one HMC No te HUB is o ptio na l Cu sto me r can h ave a dir ec t co nn ec tion t o th e FSP ca rd HMC 1 Ene t Drawer 1 FSP Card Ene t 1 Ene t 2 HUB 0 Configuration 2 Single drawer and two HMCs No te HUB is o ptio na l HMC 1 Ene t HUB 1 HMC 2 Ene t Drawer 1 FSP Card Ene t 1 Ene t 2 Configuration 3 Multi drawer with one HMC HUB 0 HMC 1 Ene t Drawer 2 FS...

Page 125: ...h as virtualized I O devices PowerVM Live Partition Mobility or PowerVM Active Memory Sharing For details about the software available on IBM Power Systems visit the IBM Power Systems Software website http www ibm com systems power software index html Tips When upgrading the code of a dual HMC configuration a good practice is to disconnect one HMC to avoid having both HMCs connected to the same se...

Page 126: ...ftware ibm com webapp set2 sas f genunix suma html IBM AIX Version 5 3 The following minimum level of AIX Version 5 3 supports the Power 770 and Power 780 AIX Version 5 3 with the 5300 12 Technology Level and Service Pack 7 or later AIX 5 3 is no longer generally available but IBM intends to provide to those clients with AIX 5 3 Technology Level 12 and the associated service extension offering the...

Page 127: ...isit the IBM Prerequisite website for compatibility information for hardware features and the corresponding AIX and IBM i Technology Levels http www 912 ibm com e_dir eserverprereq nsf 2 13 4 Linux operating system Linux is an open source operating system that runs on numerous platforms from embedded systems to mainframe computers It provides an implementation like UNIX across many computer archit...

Page 128: ... compiler optimization experience is seen in the continuous release to release compiler improvements that support the POWER4 processors through to POWER4 POWER5 POWER5 POWER6 and POWER7 processors and now including the POWER7 processors With the support of the latest POWER7 processor chip IBM advances a more than a 20 year investment in the XL compilers for POWER series and IBM PowerPC series arch...

Page 129: ...evelopment tools The IBM Rational Power Appliance solution provides a workload optimized system and integrated development environment for AIX development on IBM Power Systems IBM Rational Power Appliance includes a Power Express server preinstalled with a comprehensive set of Rational development software along with the AIX operating system The Rational development software includes support for C...

Page 130: ...ting instructions Dynamic power saver mode Dynamic power saver mode varies processor frequency and voltage based on the utilization of the POWER7 or POWER7 processors Processor frequency and utilization are inversely proportional for most workloads implying that as the frequency of a processor increases its utilization decreases given a constant workload Dynamic power saver mode takes advantage of...

Page 131: ... flushed transition lookaside buffers TLB are invalidated and the hardware clock is turned off in the core and in the caches Voltage is reduced to minimize leakage current Processor cores inactive in the system such as CoD processor cores are kept in sleep mode Sleep mode saves about 35 power consumption in the processor core and associated L2 and L3 caches Fan control and altitude input System fi...

Page 132: ...un in shared processing mode have a common power savings setting which is that of the system processor pool The reason is because processing unit fractions cannot be power managed As in the case of system level power savings two Dynamic Power Saver options are offered Favor partition performance Favor partition power savings The user must configure this setting from Active Energy Manager When dyna...

Page 133: ... purpose is to manage system energy The TPMD card monitors the processor modules memory environmental temperature and fan speed Based on this information it can act upon the system to maintain optimal power and energy conditions for example increase the fan speed to react to a temperature change It also interacts with the IBM Systems Director Active Energy Manager to report power and thermal infor...

Page 134: ...120 IBM Power 770 and 780 9117 MMD 9179 MHD Technical Overview and Introduction ...

Page 135: ...make better use of IT assets Improve business responsiveness and operational speed by dynamically re allocating resources to applications as needed to better match changing business needs or handle unexpected changes in demand Simplify IT infrastructure management by making workloads independent of hardware resources so you can make business driven policies to deliver resources based on time cost ...

Page 136: ...erforms a reset or reload if it detects the loss of the Service Processor notifying the operating system if the problem is not corrected The POWER Hypervisor is always active regardless of the system configuration and also when not connected to the managed console It requires memory to support the resource assignment to the logical partitions on the server The amount of memory that is required by ...

Page 137: ...t for PowerVM on page 153 The virtual Ethernet is part of the base system configuration Virtual Ethernet has the following major features The virtual Ethernet adapters can be used for both IPv4 and IPv6 communication and can transmit packets with a size up to 65 408 bytes Therefore the maximum MTU for the corresponding interface can be up to 65 394 or 65 390 if VLAN tagging is used The POWER Hyper...

Page 138: ...ystem console Tasks such as operating system installation network setup and various problem analysis activities require a dedicated system console The POWER Hypervisor provides the virtual console by using a virtual TTY or serial adapter and a set of Hypervisor calls to operate on them Virtual TTY does not require the purchase of any additional features or software such as the PowerVM Edition feat...

Page 139: ...ode is compatible with Version 2 05 of the Power Instruction Set Architecture ISA For more information visit the following address http power org wp content uploads 2012 07 PowerISA_V2 05 pdf POWER6 compatibility mode This mode is similar to POWER6 with eight additional Storage Protection Keys POWER7 mode This is the native mode for POWER7 and POWER7 processors implementing the v2 06 of the Power ...

Page 140: ...echnical Overview and Introduction The selection of the mode is made on a per partition basis from the managed console by editing the partition profile Figure 3 2 Figure 3 2 Configuring partition profile compatibility mode from the managed console ...

Page 141: ...echnology Level 4 with SP2 or later Linux will support Active Memory Expansion on the next major versions Active Memory Expansion uses CPU resource of a partition to compress decompress the memory contents of this same partition The trade off of memory capacity for processor cycles can be an excellent choice but the degree of expansion varies based on how compressible POWER6 and POWER6 mode POWER7...

Page 142: ...ial program load IPL is required for the specific partition that is turning memory expansion on or off After turned on monitoring capabilities are available in standard AIX performance tools such as lparstat vmstat topas and svmon For specific POWER7 hardware compression the tool amepat is used to configure the offload details Figure 3 3 represents the percentage of CPU that is used to compress me...

Page 143: ...e 3 4 Output from Active Memory Expansion planning tool Active Memory Expansion Modeled Statistics Modeled Expanded Memory Size 52 00 GB Achievable Compression ratio 4 51 Expansion Modeled True Modeled CPU Usage Factor Memory Size Memory Gain Estimate 1 40 37 25 GB 14 75 GB 40 0 00 0 1 80 29 00 GB 23 00 GB 79 0 87 5 2 19 23 75 GB 28 25 GB 119 2 13 13 2 57 20 25 GB 31 75 GB 157 2 96 18 2 98 17 50 G...

Page 144: ...tware key is provided when the enablement feature is ordered that is applied to the server Rebooting is not required to enable the physical server The key is specific to an individual server and is permanent It cannot be moved to a separate server This feature is ordered per server independent of the number of partitions using memory expansion Active Memory Expansion Modeled Statistics Modeled Exp...

Page 145: ...ER Hypervisor Virtual I O Server Live Partition Mobility Workload Partitions and more As with Advanced Power Virtualization in the past PowerVM is a combination of hardware enablement and value added software The licensed features of each of the three separate editions of PowerVM are described in 3 4 1 PowerVM editions on page 132 Note If you want to move an LPAR that uses Active Memory Expansion ...

Page 146: ...dd a new level of configuration possibilities This section provides details and configuration specifications about this topic Logical partitioning Logical partitioning was introduced with the POWER4 processor based product line and the AIX Version 5 1 Red Hat Enterprise Linux 3 0 and SUSE Linux Enterprise Server 9 0 operating systems This technology offered the capability to divide a pSeries syste...

Page 147: ...indow Shared processor partitions use the default shared processor pool called DefaultPool by default See 3 4 3 Multiple shared processor pools on page 135 for details about multiple shared processor pools Whether the partition will be able to access extra processing power to fill up its virtual processors above its capacity entitlement selecting either to cap or uncap your partition If spare proc...

Page 148: ...s CPU entitlement that determines how much processing power any given partition should receive The total sum of CPU entitlement of all partitions cannot exceed the number of available physical processors in a shared processor pool The number of virtual processors can be changed dynamically through a dynamic LPAR operation Processing mode When you create a logical partition you can assign entire pr...

Page 149: ...lization without compromising the computing power for critical workloads in a dedicated processor Shared mode In shared mode logical partitions use virtual processors to access fractions of physical processors Shared partitions can define any number of virtual processors the maximum number is 10 times the number of processing units that are assigned to the partition From the POWER Hypervisor persp...

Page 150: ...ocessor pool do not use their capacity entitlement the unused capacity is ceded and other uncapped micropartitions within the same shared processor pool are allocated the additional capacity according to their uncapped weighting In this way the entitled pool capacity of a shared processor pool is distributed to the set of micropartitions within that shared processor pool All Power Systems servers ...

Page 151: ...ve and can accept micropartitions either transferred from SPP0 or newly created Levels of processor capacity resolution The following two levels of processor capacity resolution are implemented by the POWER Hypervisor and Multiple shared processor pools Level0 The first level Level0 is the resolution of capacity within the same shared processor pool Unused processor cycles from within a shared pro...

Page 152: ... it require additional processor capacity above the entitled pool capacity then the POWER Hypervisor redistributes some of the extra capacity to the uncapped micropartitions This level of processor capacity management is sometimes referred to as Level1 capacity resolution To redistribute unused processor capacity to uncapped micropartitions in multiple shared processor pools above the entitled poo...

Page 153: ...graphical interface or the command line interface CLI Dynamic adjustment of reserved pool capacity The reserved pool capacity of a shared processor pool other than the default shared processor pool0 can be adjusted dynamically from the managed console by using either the graphical interface or the CLI Dynamic movement between shared processor pools A micropartition can be moved dynamically from on...

Page 154: ...O Server eliminates the requirement that every partition owns a dedicated network adapter disk adapter and disk drive The Virtual I O Server supports OpenSSH for secure remote logins It also provides a firewall for limiting access by ports network services and IP addresses Figure 3 10 shows an overview of a Virtual I O Server configuration Figure 3 10 Architectural view of the Virtual I O Server B...

Page 155: ...stems on the physical network IEEE 802 1 VLAN tagging is supported The Shared Ethernet Adapter also provides the ability for several client partitions to share one physical adapter With an SEA you can connect internal and external VLANs using a physical adapter The Shared Ethernet Adapter service can only be hosted in the Virtual I O Server not in a general purpose AIX or Linux partition and acts ...

Page 156: ...on broadcast or multicast such as Address Resolution Protocol ARP Dynamic Host Configuration Protocol DHCP Boot Protocol BOOTP and Neighbor Discovery Protocol NDP can work on an SEA IP address A Shared Ethernet Adapter does not need to have an IP address configured to be able to perform the Ethernet bridging functionality Configuring IP on the Virtual I O Server is convenient because the Virtual I...

Page 157: ...rces is provided by the Virtual I O Server Physical disks presented to the Virtual O Server can be exported and assigned to a client partition in a number of ways The entire disk is presented to the client partition The disk is divided into several logical volumes which can be presented to a single client or multiple clients As of Virtual I O Server 1 5 files can be created on these disks and file...

Page 158: ...l SPT and Workload Estimator which are designed to ease the deployment of a virtualized infrastructure For more information about the System Planning Tool see 3 5 System Planning Tool on page 156 IBM Systems Director agent and a number of preinstalled IBM Tivoli agents such as the following examples Tivoli Identity Manager to allow easy integration into an existing Tivoli Systems Management infras...

Page 159: ...ation system requirements The source partition must be one that has only virtual devices If there are any physical devices in its allocation they must be removed before the validation or migration is initiated An N_Port ID Virtualization NPIV device is considered virtual and is compatible with partition migration The hypervisor must support the Partition Mobility functionality also called migratio...

Page 160: ... reserve_policy no_reserve In addition all logical partitions must be on the same open network with RMC established to the managed console The managed console is used to configure validate and orchestrate You use the managed console to configure the Virtual I O Server as an MSP and to configure the VASI device An managed console wizard validates your configuration and identifies issues that can ca...

Page 161: ...es physical memory for the shared memory pool assigns partitions to the pool and provides access limits to the pool Active Memory Sharing can be used to increase memory utilization on the system either by decreasing the global memory requirement or by allowing the creation of additional partitions on an existing system Active Memory Sharing can be used in parallel with Active Memory Expansion on a...

Page 162: ...l partition memory pages to a single physical memory page within a shared memory pool This way enables a better utilization of the Active Memory Sharing shared memory pool increasing the system s overall performance by avoiding paging Deduplication can cause the hardware to incur fewer cache misses which also leads to improved performance D U D D D U U U U U U U U U U U U U U U U U U U U D U U U U...

Page 163: ...h as frequently referenced read only code pages are particularly good for deduplication To perform deduplication the hypervisor cannot compare every memory page in the Active Memory Sharing pool with every other page Instead it computes a small signature for each page that it visits and stores the signatures in an internal table Each time that a page is inspected a look up of its signature is done...

Page 164: ...dynamically configure the size of the deduplication table ranging from 1 8192 to 1 256 of the configured maximum Active Memory Sharing memory pool size Having this table be too small might lead to missed deduplication opportunities Conversely having a table that is too large might waste a small amount of overhead space The management of the Active Memory Deduplication feature is done through a man...

Page 165: ...EB33 is an IBM PowerVM feature that helps the user to configure the logical partition memory and CPU affinity on the POWER7 processor based servers thus improve performance under some workload scenarios On a nonuniform memory access NUMA context the main goal of the DPO is to assign a local memory to the CPUs thus reducing the memory access time because a local memory access is much faster than a ...

Page 166: ...so interacts with POWER7 Performance Monitoring Unit PMU to discover the best affinity and page size for the machine workload N_Port ID Virtualization NPIV NPIV is a technology that allows multiple logical partitions to access independent physical storage through the same physical Fibre Channel adapter This adapter is attached to a Virtual I O Server partition that acts only as a pass through mana...

Page 167: ...s Yes DLPAR I O adapter add remove Yes Yes Yes Yes Yes Yes Yes Yes Yes DLPAR processor add remove Yes Yes Yes Yes Yes Yes Yes Yes Yes DLPAR memory add Yes Yes Yes Yes Yes Yes Yes Yes Yes DLPAR memory remove Yes Yes Yes Yes Yes No Yes No Yes Micropartitioning Yes Yes Yes Yes Yes Yesa Yesb Yesa Yes Shared dedicated capacity Yes Yes Yes Yes Yes Yes Yes Yes Yes Multiple Shared Processor Pools Yes Yes ...

Page 168: ...R2 with PTF SI39077 or later d Requires IBM i 7 1 TR1 e Will become fully provisioned device when used by IBM i f Requires AIX 6 1 TL7 or later g Requires AIX 7 1 TL1 or later h Requires IBM i 7 1 4 or later i Requires IBM i 7 1 TR4 PTF group or later You can access this link for more details http www 912 ibm com s_dir SLKBase nsf 1ac66549a21402188625680b0002037e e1877ed7f3b0cfa8862579ec 0048e067 ...

Page 169: ...t RHEL5 release_notes at 05 2 1 0 html VSX support No Yes No Yes Full exploitation requires Advance Toolchain Distro toolchain mcpu mtune p7 No Yes No Yes SLES11 GA toolchain has minimal P7 enablement necessary to support kernel build Advance Toolchain support Yes execution restricted to Power6 instructions Yes Yes execution restricted to Power6 instructions Yes Alternative GNU Toolchain that expl...

Page 170: ...stem Planning Tool and both the Workload Estimator WLE and IBM Performance Management PM allows you to create a system that is based on performance and capacity data from an existing system or that is based on new workloads that you specify You can use the SPT before you order a system to determine what you must order to support your workload You can also use the SPT to determine how you can parti...

Page 171: ... not support mapping these as virtual optical devices to clients However you can import the disk in to the virtual optical media library and map the created file to the client as a virtual DVD drive The IBM PowerVM IBM Workload Partitions Manager for AIX Version 2 2 has the following enhancements When used with AIX 6 1 Technology Level 6 the following support applies Support for exporting VIOS SCS...

Page 172: ...158 IBM Power 770 and 780 9117 MMD 9179 MHD Technical Overview and Introduction ...

Page 173: ... generation of IBM servers is designed to be more reliable than the previous server family POWER7 and POWER7 processor based servers have features to support new levels of virtualization help ease administrative burden and increase system utilization Reliability starts with components devices and subsystems designed to be fault tolerant POWER7 and POWER7 uses lower voltage technology improving rel...

Page 174: ...ervice processors Design and manufacturing verification and integration and also field support information is used as feedback for continued improvement on the final products This chapter also includes a manageability section which describes the means to successfully manage your systems Several software based availability features exist that are based on the benefits available when using AIX and I...

Page 175: ...rocessor design Not only does this case reduce the total number of system components it reduces the total amount of heat generated in the design resulting in an additional reduction in required power and cooling components POWER7 and POWER7 processor based servers also integrate L3 cache into the processor chip for a higher integration of parts Parts selection also plays a critical role in overall...

Page 176: ...current repair High opportunity components or those that most affect system availability are protected with redundancy and the ability to be repaired concurrently The use of redundant parts allows the system to remain operational POWER7 cores which include redundant bits in L1 I L1 D and L2 caches and in L2 and L3 directories Power 770 and Power 780 main memory DIMMs which contain an extra DRAM ch...

Page 177: ...ion has the lowest priority and attempts to claim the needed resource On a properly configured POWER processor based server this approach allows that capacity to first be obtained from a low priority partition instead of a high priority partition This capability is relevant to the total system availability because it gives the system an additional stage before an unplanned outage In the event that...

Page 178: ...ecting system operation again The repair action is deferred to a more convenient less critical time Persistent deallocation functions include the following items Processor L2 L3 cache lines cache lines are dynamically deleted Memory Deconfigure or bypass failing I O adapters Processor instruction retry As in POWER6 the POWER7 and POWER7 processor has the ability to retry processor instruction and ...

Page 179: ...robability of any one processor affecting total system availability by containing most processor checkstops to the partition that was using the processor at the time that the full checkstop goes into effect Even with all these availability enhancements to prevent processor errors from affecting system wide availability errors might result on a system wide outage 4 2 3 Memory protection A memory pr...

Page 180: ...kill is an enhancement that enables a system to sustain the failure of an entire DRAM chip Chipkill spreads the bit lines from a DRAM over multiple ECC words so that a catastrophic DRAM failure does not affect more of what is protected by the ECC code implementation The system can continue indefinitely in this state with no performance degradation until the failed DIMM can be replaced Figure 4 2 s...

Page 181: ...ER Hypervisor notifies the owning partition that the page should be deallocated Where possible the operating system moves any data that is currently contained in that memory area to another memory area and removes the page or pages that are associated with this error from its memory map no longer addressing these pages The operating system performs memory page deallocation without any user interve...

Page 182: ...re marked as deallocated and working resources are included in the active memory space Because these activities reduce the amount of CoD memory available for future use schedule repair of the faulty memory as soon as convenient Upon reboot if not enough memory is available to meet minimum partition requirements the POWER Hypervisor reduces the capacity of one or more partitions Depending on the co...

Page 183: ...rrored Desired memory configured for individual partitions is not mirrored To enable mirroring the requirement is to have eight equally sized functional memory DIMMs behind at least one POWER7 or POWER7 chip in each CEC enclosure The DIMMs will be managed by the same memory controller The sizes of DIMMs might be different from one Power 7 or Power 7 chip to another A write operation in the memory ...

Page 184: ...o change from mirroring mode to non mirrored mode This same frame also gives information about the mirroring status Desired mirroring mode The values are either Off or System firmware only System firmware mirroring status Fully mirrored The mirroring is completely functional Partially functional Because of uncorrectable memory failures some of the hypervisor elements or objects are not mirrored Th...

Page 185: ...ht impact on performance while in progress The operation can be stopped by selecting Cancel A time limit can also be specified DIMM guard at system boot During system boot the FSP will guard a failing DIMM Because there will not be eight functional DIMMs behind a memory controller hypervisor mirroring is not possible on this chip Then at boot time the following events occur If there are other chip...

Page 186: ...n deallocate all but one set before doing a Processor Instruction Retry In addition faults in the Segment Lookaside Buffer SLB array are recoverable by the POWER Hypervisor The SLB is used in the core to perform address translation calculations L2 and L3 array protection The L2 and L3 caches in the POWER7 processor are protected with double bit detect single bit correct error detection code ECC Si...

Page 187: ...tem that the standard ECC is no longer valid The service processor is then notified and takes appropriate actions When running AIX V5 2 or later or Linux and a process attempts to use the data the operating system is informed of the error and might terminate or only terminate a specific process that is associated with the corrupt data depending on the operating system and firmware level and whethe...

Page 188: ... a system reboot to continue PCI enhanced error handling enabled adapters respond to a special data packet that is generated from the affected PCI slot hardware by calling system firmware which examines the affected bus allows the device driver to reset it and continues without a system reboot For Linux enhanced error handling EEH support extends to the majority of frequently used devices although...

Page 189: ... setup CSU customer installed features CIF and customer replaceable units CRU On demand service education Error detection and fault isolation ED FI First failure data capture FFDC An automated guided repair strategy that uses common service interfaces for a converged service approach across multiple IBM server platforms By delivering on these goals IBM Power Systems servers enable faster and more ...

Page 190: ...tem fan speed is out of operational specification for example because of multiple fan failures The server input voltages are out of operational specification The service processor can immediately shut down a system in the following circumstances Temperature exceeds the critical level or remains above the warning level for too long Internal component temperatures reach critical levels Non redundant...

Page 191: ... the information is passed from the NVRAM to the system error log where it is analyzed by error log analysis ELA routines Appropriate actions are taken to report the boot time error for subsequent service if required Concurrent access to the service processors menus of the ASMI This access allows nondisruptive abilities to change system default parameters interrogate service processor progress and...

Page 192: ... so that for every check station the unique error domain for that checker is defined and documented Ultimately the error domain becomes the field replaceable unit FRU call and manual interpretation of the data is not normally required First failure data capture FFDC FFDC is an error isolation technique It ensures that when a fault is detected in a system through error checkers or other types of de...

Page 193: ...exceeded a pre determined threshold or was unrecoverable Based on the isolation analysis recoverable error threshold counts can be incremented No specific service action is necessary when the event is recoverable When the event requires a service action additional required information is collected to service the fault For unrecoverable errors or for recoverable events that meet or exceed their ser...

Page 194: ...stem was powered off or on the boot time selection menu Run time All Power Systems servers can monitor critical system components during run time and they can take corrective actions when recoverable faults occur IBM hardware error check architecture provides the ability to report non critical errors in an out of band communications path to the service processor without affecting system performanc...

Page 195: ...ent failure data with service parts information and part locations is sent to the IBM service organization This information will also contain the client contact information as defined in the Electronic Service Agent ESA guided set up wizard Error logging and analysis When the root cause of an error is identified by a fault isolation component an error log entry is created with basic data such as t...

Page 196: ...vice processor It then looks at all active service event requests analyzes the failure to ascertain the root cause and if enabled initiates a call home for service This methodology ensures that all platform errors will be reported through at least one functional path ultimately resulting in a single notification for a single problem Extended error data Extended error data EED is additional data th...

Page 197: ...hese events can always be reported back to IBM at the client s discretion Call home A correctly configured POWER processor based system can initiate an automatic or manual call from a client location to the IBM service and support organization with error data server status or other service related information The call home feature invokes the service organization in order for the appropriate servi...

Page 198: ...hanisms such as latches levers thumb screws pop Nylatches U clips and cables are included to help prevent loose connections and aid in installing seating parts correctly These positive retention items do not require tools Light Path The Light Path LED feature is for low end systems including Power Systems up to models 750 and 755 that can be repaired by clients In the Light Path LED implementation...

Page 199: ...n and serviceability direction of components Various serviceable parts such as latches levers and touch points must be pulled or pushed in a certain direction and order so that the mechanical mechanisms can engage or disengage Arrows generally improve the ease of serviceability The operator panel The operator panel on a POWER processor based system is a four row by 16 element LCD display that is u...

Page 200: ...s must comply with the following protective measures For memory upgrade and node repair ensure that the system has sufficient inactive or spare processors and memory Critical I O resources must be configured with redundant paths Schedule upgrades or repairs during non peak operational hours Move business applications to another server by using the PowerVM Live Partition Mobility feature or quiesce...

Page 201: ... is stand alone or managed by a management console the current firmware installed and what operating systems are running on the system These scenarios and the associated installation instructions are comprehensively outlined in the firmware section of Fix Central http www ibm com support fixcentral You might also want to review the best practice white papers http www14 software ibm com webapp set2...

Page 202: ...g on the state of the system and its operating environment The primary service interfaces are the following items Light Path and Guiding Light For more information see Light Path on page 184 and Guiding Light on page 184 Service processor Advanced System Management Interface ASMI Operator panel Operating system service menu Service Focal Point on the Hardware Management Console Service Focal Point...

Page 203: ...46 Service processor Eth1 or HMC2 port is configured as 169 254 3 146 The following functions are available through service processor Call home Advanced System Management Interface ASMI Error Information error code part number location codes menu View of guarded components Limited repair procedures Generate dump LED Management menu Remote view of ASMI menus Firmware update through USB key Advanced...

Page 204: ...er versions of these browsers might work but are not officially supported The JavaScript language and cookies must be enabled The web interface is available during all phases of system operation including the initial program load IPL and run time However several of the menu options in the web interface are unavailable during IPL or run time to prevent usage or ownership conflicts if the system res...

Page 205: ... panel features include the following items A 2 x 16 character LCD display Reset enter power On Off increment and decrement buttons Amber System Information Attention green Power LED Blue Enclosure Identify LED on the Power 770 and Power 780 Altitude sensor USB Port Speaker Beeper The functions available through the operator panel include the following items Error Information Generate dump View Ma...

Page 206: ...d to stop all activity on the operating system and put the operating system into maintenance mode The System Management Services SMS error log is accessible on the SMS menus This error log contains errors that are found by partition firmware when the system or partition is booting The service processor s error log can be accessed on the ASMI menus You can also access the system diagnostics from a ...

Page 207: ... report the same error By using the Manage Serviceable Events task in the management console you can avoid long lists of repetitive call home information by recognizing that these are repeated errors and consolidating them into one error In addition you can use the Manage Serviceable Events task to initiate service functions on systems and logical partitions including the exchanging of parts confi...

Page 208: ...bility see the Support for IBM Systems web page http www ibm com systems support For Power Systems select the Power link Figure 4 11 Figure 4 11 Support for Power servers web page Although the content under the Popular links section can change click Firmware and HMC updates to go to the resources for keeping your system s firmware current ...

Page 209: ...stalled level It is installed on the permanent side of system firmware IBM provides the Concurrent Firmware Maintenance CFM function on selected Power Systems This function supports applying nondisruptive system firmware service packs to the system concurrently without requiring a reboot operation to activate changes For systems that are not managed by an management console the installation of sys...

Page 210: ...some new firmware functions requires installation of a firmware release level This process is disruptive to server operations and requires a scheduled outage and full server reboot 4 4 3 Electronic Services and Electronic Service Agent IBM transformed its delivery of hardware and software support services to help you achieve higher system availability Electronic Services is a web enabled solution ...

Page 211: ...celerator RAS New accelerators are designed with RAS features to avoid system outages in the vast majority of faults that can be detected by the accelerators Fabric Bus Dynamic Lane Repair POWER7 has spare bit lanes that can dynamically be repaired using PORE For busses that connect POWER7 770 and 780 CEC drawers this feature avoids any repair action or outage related to a single bit failure for t...

Page 212: ... to concurrently apply an initialization update to a processor core chiplet by loading new initialization values into memory and then forcing it to go in and out of winkle mode This step happens all without causing disruption to the workloads or operating system all occurring in a few milliseconds In the same fashion PORE can initiate an L3 cache dynamic bit line repair operation if the POWER Hype...

Page 213: ...otection X X X X X X X L2 L3 ECC and cache line delete X X X X X X X Special uncorrectable error handling X X X X X X X Active Memory Mirroring X X X X X X X Fault detection and isolation Platform FFDC diagnostics X X X X X X X Run time diagnostics X X X X Most Most Most Storage Protection Keys X X X Dynamic Trace X X X X X Operating System FFDC X X X Error log analysis X X X X X X X Freeze mode o...

Page 214: ...ing light LEDs X X X X X X X System dump for memory POWER Hypervisor SP X X X X X X X Information center Systems Support Site service publications X X X X X X X System Support Site education X X X X X X X Operating system error reporting to management console SFP X X X X X X X RMC secure error transmission subsystem X X X X X X X Health check scheduled operations with management console X X X X X ...

Page 215: ... 720 and 740 Technical Overview and Introduction REDP 4797 IBM Power 750 and 755 Technical Overview and Introduction REDP 4638 IBM Power 795 Technical Overview and Introduction REDP 4640 IBM Power Systems SDMC to HMC Migration Guide RAID1 REDP 4872 IBM PowerVM Virtualization Introduction and Configuration SG24 7940 IBM PowerVM Virtualization Managing and Monitoring SG24 7590 IBM PowerVM Live Parti...

Page 216: ...common ssi ecm en pod03051usen POD03051USEN PDF IBM Power 750 server Data Sheet http public dhe ibm com common ssi ecm en pod03034usen POD03034USEN PDF IBM Power 755 server Data Sheet http public dhe ibm com common ssi ecm en pod03035usen POD03035USEN PDF IBM Power 770 server Data Sheet http public dhe ibm com common ssi ecm en pod03035usen POD03035USEN PDF IBM Power 780 server Data Sheet http pub...

Page 217: ...entral website http www ibm com support fixcentral Power Systems Capacity on Demand website http www ibm com systems power hardware cod Support for IBM Systems website http www ibm com support entry portal Overview brandind Hardware Systems Power IBM Power Systems website http www ibm com systems power IBM Storage website http www ibm com systems storage IBM Systems Energy Estimator http www 912 i...

Page 218: ...204 IBM Power 770 and 780 9117 MMD 9179 MHD Technical Overview and Introduction ...

Page 219: ......

Page 220: ...Power 770 and 780 offerings and their prominent functions The IBM POWER7 processor available at frequencies of 3 8 GHz and 4 2 GHz for the Power 770 and 3 7 GHz and 4 4 GHz for the Power 780 The specialized IBM POWER7 Level 3 cache that provides greater bandwidth capacity and reliability The 1 Gb or 10 Gb Integrated Multifunction Card that provides two USB ports one serial port and four Ethernet c...

Reviews:

No comments

Related manuals for Power 770

Brand: Makita Pages: 3

Brand: Makita Pages: 2

Brand: Makita Pages: 3

Brand: Gallagher Pages: 39

Brand: Makita Pages: 3

Brand: Earlex Pages: 4

Brand: Keithley Pages: 160

Brand: Keithley Pages: 22

Brand: Keithley Pages: 66

Brand: Keithley Pages: 58

Brand: Laser Pages: 8

Brand: Grizzly Pages: 44

Brand: Sealey Pages: 3

Brand: Würth Pages: 8

Brand: Metabo Pages: 72

Brand: Milwaukee Pages: 35

EnergyGrind-100

Brand: PEUGEOT Pages: 10

Brand: National Instruments Pages: 18

Brands by name

0 1 2 3 4 5 6 7 8 9 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Popular brands

Load more brands