IBM Power Systems E870 Technical Overview And Introduction Download Page 46

Page: 46 / 202

5137ch02.fm

Draft Document for Review October 14, 2014 10:19 am

IBM Power Systems E870 and E880 Technical Overview and Introduction

2.1 Logical diagrams

This section contains logical diagrams for the Power E870 and E880.

Figure 2-1 shows the logical system diagram for a single system node of a Power E870 or
Power E880.

Figure 2-1 Logical system diagram for a system node of a Power E870 or a Power E880

SCU Interface

P8 (1)

Mem

tro

lle

r 0

Me
m

Co
n

tro

lle

r 1

PH
B 0

PH
B 1

P8 (2)

PH
B 0

PH
B 1

P8 (0)

PH
B

P8 (3)

PH
B

SM
P

X Bu

SM
P

X Bu

SM
P

X Bu

SM
P

X Bu

SMP

A Bus

SMP

A Bus

SMP

A Bus

SMP

A Bus

PCIe

Gen3 x16

PCIe

Gen3 x16

PCIe

Gen3 x16

PCIe

Gen3 x16

PCIe

Gen3 x16

PCIe

Gen3 x16

PCIe

Gen3 x16

PCIe

Gen3 x16

CDIMM

Memo

ntr
oll

Me
m

ont

ller

CDIMM

Mem

tro

lle

r 0

Me
m

Co
n

tro

lle

r 1

CDIMM

Memo

ntr
oll

Me
m

ont

ller

CDIMM

To other

enclosures

To other

enclosures

To other

enclosures

To other

enclosures

SCU Interface

card

12v power

to SCU

Service

Processor

Connection

Clock

Interface

To SCU

Clock

SCU Interface

card

12v power

to SCU

Service

Processor

Connection

Clock

Interface

To SCU

Clock

25.6 GB/s

76.8 GB/s

15.75 GB/s

28.8 GB/s

Summary of Contents for Power Systems E870

Page 1: ...Front cover IBM Power Systems E870 and E880 Technical Overview and Introduction Alexandre Bicas Caldeira YoungHoon Cho James Cruickshank Bart omiej Grabowski New modular architecture for increased re...

Page 2: ......

Page 3: ...nternational Technical Support Organization IBM Power Systems E870 and E880 Technical Overview and Introduction October 2014 Draft Document for Review October 14 2014 10 19 am 5137edno fm REDP 5137 00...

Page 4: ...hedule Contract with IBM Corp 5137edno fm Draft Document for Review October 14 2014 10 19 am First Edition October 2014 This edition applies to the IBM Power E870 9119 MME and Power E880 9119 MHE Powe...

Page 5: ...Power supply features 14 1 4 5 Processor card features 14 1 4 6 Summary of processor features 14 1 4 7 Memory features 16 1 4 8 System node PCIe slots 17 1 5 Disk and media features 17 1 6 I O drawer...

Page 6: ...pacity Upgrade on Demand CUoD 60 2 4 2 Power enterprise pools and mobile capacity on demand Mobile CUoD 62 2 4 3 Elastic Capacity on Demand Elastic CoD 63 2 4 4 Utility Capacity on Demand Utility CoD...

Page 7: ...e 114 3 2 POWER processor modes 115 3 3 Active Memory Expansion 117 3 4 PowerVM 118 3 4 1 PowerVM edition 118 3 4 2 Logical partitions 118 3 4 3 Multiple shared processor pools 122 3 4 4 Virtual I O S...

Page 8: ...anced Error Handling 154 4 4 Enterprise systems availability details 156 4 5 Availability impacts of a solution architecture 156 4 5 1 Clustering 157 4 5 2 Virtual I O redundancy configurations 157 4...

Page 9: ...ided for convenience only and do not in any manner serve as an endorsement of those websites The materials at those websites are not part of the materials for this IBM product and use of those website...

Page 10: ...AIX Electronic Service Agent EnergyScale eServer Focal Point IBM Micro Partitioning Power Architecture POWER Hypervisor Power Systems Power Systems Software POWER6 POWER6 POWER7 POWER7 PowerHA PowerP...

Page 11: ...per expands the current set of IBM Power Systems documentation by providing a desktop reference that offers a detailed technical description of the Power E870 and Power E880 systems This paper does no...

Page 12: ...olker Haug Daniel Henderson Stephanie Jensen Bob Kovacks Jai Lei Ma Chris Mann Dwayne Moore Mark Olson Monica Sanchez Bill Starke Jeff Stuecheli Doug Szerdi Jacobo Vargas Steve Will IBM Now you can be...

Page 13: ...m IBMRedbooks Follow us on Twitter http twitter com ibmredbooks Look for us on LinkedIn http www linkedin com groups home gid 2130806 Explore new Redbooks publications residencies and workshops with t...

Page 14: ...5137pref fm Draft Document for Review October 14 2014 10 19 am xii IBM Power Systems E870 and E880 Technical Overview and Introduction...

Page 15: ...ning AIX IBM i and Linux workloads The Power E870 is a modular built system and uses one or two system nodes together with a system control unit Each system node is five EIA units tall 5U and the syst...

Page 16: ...ant system master Flexible Service Processor FSP and support for the Operator Panel the system VPD and the base DVD The system control unit provides clock signals to the system nodes with semi flexibl...

Page 17: ...Power E880 is a modular system that is built from a combination of the following four building blocks System control unit System node PCIe Gen3 I O expansion drawer EXP24S SFF Gen2 bay drawer The sys...

Page 18: ...em Control Unit The system control unit SCU in a Power E870 and E880 is a new innovation to increase the reliability availability and serviceability of the servers The 2 EIA rack unit U unit provides...

Page 19: ...tures are indicated Figure 1 3 Front and rear view of the system control unit 1 1 4 System nodes The system nodes in the Power E870 and E880 servers host the processors memory PCIe slots and power sup...

Page 20: ...ew of the system node Figure 1 4 Front view of the system node Figure 1 5 shows the rear view of the system node with notable features highlighted Figure 1 5 Rear view of the system node PCIe Gen3 x16...

Page 21: ...s are fully flexible These cables do not impose restrictions on allowed rack specification Figure 1 6 shows a diagram of how SMP cables can be routed within a rack on a Power E880 with all four system...

Page 22: ...losures The Power E880 is a modular system that can be constructed from a single system control unit and one two three or four building block enclosures In 2014 up to two system nodes per server are s...

Page 23: ...ocessor modules with 512 KB L2 cache and 8 MB L3 cache per core 1 4 1 Power E870 system features The following features are available on the Power E870 One or two 5U 19 inch rack mount system node dra...

Page 24: ...ic CoD Temporary Processor Enablement EP9T Eight PCIe Gen3 x16 I O expansion slots per system node drawer maximum 16 with 2 drawer system One slim line SATA media bay per system control unit enclosure...

Page 25: ...Elastic CoD Temporary Processor Enablement EP9T Eight PCIe Gen3 x16 I O expansion slots per system node drawer maximum 16 with 2 drawer system One slim line SATA media bay per system control unit encl...

Page 26: ...awer EBA0 2 x Service Processor EU0A 1 x Load Source Specify EXP24S SFF Gen2 5887 or EL1S Load Source Specify 0728 SAN Load Source Specify 0837 1 x Rack mount Drawer Bezel and Hardware IBM Rack mount...

Page 27: ...O expansion only A machine type model rack if desired should be ordered as the primary rack A minimum number of eight processor activations must be ordered per system A minimum of four memory feature...

Page 28: ...stem must have a minimum of four active processors Each processor card feature will deliver a set of four identical processors All processor cards in the system must be identical Cable features are re...

Page 29: ...ic CoD Billing for EPBA AIX Linux EPJ7 1 Proc Day Elastic CoD Billing for EPBA IBM i EPJ8 100 Elastic CoD Proc Days of Billing for Processor EPBA AIX Linux EPJ9 100 Elastic CoD Proc Days of Billing fo...

Page 30: ...or EPBB IBM i EPJE 100 Elastic CoD Proc Days of Billing for Processor EPBB AIX Linux EPJF 100 Elastic CoD Proc Days of Billing for Processor EPBB IBM i EPJG Proc CoD Utility Billing 100 Proc mins for...

Page 31: ...E870 or Power E880 Each system control unit enclosure has one slim line bay which can support one DVD drive EU13 The EU13 DVD is cabled to a USB PCIe adapter located in either a system node or in a P...

Page 32: ...swap cassette BSC is used to house the full high adapters that go into these slots The BSC is the same BSC as used with the previous generation server s 12X attached I O drawers 5802 5803 5877 5873 T...

Page 33: ...3 I O expansion drawer Table 1 7 PCIe slot locations and descriptions for the PCIe Gen3 I O expansion drawer All slots support full length regular height adapter or short low profile with a regular he...

Page 34: ...ard disk drives HDDs or solid state drives SSDs It uses only 2 EIA of space in a 19 inch rack The EXP24S includes redundant AC power supplies and uses two power cords With AIX Linux and VIOS you can o...

Page 35: ...ystem control unit In 2014 up to two system nodes are supported Each system node can have up to 4 TB of memory installed Table 1 9 shows a summary of processor and memory maximums for the Power E870 a...

Page 36: ...wer 770 9117 MMB and 9117 MMC are not available To upgrade from a 9117 MMB or 9117 MMC an upgrade to a 9117 MMD is required first The existing components being replaced during a model or feature conve...

Page 37: ...u must reorder the elastic CoD enablement features when placing the upgrade MES order for the new Power E870 or E880 system to keep the elastic CoD function active To initiate the model upgrade the on...

Page 38: ...ory upgrade to a minimum of 4 GB 1 12 System racks The Power E870 and E880 and its I O drawers are designed to be mounted in the following existing IBM racks 7014 T00 7014 T42 7965 94Y 0553 0551 and E...

Page 39: ...1 12 2 IBM 7014 model T42 rack The 2 0 meter 79 3 inch Model T42 addresses the requirement for a tall enclosure to house the maximum amount of equipment in the smallest possible floor space The follow...

Page 40: ...ndicated with feature EC04 1 12 4 Feature code 0551 rack The 1 8 meter rack 0551 is a 36U EIA units rack The rack that is delivered as 0551 is the same rack delivered when you order the 7014 T00 rack...

Page 41: ...uration with two pairs of 30A PDUs suppling two system nodes configuration and two I O expansion drawers Figure 1 12 Two system node configuration and two I O expansion drawers supplied by 30A PDUs Fo...

Page 42: ...connector Each PDU requires one PDU to wall power cord Various power cord features are available for countries and applications by selecting a PDU to wall power cord which must be ordered separately E...

Page 43: ...ch group of two outlets is fed from one 20 A circuit breaker The Universal PDUs are compatible with previous models Power cord and PDU Based on the power cord that is used the PDU can supply a range o...

Page 44: ...5137ch01 fm Draft Document for Review October 14 2014 10 19 am 30 IBM Power Systems E870 and E880 Technical Overview and Introduction...

Page 45: ...stem E880 9119 MHE servers The bandwidths that are provided throughout the section are theoretical maximums that are used for reference The speeds that are shown are at an individual component level M...

Page 46: ...SMP A Bus PCIe Gen3 x16 slot PCIe Gen3 x16 slot PCIe Gen3 x16 slot PCIe Gen3 x16 slot PCIe Gen3 x16 slot PCIe Gen3 x16 slot PCIe Gen3 x16 slot PCIe Gen3 x16 slot CDIMM CDIMM CDIMM CDIMM CDIMM CDIMM CD...

Page 47: ...e 2 2 on page 33 shows the logical system diagram for the system control unit of a Power E870 or a Power E880 Figure 2 2 Logical system diagram for the system control unit Power in Operator Panel From...

Page 48: ...configured with more than one system node Figure 2 3 on page 34 shows the SMP connection topology for a two drawer Power E870 or Power E880 system Figure 2 3 SMP connection topology for a two drawer...

Page 49: ...e 2 4 SMP connection topology for a three drawer Power E880 T1 T2 T5 T6 T3 T4 P3 X3 X1 X0 A2 A1 A0 Drawer 3 P2 X3 X1 X0 A2 A1 A0 P0 X3 X1 X0 A2 A1 A0 P1 X3 X1 X0 A2 A1 A0 Drawer 2 T1 T2 T5 T6 T3 T4 Dr...

Page 50: ...ssor in the IBM Power Systems product family and describes its main characteristics and features T1 T2 T5 T3 T4 P3 X3 X1 X0 A2 A1 A0 Drawer 3 P2 X3 X1 X0 A2 A1 A0 P0 X3 X1 X0 A2 A1 A0 P1 X3 X1 X0 A2 A...

Page 51: ...ocessors in addition to DDR3 memory and various I O devices POWER8 systems use memory buffer chips to interface between the POWER8 processor and DDR3 or DDR4 memory1 Each buffer chip also includes an...

Page 52: ...ssor Hardware transactional memory On chip accelerators including on chip encryption compression and random number generation accelerators Coherent Accelerator Processor Interface which allows acceler...

Page 53: ...symmetric load store units and two load units all four of which can also run simple fixed point instructions An integrated multi pipeline vector scalar floating point unit for running both scalar and...

Page 54: ...ion scaling is influenced by both multi core and multi thread technology Simultaneous Multithreading SMT allows a single physical processor core to simultaneously dispatch instructions from more than...

Page 55: ...el operates at 1600 MHz and connects to a DIMM Each DIMM on a POWER8 system has a memory buffer that is responsible for many functions that were previously on the memory controller such as scheduling...

Page 56: ...MB local region of L3 cache FLR L3 but also has access to other L3 cache regions as shared L3 cache Additionally each core can negotiate to use the FLR L3 cache that is associated with another core d...

Page 57: ...che and memory buffer POWER8 processor based systems introduce an additional level of memory hierarchy The Level 4 L4 cache is implemented together with the memory buffer in the Custom DIMM CDIMM Each...

Page 58: ...close to fine grained locking Most implementations of transactional memory are based on software The POWER8 processor based systems provide a hardware based implementation of transactional memory tha...

Page 59: ...Power Service Layer PSL which provides address translation and system memory cache for the accelerator functions The custom processors on the board consisting of an FPGA or an Application Specific In...

Page 60: ...ich frequency to set is different Dynamic Power Saver Tunable Parameters The Dynamic Power Saver Favor Performance and Dynamic Power Saver Favor Power modes are tuned to provide both energy savings an...

Page 61: ...and dynamically activate it when needed It is required that at least 50 of the installed RAM capacity is active The Power E870 and E880 servers support an optional feature called Active Memory Expans...

Page 62: ...nts include Memory Scheduler Memory Management RAS Decisions Energy Management Memory Buffer By adopting this architecture for the memory DIMMs several decisions and processes regarding memory optimiz...

Page 63: ...870 and Power E880 Reduces energy consumption by reducing the number of memory requests Increases memory write performance by acting as a cache and by grouping several random writes into larger transa...

Page 64: ...ds can be seen on Figure 2 13 Figure 2 13 Logical diagram of a POWER8 processor and its two memory quads The basic rules for memory placement follows Each feature code equals a set of four physical CD...

Page 65: ...d P1 C36 Quad 4 P1 C21 P1 C22 P1 C27 and P1 C28 Quad 5 P1 C47 P1 C48 P1 C49 and P1 C50 Quad 6 P1 C39 P1 C40 P1 C41 and P1 C42 Quad 7 P1 C31 P1 C32 P1 C33 and P1 C34 Quad 8 P1 C23 P1 C24 P1 C25 and P1...

Page 66: ...m Node 1 Processor 0 Processor 2 Processor 3 Processor 1 Quad 1 Quad 5 Quad 2 Quad 6 Quad 3 Quad 7 Quad 4 Quad 8 1 5 2 6 3 7 4 8 Notes Memory quads 1 4 must be populated Memory quads on the same proce...

Page 67: ...ocessor 3 Processor 1 Quad 1 Quad 5 Quad 2 Quad 6 Quad 3 Quad 7 Quad 4 Quad 8 1 13 2 16 3 19 4 22 System Node 2 Processor 0 Processor 2 Processor 3 Processor 1 Quad 1 Quad 5 Quad 2 Quad 6 Quad 3 Quad...

Page 68: ...Memory activations that can be moved from server to server in a power enterprise pool Both types of memory activations can co reside in the same system as long as at least 25 of the memory activations...

Page 69: ...power enterprise pool and have feature code EB35 configured For more information on power enterprise pools please see 2 4 2 Power enterprise pools and mobile capacity on demand Mobile CUoD on page 62...

Page 70: ...s depending on the clock of the core and the formula is as follows 4 024 GHz Core 1 32 B 1 32 B 4 024 GHz 257 54 GBps 4 190 GHz Core 1 32 B 1 32 B 4 190 GHz 286 16 GBps For each system node of a Power...

Page 71: ...ation can be accomplished The value varies depending on the clock of the core and the formula is as follows 4 350 GHz Core 1 32 B 1 16 B 4 350 GHz 208 80 GBps L3 cache In one clock cycle one 32 byte l...

Page 72: ...ross multiple memory CDIMMs If a CDIMM that contains the hypervisor code develops an uncorrectable error its mirrored partner will enable the system to continue to operate uninterrupted System node ba...

Page 73: ...for tracking the state of the memory pages assigned to partitions Translation control entities TCEs responsible for providing I O buffers for the partition s communications Memory used by the hypervi...

Page 74: ...ing prevents an uncorrectable error in memory or cache from immediately causing the system to terminate Rather the system tags the data and determines whether it will ever be used again If the error i...

Page 75: ...that would only be necessary on later stages of the project usually with impacts on software licensing costs and software maintenance By using Capacity Upgrade on Demand a company could start with a...

Page 76: ...sor generations The basic rules for the Mobile Capacity on Demand follows The Power 770 and Power 780 systems require a minimum of four static processor activations The Power 870 and Power 880 require...

Page 77: ...Table 2 19 lists the mobile memory activation features that are available for the Power E870 and Power E880 Table 2 19 Mobile memory activation features For more information on power enterprise pools...

Page 78: ...ry capacity on a server you must enable it for elastic CoD To do this order an enablement feature and sign the required contracts IBM will generate an enablement code mail it to you and post it on the...

Page 79: ...erVM Enterprise Edition to be active If a Power E870 or Power E880 server uses the IBM i operating system in addition to any other supported operating system on the same server the client must inform...

Page 80: ...re 2 18 Figure 2 18 System nodes PCIe slots directly attached to PCIe controllers on POWER8 chips Besides the slots directly attached to the processors PCI Gen3 controllers the systems also allow for...

Page 81: ...70 and Power E880 as a standard redundant service processor cards are installed on the control unit as well as redundant clock cards The cables used to provide communications between the control units...

Page 82: ...problem EEH enabled adapters respond to a special data packet that is generated from the affected PCIe slot hardware by calling system firmware which examines the affected bus allows the device drive...

Page 83: ...without removing the system nodes or PCIe expansion drawers from the rack Slot 8 P1 C8 PCIe Gen3 x16 Yes Yes a At the time of writing there are no supported CAPI adapters for the Power E870 and E880 s...

Page 84: ...serial interface and allows for point to point interconnections between devices using a directly wired interface between these connection points A single PCIe serial link is a dual simplex connection...

Page 85: ...llowing sections describe the supported adapters and provide tables of orderable feature numbers The tables indicate operating system support AIX IBM i and Linux for each of the adapters 2 7 2 LAN Ada...

Page 86: ...inux EC3B 57B6 PCIe3 2 Port 40 GbE NIC RoCE QSFP Adapter I O drawer AIX Linux EN0S 2CC3 PCIe2 4 Port 10Gb 1 GbE SR RJ45 Adapter I O drawer AIX Linux EN0U 2CC3 PCIe2 4 port 10Gb 1 GbE Copper SFP RJ45 A...

Page 87: ...B4 PCIe3 LP RAID SAS ADAPTER CEC AIX IBM i Linux EJ10 57B4 PCIe3 SAS Tape DVD Adapter Quad port 6Gb x8 I O drawer AIX IBM i Linux EJ11 57B4 PCIe3 LP SAS Tape DVD Adapter Quad port 6Gb x8 CEC AIX IBM i...

Page 88: ...C traffic and Fibre Channel functions Table 2 26 Available FCoE adapters For more information about FCoE see An Introduction to Fibre Channel over Ethernet and Fibre Channel over Convergence Enhanced...

Page 89: ...f multiple byte lanes Each individual byte lane is a four wire 2 5 5 0 or 10 0 Gbps bidirectional connection Combinations of link width and byte lane speed allow for overall link speeds from 2 5 Gbps...

Page 90: ...wer The control unit has a DVD drive which is connected to an external USB port on the rear of the unit In order to use the DVD drive at least on PCIe USB adapter must be installed and connected via a...

Page 91: ...nd Power E880 2 9 1 PCIe Gen3 I O expansion drawer The PCIe Gen3 I O expansion drawer is a 4U high PCI Gen3 based and rack mountable I O drawer It offers two PCIe FanOut Modules EMXF that each provide...

Page 92: ...the adapters in the system node with data transfer cables 2M Optical Cable Pair for PCIe3 Expansion Drawer ECC6 10M Optical Cable Pair for PCIe3 Expansion Drawer ECC8 Two PCIe3 Optical Cable Adapter f...

Page 93: ...er Connect the other end of the cable to connector T2 on the PCIe3 6 slot fanout module in your expansion drawer Repeat above 4 steps for the other PCIe3 6 slot fanout module in the expansion drawer F...

Page 94: ...er E870 and Power E880 system node However we recommend that you use the PCIe adapter slot priority information while selecting slots for installing PCIe3 Optical Cable Adapter EJ07 Table 2 30 shows P...

Page 95: ...37ch02 fm Figure 2 27 shows example of a single system node and two PCI Gen3 I O expansion drawers Figure 2 27 Example of a single system node and two I O drawers Left FanOut Right FanOut Left FanOut...

Page 96: ...shows an example of two system nodes and two PCI Gen3 I O expansion drawers Figure 2 28 Example of two system nodes and two I O drawers Left FanOut Right FanOut Left FanOut Right FanOut Slot 6 Slot 7...

Page 97: ...ion drawer SPCN cabling There is no system power control network SPCN used to control and monitor the status of power and cooling within the I O drawer SPCN capabilities are integrated in the optical...

Page 98: ...ies and uses two power cords To maximize configuration flexibility and space utilization the system node of Power E870 and Power E880 system does not have integrated SAS bays or integrated SAS control...

Page 99: ...disks on each mode Figure 2 30 EXP24S front view with location codes and disk groups depending on its mode of operation Mode setting is done by IBM Manufacturing and there is no option provided to cha...

Page 100: ...Review October 14 2014 10 19 am 86 IBM Power Systems E870 and E880 Technical Overview and Introduction Figure 2 31 on page 86 shows the mode stickers Figure 2 31 Mode sticker locations at the rear of...

Page 101: ...port the EXP24S PCIe Dual x4 SAS Adapter 5901 PCIe2 1 8GB Cache RAID SAS Adapter Tri port 6Gb 5913 PCIe2 1 8GB Cache RAID SAS Adapter Tri port 6Gb CR ESA3 PCIe3 RAID SAS Adapter Quad port 6Gb x8 EJ0J...

Page 102: ...SAS SFF 2 Disk Drive IBM i IBM i 1962 19B3 571 GB 10 K RPM SAS SFF 2 Disk Drive IBM i IBM i 1964 600 GB 10 K RPM SAS SFF 2 Disk Drive AIX Linux AIX Linux ES0C 58B9 387 GB SFF 2 SSD for AIX LINUX with...

Page 103: ...le scenarios are included For more information about SAS cabling and cabling configurations see Planning for serial attached SCSI cables in the IBM Knowledge Center point to correct link when infocent...

Page 104: ...lowing for up to 24 disks to be attached to the server Figure 2 34 on page 90 shows the connection diagram and components of the solution Figure 2 34 Scenario 1 Basic non redundant connection For this...

Page 105: ...ection diagram and components of the solution Figure 2 35 Scenario 2 Basic redundant connection For this scenario the required feature codes are One EXP24S drawer 5887 with indicator feature 9360 mode...

Page 106: ...agram and components of the solution Figure 2 36 Dual Virtual I O Servers sharing a single EXP24S For this scenario the required feature codes are One EXP24S drawer 5887 with indicator feature 9366 mo...

Page 107: ...ng for hot maintenance of the whole EXP24S drawers if all data is properly mirrored Figure 2 37 on page 93 shows the connection diagram and components of the solution Figure 2 37 Dual Virtual I O Serv...

Page 108: ...on Figure 2 38 Four Virtual I O Servers sharing two EXP24S For this scenario the required feature codes are Two EXP24S drawers 5887 with indicator feature 9365 mode 4 with four 5901 Eight PCIe SAS ada...

Page 109: ...m com systems storage storwize IBM Flash Storage IBM Flash Storage delivers extreme performance to derive measurable economic value across the data architecture servers software applications and stora...

Page 110: ...lp improve server usage simplify systems management and accelerate provisioning of server resources by using the PowerVM virtualization technology The Power E870 and Power E880 platforms support two m...

Page 111: ...8 by default includes two HDDs with RAID 1 configured RAID 1 is also offered on the 7042 CR6 7042 CR7 and 7042 CR8 models if the feature was removed from the initial order as an MES upgrade option RAI...

Page 112: ...orts must be addressed by two separate subnets Figure 2 39 shows a simple network configuration to enable the connection from the HMC to the server and to allow for dynamic LPAR operations For more in...

Page 113: ...to be available when the other is not during maintenance for example To achieve HMC redundancy for a POWER8 processor based server the server must be connected to two HMCs The HMCs must be running th...

Page 114: ...uide SG24 7491 2 12 Operating system support The IBM Power E870 and Power E880 systems support the following operating systems AIX IBM i Linux In addition the Virtual I O Server can be installed in sp...

Page 115: ...p you to automate the task of checking and downloading operating system downloads is part of the base operating system For more information about the suma command go to the following website http www1...

Page 116: ...2 3 IBM i operating system The IBM i operating system is supported on the Power E870 and Power E880 with the following minimum required levels IBM i 7 1 TR9 or later IBM i 7 2 TR1 or later IBM periodi...

Page 117: ...unleash the full power of your IT investment With the XL compilers you can create and maintain critical business and scientific applications while maximizing application performance and improving dev...

Page 118: ...sor local build and cross language cross platform debugger all integrated into an Eclipse workbench This solution can greatly improve developers productivity and initial code quality with resultant be...

Page 119: ...he processor frequency and voltage on a fixed amount reducing the energy consumption of the system while still delivering predictable performance This percentage is predetermined to be within a safe o...

Page 120: ...s to meet a particular consumption limit then soft power capping is the mechanism to use Processor core nap mode IBM POWER8 processor uses a low power mode that is called nap that stops processor exec...

Page 121: ...rgy Saver Mode or Dynamic Power Saver Mode the fan speed varies based on power consumption and ambient temperature Processor folding Processor folding is a consolidation technique that dynamically adj...

Page 122: ...hnologies are embedded in the hardware and do not require an operating system or external management component Fan control environmental monitoring and system energy management are controlled by the O...

Page 123: ...cy only 2 13 3 Energy consumption estimation Often for Power Systems various energy related values are important Maximum power consumption and power source loading values These values are important fo...

Page 124: ...5137ch02 fm Draft Document for Review October 14 2014 10 19 am 110 IBM Power Systems E870 and E880 Technical Overview and Introduction...

Page 125: ...changing business needs or handle unexpected changes in demand Simplify IT infrastructure management by making workloads independent of hardware resources so you can make business driven policies to...

Page 126: ...a reset or reload if it detects the loss of the service processor notifying the operating system if the problem is not corrected The POWER Hypervisor is always active regardless of the system configur...

Page 127: ...3 4 8 Operating system support for PowerVM on page 129 The virtual Ethernet is part of the base system configuration Virtual Ethernet has the following major features The virtual Ethernet adapters can...

Page 128: ...ccess to a system console Tasks such as operating system installation network setup and various problem analysis activities require a dedicated system console The POWER Hypervisor provides the virtual...

Page 129: ...er org wp content uploads 2012 07 PowerISA_V2 05 pdf POWER6 compatibility mode This mode is similar to POWER6 with eight more storage protection keys POWER7 mode This is the mode for POWER7 and POWER7...

Page 130: ...OWER7 and POWER8 compatibility modes POWER6 and POWER6 mode POWER7 mode POWER8 mode Customer value 2 thread SMT 4 thread SMT 8 thread SMT Throughput performance and processor core usage Vector Multime...

Page 131: ...decompression The POWER8 processor includes Active Memory Expansion on the processor chip to provide dramatic improvement in performance and greater processor efficiency To take advantage of the hardw...

Page 132: ...ify the details what is specifically supported by the operating system go to the Table 3 3 on page 129 Active Memory Expansion AME is available as an additional feature EM82 3 4 2 Logical partitions L...

Page 133: ...g the shared processor pool Management window Shared processor partitions use the default shared processor pool called DefaultPool by default For more information about multiple shared processor pools...

Page 134: ...essors A virtual processor can be running dispatched either on a physical core or as standby waiting for a physical core to became available Virtual processors do not introduce any additional abstract...

Page 135: ...nd on dynamically while the operating system is running for AIX run smtctl for Linux run ppc64_cpu smt and for IBM i use QPRCMLTTSK system value If simultaneous multithreading is off each physical cor...

Page 136: ...cal processors depends on whether simultaneous multithreading is turned on or off 3 4 3 Multiple shared processor pools Multiple shared processor pools MSPPs are supported on POWER8 processor based se...

Page 137: ...rs that support the multiple shared processor pools capability have a minimum of one the default shared processor pool and up to a maximum of 64 shared processor pools 3 4 4 Virtual I O Server The VIO...

Page 138: ...Ethernet Adapter A Shared Ethernet Adapter SEA can be used to connect a physical Ethernet network to a virtual Ethernet network The Shared Ethernet Adapter provides this access by connecting the POWE...

Page 139: ...lability because there are no configuration limits Unicast broadcast and multicast are supported so protocols that rely on broadcast or multicast such as Address Resolution Protocol ARP Dynamic Host C...

Page 140: ...ocumentation datasheet html N_Port ID Virtualization N_Port ID Virtualization NPIV is a technology that allows multiple logical partitions to access independent physical storage through the same physi...

Page 141: ...on Mobility PowerVM Live Partition Mobility allows you to move a running logical partition including its operating system and running applications from one system to another without any shutdown or wi...

Page 142: ...VM The physical memory of an IBM Power System can be assigned to multiple partitions in either dedicated or shared mode The system administrator can assign some physical memory to a partition and some...

Page 143: ...itions can hint to the POWER Hypervisor that some pages such as frequently referenced read only code pages are good for deduplication To perform deduplication the hypervisor cannot compare every memor...

Page 144: ...s Yes Yes Yes Yes Yes Shared dedicated capacity Yes Yes Yes Yes Yes Yes Multiple Shared Processor Pools Yes Yes Yes Yes Yes Yes VIOS Yes Yes Yes Yes Yes Yes Integrated Virtualization Manager Yes Yes Y...

Page 145: ...8R8 2 0 HMC V8R8 2 0 provides the following new functions PowerVM simplification improves and simplifies the overall end to end management and deployment of virtualization on Power Systems This is a c...

Page 146: ...ates allow you to specify the configuration details for the system I O memory storage network processor and other partition resources A user can use the predefined or captured templates that are avail...

Page 147: ...elect a System Template and click Deploy After deploying a system a user can choose a Partition Template from the library Performance The Performance function opens the Performance and Capacity Monito...

Page 148: ...4 IBM Power Systems E870 and E880 Technical Overview and Introduction Figure 3 9 shows the bottom of the window where performance and capacity data are presented in a graphical format Figure 3 9 HMC p...

Page 149: ...nctions As part of the enhancements introduced in this version this new capability aids in the management of PowerVM from a single UI Figure 3 10 shows all virtualization components are now displayed...

Page 150: ...allocated memory allocated processing units allocated virtual processors and status This can be seen in Figure 3 11 Figure 3 11 Virtual I O server properties displayed in a single UI 3 4 12 Virtual St...

Page 151: ...tions and its virtual SCSI devices Figure 3 12 This figure displays the adapters assigned to each partition 3 4 13 Virtual Network Management HMC V8 8 1 0 1 helps to manage PowerVM virtual networks th...

Page 152: ...a Link Aggregation device PowerVM networking concepts review PowerVM includes extensive and powerful networking tools and technologies which can be used to enable more flexibility better security and...

Page 153: ...system that is based on performance and capacity data from an existing system or that is based on new workloads that you specify You can use the SPT before you order a system to determine what you mus...

Page 154: ...erVC Editions Table 3 6 IBM PowerVC Editions key features overview For more information about IBM PowerVC see IBM PowerVC Version 1 2 Introduction and Configuration SG24 8199 3 7 IBM Power Virtualizat...

Page 155: ...n which gives you more performance details for each VM displaying detailed information about various resources such as CPU memory and disk activity Support for all virtual machine types including AIX...

Page 156: ...better use the 10 Gb Ethernet Adapters that are used within the mobility process and PowerVM server evacuation function Shared Ethernet Adapter by default uses the largesend attribute The VIOS update...

Page 157: ...capable hardware_encryption_capable hca_capable huge_page_mem_capable lpar_ affinity_group_capable lpar_avail_priority_capable lpar_proc_compat_mode_capable l par_remote_restart_capable powervm_lpar_r...

Page 158: ...be met The managed system should support toggle partition remote capability The partition should be in the inactive state The partition type should be AIX IBM i or Linux The reserved storage device p...

Page 159: ...ty and serviceability RAS design and features The elements of RAS can be described as follows Reliability Indicates how infrequently a defect or fault in a server occurs Availability Indicates how inf...

Page 160: ...r for correction or try again after soft error events In addition the design incorporates spare capacity that is integrated into many elements to tolerate certain faults without requiring an outage or...

Page 161: ...o support a PCIe switch to provide additional integrated I O capacity These integrated I O adapters can be repaired in these servers concurrently which is an improvement over comparable POWER7 7 scale...

Page 162: ...with higher failure rates that is it cuts off the front end of the traditional failure rate bathtub curve see Figure 4 1 Figure 4 1 Failure rate bathtub curve 4 2 2 Placement of components Packaging...

Page 163: ...olerated within the hardware design by using error correction code or advanced techniques to try operations again after a fault Tolerating a correctable solid fault runs the risk that the fault aligns...

Page 164: ...o correctable by a try again operation that is handled by the hardware Internal and external processor fabric busses have SEC DED ECC protection as well SEC DED capabilities are also included in other...

Page 165: ...st priority workload Partition Availability Priority is assigned to partitions by using a weight value or integer rating The lowest priority partition is rated at 0 zero and the highest priority parti...

Page 166: ...troller for attaching cache coherent adapters that are external to the processor module The POWER8 design contains a function to freeze the function that is associated with some of these elements with...

Page 167: ...cating with DRAM modules The 16 GB DIMM for example has one rank that is composed of four ports of x8 DRAM modules each port containing 10 DRAM modules L4 Ca che M em or y Bu ffer L 4 Memory Controlle...

Page 168: ...s of single cell persistent hard faults for deallocation of associated pages However because of the ECC and sparing capabilities that are used such memory page deallocation is not relied upon for repa...

Page 169: ...m or a PCIe switch The integrated PCIe controller supports try again end point error recovery and freezing IBM device drivers under AIX are fully EEH capable For Linux under PowerVM EEH support extend...

Page 170: ...inimize the impact to server performance caused by a failed processor An inactive processor is activated if a failing processor reaches a predetermined error threshold thus helping to maintain perform...

Page 171: ...emMirror 7 1 2 Enterprise Edition for AIX http www redbooks ibm com abstracts sg248106 html 4 5 2 Virtual I O redundancy configurations Within each server the partitions can be supported with a single...

Page 172: ...system PowerVM This is done across a LAN while the initial partition continues to run PowerVM has control of I O operations through I O virtualization and keeps track of memory changes that occur thro...

Page 173: ...O through a VIOS there can be no non virtualized adapters assigned to such partitions A diagram with the minimum requirements can be seen in Figure 4 4 Figure 4 4 Minimum Live Partition Mobility requ...

Page 174: ...these slots might become unusable Once this affects availability of PCIe slots it must be taken into consideration while selecting the slot placement for the adapters on the VIrtual I O Servers For s...

Page 175: ...Processor Chip PHB PHB PCIe Ctrl Processor Chip PHB PHB PCIe Ctrl Processor Chip PHB PHB PCIe Ctrl x16 PCIe Switch x8 x8 LAN Adapter LAN Adapter FC Adapter For SAN FC Adapter For SAN LAN Adapter LAN A...

Page 176: ...erviceability is to repair the system while attempting to minimize or eliminate service cost within budget objectives and maintaining application availability and high customer satisfaction Serviceabi...

Page 177: ...alized hardware detection circuitry that is used to detect erroneous hardware operations Error checking hardware ranges from parity error detection that is coupled with Processor Instruction Retry and...

Page 178: ...cation for example because of multiple fan failures The server input voltages are out of operational specification The service processor can shut down a system in the following circumstances The tempe...

Page 179: ...vers re creating diagnostic tests for failures or requiring user intervention is not necessary Solid and intermittent errors are designed to be correctly detected and isolated at the time that the fai...

Page 180: ...logs the error In non HMC managed servers the OS can start the Call Home application to report the service event to IBM For optional HMC managed servers the event is reported to the HMC which can init...

Page 181: ...re not used for the service infrastructure Service Focal Point application for partitioned systems A critical requirement in a logically partitioned environment is to ensure that errors are not lost b...

Page 182: ...the operating system depending on the type of memory dump that was initiated and whether the operating system is operational 4 6 6 Notifying After a Power Systems server detects diagnoses and reports...

Page 183: ...rded for problem management by the support and development organizations The problem is then tracked and monitored until the system fault is repaired 4 6 7 Locating and servicing The final component o...

Page 184: ...air Location diagrams are especially useful when multiple components are installed such as DIMMs sockets processor cards fans adapter LEDs and power supplies Remove or replace procedure labels contain...

Page 185: ...tabase for storage with the serviceable event to ensure that the guided maintenance procedures are operating correctly Clients can subscribe through the subscription services on the IBM Support Portal...

Page 186: ...ntegrated into the service processor operating environment Both Ethernet ports support only auto negotiation Customer selectable media speed and duplex settings are not available Both Ethernet ports h...

Page 187: ...several of the menu options in the web interface are unavailable during IPL or run time to prevent usage or ownership conflicts if the system resources are in use during that phase The ASMI provides...

Page 188: ...history log QHST and IBM i problem log The modes are as follows Service mode This mode requires a service mode boot of the system and enables the checking of system devices and features Service mode...

Page 189: ...Licensed Internal Code Work with communications trace Display Alter Dump Licensed Internal Code log Main storage memory dump manager Hardware service manager Call Home Customer Notification Error info...

Page 190: ...e system is no longer entitled the firmware updates fail Some new System Reference Code SRC packages are available E302FA06 Acquisition entitlement check failed E302FA08 Installation entitlement check...

Page 191: ...g on the system These scenarios and the associated installation instructions are comprehensively outlined in the firmware section of Fix Central found at the following website http www ibm com support...

Page 192: ...installed level It is installed on the permanent side of system firmware Figure 4 8 shows the different levels in the HMC Figure 4 8 HMC System Firmware window IBM provides the CFM function on select...

Page 193: ...d a system reboot for activation With the Power On Reset Engine PORE the firmware can now dynamically power off processor components change the registers and reinitialize while the system is running w...

Page 194: ...ing and uploading system information to IBM Support This can translate to less time that is wasted monitoring the symptoms diagnosing the error and manually calling IBM Support to open a problem recor...

Page 195: ...rvices contact your IBM SSR or see the following website http www ibm com support electronic Service Event Manager The Service Event Manager allows the user to decide which of the Serviceable Events a...

Page 196: ...MCs Event Criteria Select the filters for filtering the list of serviceable events that are shown After the selections are made click Refresh to refresh the list based on the filter values Approval st...

Page 197: ...em RAS feature AIX V7 1 TL3 SP3 V6 1 TL9 SP3 IBM i V7R1M0 TR8 V7R2M0 Linux RHEL6 5 RHEL7 SLES11SP3 Ubuntu 14 04 Processor FFDC for fault detection error isolation X X X Dynamic Processor Deallocation...

Page 198: ...s X X X System Support Site education X X X Operating system error reporting to HMC SFP application X X X RMC secure error transmission subsystem X X X Healthcheck scheduled operations with HMC X X X...

Page 199: ...duction REDP 5065 IBM PowerVM Best Practices SG24 8062 IBM PowerVM Enhancements What is New in 2013 SG24 8198 IBM PowerVM Virtualization Introduction and Configuration SG24 7940 IBM PowerVM Virtualiza...

Page 200: ...iew and Introduction IBM Power System E870 server specifications http www ibm com systems power hardware e870 specs html IBM Power System E880 server specifications http www ibm com systems power hard...

Page 201: ......

Page 202: ...e of this paper is to introduce the major innovative Power E870 and Power E880 offerings and their relevant functions The new IBM POWER8 processor available at frequencies of 4 024 GHz 4 190 GHz and 4...

Search results

Summary of Contents for Power Systems E870

Reviews:

Related manuals for Power Systems E870

Brands by name

Popular brands

IBM Power Systems E870, Technical Overview And Introduction

Search results

Summary of Contents for Power Systems E870

Reviews:

Related manuals for Power Systems E870

Brands by name

Popular brands