IBM Power 780 Technical Overview And Introduction Download Page 219

Page: 219 / 220

Summary of Contents for Power 780

Page 1: ...Technical Overview and Introduction An Ding Chen Dave Freeman Breno Henrique Leit o Features the 9117 MMD and 9179 MHD based on the latest POWER7 processor technology Describes support of up to 20 LP...

Page 2: ......

Page 3: ...International Technical Support Organization IBM Power 770 and 780 9117 MMD 9179 MHD Technical Overview and Introduction February 2013 REDP 4924 00...

Page 4: ...ights Use duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp First Edition February 2013 This edition applies to the IBM Power 770 9117 MMD and Power 780 9179 MHD Power Sy...

Page 5: ...y features 18 1 5 Disk and media features 20 1 6 I O drawers 23 1 6 1 PCI DDR 12X Expansion Drawers FC 5796 23 1 6 2 12X I O Drawer PCIe FC 5802 and FC 5877 23 1 6 3 EXP12S SAS Drawer 24 1 6 4 EXP 24S...

Page 6: ...ity on Demand 58 2 4 1 Capacity Upgrade on Demand CUoD 58 2 4 2 On Off Capacity on Demand On Off CoD 58 2 4 3 Utility Capacity on Demand Utility CoD 59 2 4 4 Trial Capacity on Demand Trial CoD 60 2 4...

Page 7: ...2 13 Operating system support 109 2 13 1 Virtual I O Server 110 2 13 2 IBM AIX operating system 110 2 13 3 IBM i operating system 111 2 13 4 Linux operating system 111 2 13 5 Java versions that are s...

Page 8: ...4 2 7 PCI enhanced error handling 169 4 2 8 POWER7 I O chip freeze behavior 171 4 3 Serviceability 171 4 3 1 Detecting 171 4 3 2 Diagnosing 176 4 3 3 Reporting 177 4 3 4 Notifying 179 4 3 5 Locating...

Page 9: ...o not in any manner serve as an endorsement of those websites The materials at those websites are not part of the materials for this IBM product and use of those websites is at your own risk IBM may u...

Page 10: ...ioning POWER Hypervisor Power Systems Power Systems Software POWER6 POWER6 POWER7 POWER7 PowerHA PowerPC PowerVM POWER pSeries PureFlex Rational Team Concert Rational Real time Compression Redbooks Re...

Page 11: ...erVM Live Partition Mobility and PowerVM Active Memory Sharing Active Memory Expansion that provides more usable memory than what is physically installed on the system IBM EnergyScale technology that...

Page 12: ...razil He has 14 years of experience with Linux Breno is also a Master Inventor in Brazil and holds a degree in Computer Science from Universidade de Sao Paulo His areas of expertise include operating...

Page 13: ...n International Technical Support Organization Dept HYTD Mail Station P099 2455 South Road Poughkeepsie NY 12601 5400 Stay connected to IBM Redbooks Find us on Facebook http www facebook com IBMRedboo...

Page 14: ...xii IBM Power 770 and 780 9117 MMD 9179 MHD Technical Overview and Introduction...

Page 15: ...bility for demanding commercial workloads The innovative IBM Power 770 and Power 780 servers with POWER7 processors are symmetric multiprocessing SMP rack mounted servers These modular built systems u...

Page 16: ...our CEC enclosures running at frequencies of 3 8 GHz The server can be specified starting with only four active cores and incrementing one core at a time through built in CoD functions to a maximum of...

Page 17: ...e core at a time up to a maximum of 64 or 128 active cores A single Power 780 CEC enclosure is equipped with 16 DIMM slots running at 1066 MHz A system configured with four drawers and 64 GB DDR3 DIMM...

Page 18: ...r source loading Power 770 1 649 kVA maximum per enclosure with 16 cores active Power 780 1 959 kVA maximum per enclosure with 24 cores active Not applicable Thermal output Power 770 5 461 Btu hr maxi...

Page 19: ...sures can take 4U EIA units of rack space Thus a two enclosure system requires 8U three enclosures require 12U and four enclosures require 16U Table 1 2 Physical dimensions of a Power 770 and Power 78...

Page 20: ...FC 1768 Dual 10 Gb Optical and Dual 1 Gb Ethernet FC 1769 One serial port included on each Integrated Multifunction Card Two USB ports included on each Integrated Multifunction Card plus another USB p...

Page 21: ...wer holding up to 30 SSDs FC EDR1 The EXP30 Ultra SSD I O Drawer is attached directly to the Power 770 9117 MMD and Power 780 9179 MHD GX slot for higher bandwidth IBM Systems Director Active Energy M...

Page 22: ...eature FC 5796 Disk only I O drawers Up to 56 EXP24S SFF SAS I O drawers on external SAS controller FC 5887 Up to 110 EXP12S SAS DASD SSD I O drawers on SAS PCI controllers FC 5886 Up to 60 EXP24 SCSI...

Page 23: ...Dual 10 Gb Copper and Dual 1 Gb Ethernet FC 1768 Dual 10 Gb Optical and Dual 1 Gb Ethernet FC 1769 1x primary operating system one of these AIX FC 2146 Linux FC 2147 IBM i FC 2145 1x Processor Card 0...

Page 24: ...EB96 1x Service Processor FC EU09 1x DASD Backplane FC 5652 2x Power Cords two selected by customer 2x A C Power Supply FC 5532 1x Operator Panel FC EC53 1x Integrated Multifunction Card options one o...

Page 25: ...Ms with 120 MB of L3 cache 12 cores per processor card each core with 10 MB of L3 cache at 4 22 GHz FC EPM0 Four 4 core POWER7 SCMs with 160 MB of L3 cache 16 cores per processor card each core with 1...

Page 26: ...ation about CoD is in 2 4 Capacity on Demand on page 58 1 4 6 Summary of processor features Table 1 5 summarizes the processor feature codes for the Power 770 Table 1 5 Summary of processor features f...

Page 27: ...then provided to your sales channel The sales channel will place an order for a quantity of On Off Processor Core Day Billing features and bill you One FC EPME must be ordered for each billable proces...

Page 28: ...pute your billing data is then provided to your sales channel The sales channel will place an order for a quantity of On Off Processor Core Day Billing features and the client will be charged One FC E...

Page 29: ...on off usage to IBM at least monthly This information used to compute your billing data is provided to your sales channel The sales channel will place an order on your behalf for the quantity of this...

Page 30: ...ation used to compute your billing data is provided to your sales channel The sales channel will place an order on your behalf for the quantity of this feature that matches your reported use One FC EP...

Page 31: ...ed you can request processors on a temporary basis You must sign an On Off Capacity on Demand contract before you order this feature Note To renew this feature after the allowed 360 processor days hav...

Page 32: ...ed to the POWER7 processor memory controller through an advanced memory buffer ASIC For each DIMM there is a corresponding memory buffer Each memory channel into the POWER7 memory controllers is drive...

Page 33: ...B of DDR3 POWER7 memory AIX IBM i Linux FC EMA3 100 GB Activation of 100 GB of DDR3 POWER7 memory Each occurrence of this feature permanently activate 100 GB of DDR3 POWER7 memory AIX IBM i Linux FC 7...

Page 34: ...ust be purchased with sufficient permanent memory activation features so that the system memory is at least 50 active The minimum activations ordered with MES orders of memory features EM40 EM41 EM42...

Page 35: ...PM SAS SFF 2 Disk Drive IBM i 1888 139 GB 15 K RPM SFF SAS Disk Drive IBM i 1787 177 GB SFF 1 SSD with eMLC IBM i 1794 177 GB SFF 2 SSD with eMLC IBM i 1996 177 GB SSD Module with eMLC IBM i 1956 283...

Page 36: ...GB 15 K RPM SAS SFF 2 Disk Drive AIX Linux 1869 Quantity 150 of FC 1925 300 GB 10 K RPM SAS SFF 2 Disk Drive AIX Linux 1929 Quantity 150 of FC 1953 300 GB 15 K RPM SAS SFF 2 Disk Drive AIX Linux 1818...

Page 37: ...e Disk only I O drawers are also supported providing large storage capacity and multiple partition support Feature FC 5886 EXP12S holds a 3 5 inch SAS disk or SSD Feature FC 5887 EXP 24S SFF Gen2 bay...

Page 38: ...apters controllers attached to the I O drawer by SAS X or Y cables The SFF bays of the EXP24S are different from the SFF bays of the POWER7 system units or 12X PCIe I O drawers FC 5802 and FC 5803 The...

Page 39: ...g as low as four active cores and incrementing one core at a time through built in CoD functions to a maximum of 48 active cores with the 4 22 GHz processor or 64 active cores with the 3 8 GHz process...

Page 40: ...replace your current CEC enclosure The current CEC enclosures are returned to IBM in exchange for the financial consideration identified under the applicable feature conversions for each upgrade Clie...

Page 41: ...IMMS to DDR3 memory DIMMS New trim kits upgrading from 9117 MMA 9117 MMB or 9179 MHB to 9179 MHD existing trim kits are only functional for one drawer configurations or for racks holding only I O and...

Page 42: ...xceed the quantity of feature FC 7942 obtained for the system being upgraded Feature FC 7942 must be migrated to the new configuration report in a quantity that equals feature FC 8018 Additional FC 79...

Page 43: ...support more than 254 partitions in total the HMC might require a memory upgrade to 4 GB 1 11 2 IBM SDMC IBM withdrew the SDMC product Customers should migrate to the HMC platform by upgrading their...

Page 44: ...IBM Power systems The features of the T00 rack are as follows It has 36U EIA units of usable space It has optional removable side panels It has an optional highly perforated front door It has optiona...

Page 45: ...ting space that accommodate FC 7188 PDUs All PDUs required for application in these racks must be installed horizontally in the rear of the rack Each horizontally mounted PDU occupies 1U of space in t...

Page 46: ...included features might differ The FC 0555 is supported but it is no longer orderable 1 12 6 Feature code 0551 rack The 1 8 meter rack FC 0551 is a 36U EIA units rack The rack that is delivered as FC...

Page 47: ...ublib boulder ibm com infocenter systems scope hw index jsp The Base Side Mount Universal PDU FC 9188 feature the optional and additional Universal PDU FC 7188 feature and the Intelligent PDU options...

Page 48: ...n 29 A three drawer system cannot be installed above position 25 A four drawer system cannot be installed above position 21 The position number refers to the bottom of the lowest drawer When a system...

Page 49: ...two Slim DVD RAM or DVD ROM drives in the right side bay The two bays of the IBM System Storage 7214 Tape and DVD Enclosure can accommodate the following tape or DVD drives for IBM Power servers DAT72...

Page 50: ...only support the USB cable that is provided as part of the feature code Additional USB hubs add on USB cables or USB cable extenders are not supported For each RDX Docking Station feature installed in...

Page 51: ...tions that allow data transfer within similar system archival storage and retrieval technologies installed in existing IT facilities The 7226 offers an expansive list of drive feature options IBM 7226...

Page 52: ...R6 and POWER7 systems and also IBM BladeCenter models PS700 PS701 PS702 PS703 and PS704 that offer current level AIX IBM i and LINUX operating systems The IBM i operating system does not support 7226...

Page 53: ...This architecture offers a maximum system configuration of 64 or 128 cores depending on the processor option chosen This chapter provides an overview of the system architecture and its major componen...

Page 54: ...I e Slot PCI e Slot PCI e Slot PCI e Slot Passthru Card Drawers 3 4 Passthru A Conn I O Backplane GX Buses 4 socket CPU Card Mid Plane PSI 8 SN DIMMs WXZ Buses P7IOC A GX Slot 2 HMC 2 SPCN D2D Conns F...

Page 55: ...d systems is one of system wide balance in which the POWER7 processor plays an important role In many cases IBM is innovative to achieve required levels of throughput and bandwidth Areas of innovation...

Page 56: ...gy using copper interconnect and implements an on chip L3 cache using eDRAM The POWER7 processor chip is 567 mm2 and is built by using 2 1 billion components transistors Up to eight processor cores ar...

Page 57: ...cessor has a set of 12 execution units Two fixed point units Two load store units Four double precision floating point units One vector unit One branch unit One condition register unit One decimal flo...

Page 58: ...users to select the threading technology that meets an aggregation of objectives such as performance throughput energy use and workload enablement Intelligent Threads The POWER7 processor features Int...

Page 59: ...cache is critical to a balanced design as is the ability to provide good signaling between the L3 cache and other elements of the hierarchy such as the L2 cache or SMP interconnect The on chip L3 cac...

Page 60: ...ce requirements conserves energy and lowers latency Small physical footprint The performance of eDRAM when implemented on chip is similar to conventional SRAM but requires far less physical space IBM...

Page 61: ...2 Comparison of technology for the POWER7 processor and the prior generation POWER7 POWER7 POWER6 Technology 32 nm 45 nm 65 nm Die size 567 mm2 567 mm2 341 mm2 Maximum cores 8 8 2 Maximum SMT threads...

Page 62: ...rs This way enables a maximum system configuration of 64 cores built from four CEC enclosures The IBM Power 780 shares the same 4 socket processor card The 780 processor cards are populated with 4 cor...

Page 63: ...ed to the data lines in every DRAM module This effect traditionally degrades either the memory access times or memory density Fully buffered DIMMs overcome this effect by implementing an advanced buff...

Page 64: ...7 P3 C26 P3 C25 P3 C24 P3 C23 P3 C22 A B B B M0 D SN DDR3 DIMM 16 M0 C SN DDR3 DIMM 15 M0 B SN DDR3 DIMM 14 M0 A SN DDR3 DIMM 13 Regulator 8 TPMD Card Regulator 7 Regulator 6 Regulator 5 M0 D SN DDR3...

Page 65: ...follows Quad 1 J1A J2A J5A J6A mandatory minimum for each enclosure Quad 2 J3A J4A J7A J8A mandatory minimum for each enclosure Quad 3 J1B J2B J5B J6B Quad 4 J3B J4B J7B J8B Table 2 3 shows the optima...

Page 66: ...ry controller Memory controller J1A J2A J3A J4A J5A J6A J7A J8A J1B J2B J3B J4B J5B J6B J7B J8B Q1 Q1 Q2 Q2 Q1 Q1 Q2 Q2 Q5 Q5 Q8 Q8 Q5 Q5 Q8 Q8 Enclosure 2 CPU 1 CPU 3 CPU 4 CPU 2 Memory controller Me...

Page 67: ...ure 2 CPU 1 CPU 3 CPU 4 CPU 2 Memory controller Memory controller Memory controller Memory controller J1A J2A J3A J4A J5A J6A J7A J8A J1B J2B J3B J4B J5B J6B J7B J8B Q3 Q3 Q4 Q4 Q3 Q3 Q4 Q4 Q8 Q8 Q11...

Page 68: ...Q1 Q1 Q2 Q2 Q1 Q1 Q2 Q2 Q9 Q9 Q16 Q16 Q9 Q9 Q16 Q16 Enclosure 2 CPU 1 CPU 3 CPU 4 CPU 2 Memory controller Memory controller Memory controller Memory controller J1A J2A J3A J4A J5A J6A J7A J8A J1B J2B...

Page 69: ...mory Mirroring AMM is included with all Power 780 systems at no additional charge It can be enabled disabled or re enabled depending on the user s requirements On the Power 770 AMM is optional and mus...

Page 70: ...ition configuration I O states virtual I O information and partition state P3 C28 P3 C29 P3 C27 P3 C26 P3 C25 P3 C24 P3 C23 P3 C22 A B B B M0 D SN DDR3 DIMM 16 M0 C SN DDR3 DIMM 15 M0 B SN DDR3 DIMM 1...

Page 71: ...odate its data Advanced Memory Sharing Pool Memory used to hold the contents of platform dumps With AMM uncorrectable errors in data that are owned by a partition or application are handled by the exi...

Page 72: ...ides a system administrator an interface at the HMC to manage the activation and deactivation of resources A monitor that resides on the server records the usage activity This usage data must be sent...

Page 73: ...signed to partitions or you are billed for any unreturned processor days Billing The contract signed by the client before receiving the enablement code requires the On Off CoD user to report billing d...

Page 74: ...r Trial CoD requires you to complete a form including contact information and VPD from your Power 770 or Power 780 system with inactive CoD resources An exception request will activate all inactive pr...

Page 75: ...s The cables are designed to support hot addition of system enclosure up to the maximum scalability When adding a new drawer existing cables remain in place and new cables are added The only exception...

Page 76: ...n the order of their numbering is extremely important Each cable is numbered as shown in Figure 2 11 Note that the 2 and 3 Drawer cabling has changed in this model Figure 2 11 SMP cables installation...

Page 77: ...Chapter 2 Architecture and technical overview 63 Figure 2 12 Three link 2 Drawer SMP cabling Figure 2 13 Two link 3 Drawer SMP cabling...

Page 78: ...1 and node 2 to node 4 Figure 2 14 FSP flex cables The design of the Power 770 and Power 780 is optimized for use in an IBM 7014 T00 or 7014 T42 rack Both the front cover and the external processor fa...

Page 79: ...gure 2 15 Front view of the rack with SMP cables overlapping the rack rails SMP Cable Drawer 1 BLeft to Drawer 3 ALeft SMP Cable Drawer 2 BLeft to Drawer 3 BLeft SMP Cable Drawer 1 ALeft to Drawer 4 A...

Page 80: ...Overview and Introduction In the rear of the rack the FSP cables require only some room in the left side of the racks as Figure 2 16 shows Figure 2 16 Rear view of rack with detail of FSP flex cables...

Page 81: ...ce processor SP communication between the system drawers A SP card FC EU09 is installed in system drawer 1 and system drawer 2 The FSP Clock Pass Through card FC 5665 CCIN 2BBC is installed in system...

Page 82: ...eat sink height Cassettes can be installed and removed without removing the CEC enclosure from the rack 2 7 2 System ports Each CEC enclosure is equipped with an integrated multifunction card This int...

Page 83: ...irs of wires are called a lane A PCIe link can consist of multiple lanes In such configurations the connection is labelled as x1 x2 x8 x12 x16 or x32 where the number is effectively the number of lane...

Page 84: ...determine whether there are any existing PTF prerequisites to install See the IBM Prerequisite website for information https www 912 ibm com e_dir eServerPreReq nsf 2 8 4 PCIe adapter form factors IB...

Page 85: ...271 5271 4 Port 10 100 1000 Base TX PCI Express adapter 5717 5271 5272 5272 10 Gigabit Ethernet CX4 PCI Express adapter 5732 5732 5273 577D 8 Gigabit PCI Express Dual Port Fibre Channel adapter 5735 5...

Page 86: ...her LAN adapters are supported in the CEC enclosure PCIe slots or in I O enclosures that are attached to the system by using a PCI X or PCIe slot Table 2 13 lists the additional LAN adapters that are...

Page 87: ...hort AIX IBM i Linux 5769 5769 10 Gigabit Ethernet SR PCI Express adapter PCIe Full height Short AIX Linux 5772 576E 10 Gigabit Ethernet LR PCI Express adapter PCIe Full height Short AIX IBM i Linux 5...

Page 88: ...2 16 Available iSCSI adapters Feature code CCIN Adapter description Slot Size OS support 2055 57CD PCIe RAID and SSD SAS Adapter 3 Gb with Blind Swap Cassette PCIe Short AIX IBM i Linux 5805 574E PCIe...

Page 89: ...e CCIN Adapter description Slot Size OS support 5729 a b a A Gen2 PCIe slot is required to provide the bandwidth for all four ports to operate at full speed PCIe2 8 Gb 4 port Fibre Channel Adapter PCI...

Page 90: ...ture IBA is an industry standard architecture for server I O and inter server communication It was developed by the InfiniBand Trade Association IBTA to provide the levels of reliability availability...

Page 91: ...Power Systems Servers SG24 7767 IBM offers the GX 12X DDR Adapter that plugs into the system backplane GX slot There are two GX slots in each CEC enclosure By attaching a 12X to 4X converter cable FC...

Page 92: ...I with its point to point high frequency connections SAS physical links are a set of four wires used as two differential signal pairs One differential signal transmits in one direction The other diffe...

Page 93: ...th see all six drives The dual split 3 3 and triple split 2 2 2 configurations are not used with the paired controllers RAID 0 and RAID 10 are supported and you can also mirror two sets of controller...

Page 94: ...ust be HDDs IBM i supports configurations that use one set of six bays but does not support logically splitting the backplane into split dual or triple Thus the Dual IOA Enablement card FC 5662 is req...

Page 95: ...SAS adapter FC 5901 CCIN 57B3 Internal SAS port FC 1815 SAS cable for three way split backplane AI cable FC 3679 Adapter to internal drive 1 meter IBM i does not support this combination An I O adapt...

Page 96: ...drives SSDs are supported with a dual split backplane configuration mixing SSDs and hard disk drives HDDs in the same split domain is not supported Also mirroring SSDs with HDDs is not possible or vic...

Page 97: ...g SSDs with HDDs is not possible 2 9 3 Dual storage I O Adapter IOA configurations The dual storage IOA FC 1819 configurations are available with either internal or external disk drives from another I...

Page 98: ...ned within the backplane RAID 0 10 5 and 6 support up to six drives SSDs and HDDs can be used but can never be mixed in the same disk enclosure To connect to the external storage you need to connect t...

Page 99: ...in wide and takes up half the width of the 4U EIA units rack space The 4U enclosure can hold up to two PCI DDR 12X Expansion Drawer drawers mounted side by side in the enclosure The drawer is 800 mm 3...

Page 100: ...on the same 12X loop The 12X I O drawer FC 5877 is the same as this drawer FC 5802 except that it does not support any disk bays Drawer FC 5877 can be on the same loop as drawer FC 5802 Drawer FC 5877...

Page 101: ...ividing SFF drive bays in 12X I O drawer PCIe Disk drive bays in the 12X I O drawer PCIe can be configured as one two or four sets This way allows for partitioning of disk bays Disk bay partitioning c...

Page 102: ...e code for mode switch setting The SAS ports as associated with the mode selector switch map to the disk bays have the mappings shown in Table 2 24 Table 2 24 SAS connection mappings Tools and CSP The...

Page 103: ...m The drawer SAS disk drive enclosure can hold up 18 disk drives The disks in this enclosure can be organized in several configurations depending on the operating system used the type of SAS adapter c...

Page 104: ...irst 12X I O drawer that is attached in any I O drawer loop requires two data transfer cables Each additional drawer up to the maximum allowed in the loop requires one additional data transfer cable N...

Page 105: ...that contains the short range adapter can be mixed in a single loop with I O drawers that contain the long range adapter In Table 2 26 a value of Yes indicates that the 12X cable identified in that co...

Page 106: ...ing loop connect SPCN 1 T2 of the topmost first CEC enclosure to the SPCN 0 T1 of the next second CEC 5 Ensure that a complete loop exists from the topmost CEC enclosure through all attached expansion...

Page 107: ...ch physically provide 3 1 GB write cache Working as a pair they provide mirrored write cache data and controller redundancy The cache contents are designed to be protected by built in flash memory in...

Page 108: ...sets With proper software if one of the controller fails the other controller can run both sets of bays GX 2 port PCIe2 X8 Adapter The GX 2 Port PCIe Adapter FC 1914 enables the attachment of the EXP3...

Page 109: ...cable PCIe Gen2 8X cable FC EDR1 FC 1914 T2 8X 8X T3 PSU P1 T2 T1 T2 ERM C1 T1 ERM C2 PSU P2 FC EDR1 PSU P1 T2 T1 T2 T3 T3 FC 1914 T2 8X 8X T1 FC 1914 T2 8X 8X T1 PCIe Gen2 8X cable Power 770 or Powe...

Page 110: ...or PCIe adapter or pair of adapters The drawer can either be attached using the backplane providing an external SAS port or using one of the following adapters PCIe 380 MB Cache Dual x4 3 Gb SAS RAID...

Page 111: ...ontroller or a single pair of controllers There is a maximum of up to 110 EXP12S Expansion Drawer on SAS PCI controllers The FC 5886 drawer can be directly attached to the SAS port on the rear of the...

Page 112: ...2 Carrier for IBM i FC 1738 An expansion option is available that uses the paired embedded controller configuration with the 175 MB Cache RAID Dual IOA Enablement Card FC 5662 CCIN 2B2 and the SAS exp...

Page 113: ...wo or four SAS controllers and provide much configuration flexibility An EXP24S in mode 2 has similar flexibility Up to 24 HDDs can be supported with any of the supported SAS adapters or controllers I...

Page 114: ...otalStorage EXP24 disk towers FC 5787 2 11 5 IBM TotalStorage EXP24 The IBM 7031 TotalStorage EXP24 Ultra320 SCSI Expandable Storage Disk Enclosure supports up to 24 Ultra320 SCSI Disk Drives arranged...

Page 115: ...ndex html IBM Storwize V7000 and Storwize V7000 Unified Disk Systems IBM Storwize V7000 and Storwize V7000 Unified are virtualized storage systems that consolidate workloads into a single storage syst...

Page 116: ...owing website http www ibm com systems storage disk ds8000 index html 2 12 Hardware Management Console HMC The HMC is a dedicated workstation that provides a graphical user interface GUI for configuri...

Page 117: ...s The HMC user interface also provides powerful table functionality with filtering sorting and customization of views on a per user basis Most HMC management features are also accessible from the IBM...

Page 118: ...e management of the physical servers under the control of the HMC System password Status bar Power on off Capacity on demand Error management System indicators Error and event collection reporting Dum...

Page 119: ...stem or a partition to remotely perform many HMC operations 2 12 3 HMC code If attaching an HMC to a new server or adding function to an existing server that requires a firmware update the HMC machine...

Page 120: ...vide such connectivity The rack mounted 7042 CR5 HMC default configuration provides four Ethernet ports The deskside 7042 C07 HMC standard configuration offers only one Ethernet port Be sure to order...

Page 121: ...hed to two independent HMCs to address availability requirements Both HMCs must have the same level of Hardware Management Console Licensed Machine Code Version 7 and installed fixes to manage POWER7...

Page 122: ...st be on a separate virtual local area network VLAN to protect from any network contention Each HMC can be a DHCP server for its VLAN Redundant service processor connectivity For the Power 770 and Pow...

Page 123: ...stem One HMC should connect to the port labeled HMC Port 1 on the first two CEC drawers of each system A second HMC must be attached to HMC Port 2 on the first two CEC drawers of each system This solu...

Page 124: ...t 2 HUB 0 Configuration 1 Single drawer and one HMC No te HUB is o ptio na l Cu sto me r can h ave a dir ec t co nn ec tion t o th e FSP ca rd HMC 1 Ene t Drawer 1 FSP Card Ene t 1 Ene t 2 HUB 0 Conf...

Page 125: ...as virtualized I O devices PowerVM Live Partition Mobility or PowerVM Active Memory Sharing For details about the software available on IBM Power Systems visit the IBM Power Systems Software website...

Page 126: ...tware ibm com webapp set2 sas f genunix suma html IBM AIX Version 5 3 The following minimum level of AIX Version 5 3 supports the Power 770 and Power 780 AIX Version 5 3 with the 5300 12 Technology Le...

Page 127: ...sit the IBM Prerequisite website for compatibility information for hardware features and the corresponding AIX and IBM i Technology Levels http www 912 ibm com e_dir eserverprereq nsf 2 13 4 Linux ope...

Page 128: ...compiler optimization experience is seen in the continuous release to release compiler improvements that support the POWER4 processors through to POWER4 POWER5 POWER5 POWER6 and POWER7 processors and...

Page 129: ...velopment tools The IBM Rational Power Appliance solution provides a workload optimized system and integrated development environment for AIX development on IBM Power Systems IBM Rational Power Applia...

Page 130: ...ing instructions Dynamic power saver mode Dynamic power saver mode varies processor frequency and voltage based on the utilization of the POWER7 or POWER7 processors Processor frequency and utilizatio...

Page 131: ...flushed transition lookaside buffers TLB are invalidated and the hardware clock is turned off in the core and in the caches Voltage is reduced to minimize leakage current Processor cores inactive in t...

Page 132: ...n in shared processing mode have a common power savings setting which is that of the system processor pool The reason is because processing unit fractions cannot be power managed As in the case of sys...

Page 133: ...purpose is to manage system energy The TPMD card monitors the processor modules memory environmental temperature and fan speed Based on this information it can act upon the system to maintain optimal...

Page 134: ...120 IBM Power 770 and 780 9117 MMD 9179 MHD Technical Overview and Introduction...

Page 135: ...ake better use of IT assets Improve business responsiveness and operational speed by dynamically re allocating resources to applications as needed to better match changing business needs or handle une...

Page 136: ...rforms a reset or reload if it detects the loss of the Service Processor notifying the operating system if the problem is not corrected The POWER Hypervisor is always active regardless of the system c...

Page 137: ...for PowerVM on page 153 The virtual Ethernet is part of the base system configuration Virtual Ethernet has the following major features The virtual Ethernet adapters can be used for both IPv4 and IPv...

Page 138: ...stem console Tasks such as operating system installation network setup and various problem analysis activities require a dedicated system console The POWER Hypervisor provides the virtual console by u...

Page 139: ...de is compatible with Version 2 05 of the Power Instruction Set Architecture ISA For more information visit the following address http power org wp content uploads 2012 07 PowerISA_V2 05 pdf POWER6 co...

Page 140: ...chnical Overview and Introduction The selection of the mode is made on a per partition basis from the managed console by editing the partition profile Figure 3 2 Figure 3 2 Configuring partition profi...

Page 141: ...chnology Level 4 with SP2 or later Linux will support Active Memory Expansion on the next major versions Active Memory Expansion uses CPU resource of a partition to compress decompress the memory cont...

Page 142: ...al program load IPL is required for the specific partition that is turning memory expansion on or off After turned on monitoring capabilities are available in standard AIX performance tools such as lp...

Page 143: ...3 4 Output from Active Memory Expansion planning tool Active Memory Expansion Modeled Statistics Modeled Expanded Memory Size 52 00 GB Achievable Compression ratio 4 51 Expansion Modeled True Modeled...

Page 144: ...ware key is provided when the enablement feature is ordered that is applied to the server Rebooting is not required to enable the physical server The key is specific to an individual server and is per...

Page 145: ...R Hypervisor Virtual I O Server Live Partition Mobility Workload Partitions and more As with Advanced Power Virtualization in the past PowerVM is a combination of hardware enablement and value added s...

Page 146: ...d a new level of configuration possibilities This section provides details and configuration specifications about this topic Logical partitioning Logical partitioning was introduced with the POWER4 pr...

Page 147: ...ndow Shared processor partitions use the default shared processor pool called DefaultPool by default See 3 4 3 Multiple shared processor pools on page 135 for details about multiple shared processor p...

Page 148: ...CPU entitlement that determines how much processing power any given partition should receive The total sum of CPU entitlement of all partitions cannot exceed the number of available physical processo...

Page 149: ...ization without compromising the computing power for critical workloads in a dedicated processor Shared mode In shared mode logical partitions use virtual processors to access fractions of physical pr...

Page 150: ...cessor pool do not use their capacity entitlement the unused capacity is ceded and other uncapped micropartitions within the same shared processor pool are allocated the additional capacity according...

Page 151: ...e and can accept micropartitions either transferred from SPP0 or newly created Levels of processor capacity resolution The following two levels of processor capacity resolution are implemented by the...

Page 152: ...it require additional processor capacity above the entitled pool capacity then the POWER Hypervisor redistributes some of the extra capacity to the uncapped micropartitions This level of processor cap...

Page 153: ...raphical interface or the command line interface CLI Dynamic adjustment of reserved pool capacity The reserved pool capacity of a shared processor pool other than the default shared processor pool0 ca...

Page 154: ...Server eliminates the requirement that every partition owns a dedicated network adapter disk adapter and disk drive The Virtual I O Server supports OpenSSH for secure remote logins It also provides a...

Page 155: ...tems on the physical network IEEE 802 1 VLAN tagging is supported The Shared Ethernet Adapter also provides the ability for several client partitions to share one physical adapter With an SEA you can...

Page 156: ...n broadcast or multicast such as Address Resolution Protocol ARP Dynamic Host Configuration Protocol DHCP Boot Protocol BOOTP and Neighbor Discovery Protocol NDP can work on an SEA IP address A Shared...

Page 157: ...ces is provided by the Virtual I O Server Physical disks presented to the Virtual O Server can be exported and assigned to a client partition in a number of ways The entire disk is presented to the cl...

Page 158: ...SPT and Workload Estimator which are designed to ease the deployment of a virtualized infrastructure For more information about the System Planning Tool see 3 5 System Planning Tool on page 156 IBM S...

Page 159: ...tion system requirements The source partition must be one that has only virtual devices If there are any physical devices in its allocation they must be removed before the validation or migration is i...

Page 160: ...reserve_policy no_reserve In addition all logical partitions must be on the same open network with RMC established to the managed console The managed console is used to configure validate and orchestr...

Page 161: ...s physical memory for the shared memory pool assigns partitions to the pool and provides access limits to the pool Active Memory Sharing can be used to increase memory utilization on the system either...

Page 162: ...partition memory pages to a single physical memory page within a shared memory pool This way enables a better utilization of the Active Memory Sharing shared memory pool increasing the system s overa...

Page 163: ...as frequently referenced read only code pages are particularly good for deduplication To perform deduplication the hypervisor cannot compare every memory page in the Active Memory Sharing pool with e...

Page 164: ...ynamically configure the size of the deduplication table ranging from 1 8192 to 1 256 of the configured maximum Active Memory Sharing memory pool size Having this table be too small might lead to miss...

Page 165: ...B33 is an IBM PowerVM feature that helps the user to configure the logical partition memory and CPU affinity on the POWER7 processor based servers thus improve performance under some workload scenario...

Page 166: ...o interacts with POWER7 Performance Monitoring Unit PMU to discover the best affinity and page size for the machine workload N_Port ID Virtualization NPIV NPIV is a technology that allows multiple log...

Page 167: ...Yes DLPAR I O adapter add remove Yes Yes Yes Yes Yes Yes Yes Yes Yes DLPAR processor add remove Yes Yes Yes Yes Yes Yes Yes Yes Yes DLPAR memory add Yes Yes Yes Yes Yes Yes Yes Yes Yes DLPAR memory r...

Page 168: ...2 with PTF SI39077 or later d Requires IBM i 7 1 TR1 e Will become fully provisioned device when used by IBM i f Requires AIX 6 1 TL7 or later g Requires AIX 7 1 TL1 or later h Requires IBM i 7 1 4 or...

Page 169: ...RHEL5 release_notes at 05 2 1 0 html VSX support No Yes No Yes Full exploitation requires Advance Toolchain Distro toolchain mcpu mtune p7 No Yes No Yes SLES11 GA toolchain has minimal P7 enablement...

Page 170: ...tem Planning Tool and both the Workload Estimator WLE and IBM Performance Management PM allows you to create a system that is based on performance and capacity data from an existing system or that is...

Page 171: ...not support mapping these as virtual optical devices to clients However you can import the disk in to the virtual optical media library and map the created file to the client as a virtual DVD drive Th...

Page 172: ...158 IBM Power 770 and 780 9117 MMD 9179 MHD Technical Overview and Introduction...

Page 173: ...generation of IBM servers is designed to be more reliable than the previous server family POWER7 and POWER7 processor based servers have features to support new levels of virtualization help ease admi...

Page 174: ...rvice processors Design and manufacturing verification and integration and also field support information is used as feedback for continued improvement on the final products This chapter also includes...

Page 175: ...ocessor design Not only does this case reduce the total number of system components it reduces the total amount of heat generated in the design resulting in an additional reduction in required power a...

Page 176: ...urrent repair High opportunity components or those that most affect system availability are protected with redundancy and the ability to be repaired concurrently The use of redundant parts allows the...

Page 177: ...on has the lowest priority and attempts to claim the needed resource On a properly configured POWER processor based server this approach allows that capacity to first be obtained from a low priority p...

Page 178: ...cting system operation again The repair action is deferred to a more convenient less critical time Persistent deallocation functions include the following items Processor L2 L3 cache lines cache lines...

Page 179: ...obability of any one processor affecting total system availability by containing most processor checkstops to the partition that was using the processor at the time that the full checkstop goes into e...

Page 180: ...ill is an enhancement that enables a system to sustain the failure of an entire DRAM chip Chipkill spreads the bit lines from a DRAM over multiple ECC words so that a catastrophic DRAM failure does no...

Page 181: ...R Hypervisor notifies the owning partition that the page should be deallocated Where possible the operating system moves any data that is currently contained in that memory area to another memory area...

Page 182: ...e marked as deallocated and working resources are included in the active memory space Because these activities reduce the amount of CoD memory available for future use schedule repair of the faulty me...

Page 183: ...rored Desired memory configured for individual partitions is not mirrored To enable mirroring the requirement is to have eight equally sized functional memory DIMMs behind at least one POWER7 or POWER...

Page 184: ...change from mirroring mode to non mirrored mode This same frame also gives information about the mirroring status Desired mirroring mode The values are either Off or System firmware only System firmw...

Page 185: ...t impact on performance while in progress The operation can be stopped by selecting Cancel A time limit can also be specified DIMM guard at system boot During system boot the FSP will guard a failing...

Page 186: ...deallocate all but one set before doing a Processor Instruction Retry In addition faults in the Segment Lookaside Buffer SLB array are recoverable by the POWER Hypervisor The SLB is used in the core...

Page 187: ...em that the standard ECC is no longer valid The service processor is then notified and takes appropriate actions When running AIX V5 2 or later or Linux and a process attempts to use the data the oper...

Page 188: ...a system reboot to continue PCI enhanced error handling enabled adapters respond to a special data packet that is generated from the affected PCI slot hardware by calling system firmware which examine...

Page 189: ...setup CSU customer installed features CIF and customer replaceable units CRU On demand service education Error detection and fault isolation ED FI First failure data capture FFDC An automated guided r...

Page 190: ...em fan speed is out of operational specification for example because of multiple fan failures The server input voltages are out of operational specification The service processor can immediately shut...

Page 191: ...the information is passed from the NVRAM to the system error log where it is analyzed by error log analysis ELA routines Appropriate actions are taken to report the boot time error for subsequent serv...

Page 192: ...so that for every check station the unique error domain for that checker is defined and documented Ultimately the error domain becomes the field replaceable unit FRU call and manual interpretation of...

Page 193: ...xceeded a pre determined threshold or was unrecoverable Based on the isolation analysis recoverable error threshold counts can be incremented No specific service action is necessary when the event is...

Page 194: ...tem was powered off or on the boot time selection menu Run time All Power Systems servers can monitor critical system components during run time and they can take corrective actions when recoverable f...

Page 195: ...nt failure data with service parts information and part locations is sent to the IBM service organization This information will also contain the client contact information as defined in the Electronic...

Page 196: ...ice processor It then looks at all active service event requests analyzes the failure to ascertain the root cause and if enabled initiates a call home for service This methodology ensures that all pla...

Page 197: ...ese events can always be reported back to IBM at the client s discretion Call home A correctly configured POWER processor based system can initiate an automatic or manual call from a client location t...

Page 198: ...anisms such as latches levers thumb screws pop Nylatches U clips and cables are included to help prevent loose connections and aid in installing seating parts correctly These positive retention items...

Page 199: ...and serviceability direction of components Various serviceable parts such as latches levers and touch points must be pulled or pushed in a certain direction and order so that the mechanical mechanism...

Page 200: ...must comply with the following protective measures For memory upgrade and node repair ensure that the system has sufficient inactive or spare processors and memory Critical I O resources must be conf...

Page 201: ...is stand alone or managed by a management console the current firmware installed and what operating systems are running on the system These scenarios and the associated installation instructions are c...

Page 202: ...on the state of the system and its operating environment The primary service interfaces are the following items Light Path and Guiding Light For more information see Light Path on page 184 and Guidin...

Page 203: ...6 Service processor Eth1 or HMC2 port is configured as 169 254 3 146 The following functions are available through service processor Call home Advanced System Management Interface ASMI Error Informati...

Page 204: ...r versions of these browsers might work but are not officially supported The JavaScript language and cookies must be enabled The web interface is available during all phases of system operation includ...

Page 205: ...panel features include the following items A 2 x 16 character LCD display Reset enter power On Off increment and decrement buttons Amber System Information Attention green Power LED Blue Enclosure Ide...

Page 206: ...to stop all activity on the operating system and put the operating system into maintenance mode The System Management Services SMS error log is accessible on the SMS menus This error log contains err...

Page 207: ...report the same error By using the Manage Serviceable Events task in the management console you can avoid long lists of repetitive call home information by recognizing that these are repeated errors a...

Page 208: ...ility see the Support for IBM Systems web page http www ibm com systems support For Power Systems select the Power link Figure 4 11 Figure 4 11 Support for Power servers web page Although the content...

Page 209: ...talled level It is installed on the permanent side of system firmware IBM provides the Concurrent Firmware Maintenance CFM function on selected Power Systems This function supports applying nondisrupt...

Page 210: ...ome new firmware functions requires installation of a firmware release level This process is disruptive to server operations and requires a scheduled outage and full server reboot 4 4 3 Electronic Ser...

Page 211: ...elerator RAS New accelerators are designed with RAS features to avoid system outages in the vast majority of faults that can be detected by the accelerators Fabric Bus Dynamic Lane Repair POWER7 has s...

Page 212: ...to concurrently apply an initialization update to a processor core chiplet by loading new initialization values into memory and then forcing it to go in and out of winkle mode This step happens all wi...

Page 213: ...tection X X X X X X X L2 L3 ECC and cache line delete X X X X X X X Special uncorrectable error handling X X X X X X X Active Memory Mirroring X X X X X X X Fault detection and isolation Platform FFDC...

Page 214: ...ng light LEDs X X X X X X X System dump for memory POWER Hypervisor SP X X X X X X X Information center Systems Support Site service publications X X X X X X X System Support Site education X X X X X...

Page 215: ...720 and 740 Technical Overview and Introduction REDP 4797 IBM Power 750 and 755 Technical Overview and Introduction REDP 4638 IBM Power 795 Technical Overview and Introduction REDP 4640 IBM Power Syst...

Page 216: ...ommon ssi ecm en pod03051usen POD03051USEN PDF IBM Power 750 server Data Sheet http public dhe ibm com common ssi ecm en pod03034usen POD03034USEN PDF IBM Power 755 server Data Sheet http public dhe i...

Page 217: ...ntral website http www ibm com support fixcentral Power Systems Capacity on Demand website http www ibm com systems power hardware cod Support for IBM Systems website http www ibm com support entry po...

Page 218: ...204 IBM Power 770 and 780 9117 MMD 9179 MHD Technical Overview and Introduction...

Page 219: ......

Page 220: ...ower 770 and 780 offerings and their prominent functions The IBM POWER7 processor available at frequencies of 3 8 GHz and 4 2 GHz for the Power 770 and 3 7 GHz and 4 4 GHz for the Power 780 The specia...

Search results

Summary of Contents for Power 780

Reviews:

Related manuals for Power 780

Brands by name

Popular brands

IBM Power 780, Technical Overview And Introduction

Search results

Summary of Contents for Power 780

Reviews:

Related manuals for Power 780

Brands by name

Popular brands