background image

IBM XIV Storage System Gen3
Models 281x-11x, 281x-21x, and 281x-314

Planning Guide

SC27-5412-09

IBM

Summary of Contents for XIV Gen3 Series

Page 1: ...IBM XIV Storage System Gen3 Models 281x 11x 281x 21x and 281x 314 Planning Guide SC27 5412 09 IBM...

Page 2: ...nformation in Safety and environmental notices on page xi and Notices on page 93 This edition replaces SC27 5412 08 Copyright IBM Corporation 2008 2018 US Government Users Restricted Rights Use duplic...

Page 3: ...sion rates ratios and savings 5 Prerequisites and limitations 5 Estimating compression savings 7 Effective capacity 7 General compression saving guidelines 8 Estimating compression savings using XIV G...

Page 4: ...urations 54 Fibre Channel network configurations 54 Ethernet iSCSI network configurations 58 Network cable requirements 59 Chapter 8 Planning for management tool requirements 61 Requirements for IBM X...

Page 5: ...tion Technology Industries Association JEITA Notice 96 Japan Voluntary Control Council for Interference VCCI Notice 97 Korea Notice 97 People s Republic of China Notice 97 Russia Notice 97 Taiwan Noti...

Page 6: ...vi IBM XIV Gen3 281x 11x 281x 21x and 281x 314 Planning Guide...

Page 7: ...58 16 Remote support components 66 17 Remote support connectivity by modem 67 18 Call home routing 69 19 Typical performance of a rear door heat exchanger 32 kW heat load 73 20 Typical performance of...

Page 8: ...viii IBM XIV Gen3 281x 11x 281x 21x and 281x 314 Planning Guide...

Page 9: ...voltages and frequencies 38 23 Automatic transfer switches 39 24 Main power cables 39 25 Thermal dissipation 44 26 Airflow requirements 44 27 Temperature thresholds and events for systems running micr...

Page 10: ...x IBM XIV Gen3 281x 11x 281x 21x and 281x 314 Planning Guide...

Page 11: ...erity of potential hazards Danger notice definition A special note that calls attention to a situation that is potentially lethal or extremely hazardous to people Caution notice definition A special n...

Page 12: ...es supplied and address specific issues relevant to the equipment provided Laser safety When using an NVRAM5 or NVRAM6 cluster media converter the storage system must be installed in a restricted acce...

Page 13: ...at 115 volts Use a UL listed and CSA certified cable set consisting of a minimum 18 AWG Type SVT or SJT three conductor cable a maximum of 15 feet in length and a parallel blade grounding type attach...

Page 14: ...ack at the installation site as needed to service the XIV system The customer is responsible for using professional movers or riggers in the case of equipment relocation or disposal Attention Do not t...

Page 15: ...nguages The IBM Systems Environmental Notices http ibm co 1fBgWFI information includes statements on limitations product information product recycling and disposal battery information flat panel displ...

Page 16: ...xvi IBM XIV Gen3 281x 11x 281x 21x and 281x 314 Planning Guide...

Page 17: ...pport for severe system conditions on page 67 The following list describes updated made to the planning information for the IBM XIV Storage System as of July 11 2016 v Added planning for relocation in...

Page 18: ...t technical changes to the IBM XIV Storage System as of November 15 2013 v Added planning information for the new model 281x 214 800 GB solid state drive SSD caching feature see Solid state drive cach...

Page 19: ...vironmental requirements on page 41 v Improved information about network and host connectivity requirements see Chapter 7 Planning for network and host connectivity requirements on page 49 Who should...

Page 20: ...rmation center on the Publications and related information web page http www ibm com support knowledgecenter STJTAG com ibm help xivgen3 doc xiv_pubsrelatedinfoic html v IBM XIV Storage System Product...

Page 21: ...of hardware components IBM XIV Storage System with the Virtual I O Server and IBM i This Redbooks publication describes how you can connect the XIV system to the IBM i operating system through the Vir...

Page 22: ...storage virtualization business continuity infrastructure simplification disk storage systems and storage software products and solutions Getting information help and service If you need help service...

Page 23: ...email to starpubs us ibm com Be sure to include the following information v Exact publication title and version v Publication form number for example GC27 1234 00 v Page table or illustration numbers...

Page 24: ...xxiv IBM XIV Gen3 281x 11x 281x 21x and 281x 314 Planning Guide...

Page 25: ...presentative The final installation site within the computer room must be prepared before the equipment is delivered If the site cannot be prepared before the delivery time customers must make arrange...

Page 26: ...chine type and model Warranty 2810 114 One year warranty 2812 114 Three year warranty 2810 214 One year warranty 2812 214 Three year warranty 2810 314 One year warranty 2812 314 Three year warranty 2...

Page 27: ...45 30 Intel Xeon processors E5645 Maximum number of processor cores 60 physical 120 logical cores as a result of hyper threading 90 physical 180 logical cores as a result of hyper threading 180 physic...

Page 28: ...m altitude 2134 m 7000 ft 2134 m 7000 ft 2134 m 7000 ft Humidity 25 80 non condensing 25 80 non condensing 25 80 non condensing Connectivity Specification Model 281x 114 Model 281x 214 Model 281x 314...

Page 29: ...ider savings it is easiest to use the compression rate The compression ratio helps in understanding how much effective data you can store on your system So when you have a 5 1 compression ratio you wi...

Page 30: ...ze of the uncompressed volume and free soft space It is a good practice to have free soft space at least the size of the uncompressed volume The Storage Admin can modify the system soft capacity Use t...

Page 31: ...ge that is allocated to applications Using thin provisioned storage architectures the effective capacity is virtually larger than the array usable capacity This is made possible by over committing cap...

Page 32: ...PEG PNG MP3 medical imaging DICOM and MPEG2 v Compressed user productivity file formats Microsoft Office 2007 and newer formats pptx docx xlsx etc PDF files Microsoft Windows executable files exe etc...

Page 33: ...e savings of the compressed data and the expected effect on performance throughput and latency of the compression processing overhead Figure 1 displays the compression savings in both percentage and G...

Page 34: ...by the RACE implementation The utility runs on a host that has access to the devices to be analyzed It runs only read operations so it has no effect on the data that is stored on the device The follo...

Page 35: ...Models 281x 114 281x 214 and 281x 314 The following components are supplied with each XIV system v IBM T42 rack v For models 281x 114 and 281x 214 Three to nine data modules each with 12 disk drive mo...

Page 36: ...erface module Partially populated configurations have the same power floor planning hardware software and cabling configurations as fully populated systems In other words partially populated racks are...

Page 37: ...aaaaaa aaaaaa aaaaaa aaaaaa aaaaaa aaaaaa aaaaaa aaaaaa aaaaaa aa aa aa aa aa aa aa aa aa aa aa aa aa aa aa aa aa aa aa aa aa aa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaa aaaaaaa aaaaaaa aaa...

Page 38: ...aaaaaaaaaaaaaaaaaaaaaaaaaa aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa aaaaaaaaaaaaa...

Page 39: ...aaaaaaaaaaaaaaaa aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa aaaaaaaaaaaaaaaaaaaaaaa...

Page 40: ...tem is fully redundant even with the failures Replacement for failed DDMs is deferred until the third DDM fails or until another component requires immediate onsite maintenance For administrators if a...

Page 41: ...s the number of Fibre Channel and iSCSI ports and identifies the interface modules from which Fibre Channel and iSCSI ports are available for each module configuration For XIV systems with 1 Gb Ethern...

Page 42: ...modules are ordered as CoD and not yet activated this means that initially the customer is only licensed to use 12 15 of the system usable capacity By activating the three CoD modules the customer wi...

Page 43: ...s with 10 GbE cards 2135 3 TB CoD interface module with 1 GbE cards 1147 2037 3 TB CoD interface module with 10 GbE cards 2137 3 TB module CoD activation with 1 GbE cards 1150 2039 3 TB module CoD act...

Page 44: ...ture includes a 400 480 or 800 GB SSD in each data and interface module for up to 12 0 TB of management free SSD caching The following table lists the feature available for each XIV model Note Model 2...

Page 45: ...es on the front and rear of the rack which prevents the rack from twisting The earthquake resistance option brings the XIV system into compliance with earthquake resistance objectives that are documen...

Page 46: ...cools the air that is heated and exhausted by devices inside the rack A supply hose delivers chilled conditioned water to the heat exchanger A return hose delivers warmed water back to the water pump...

Page 47: ...heat exchanger Rear door heat exchanger 0082 0082 0082 See Chapter 10 Planning for the rear door heat exchanger on page 71 for information about requirements for preparing the installation site befor...

Page 48: ...weight to approximately 1018 kg 2239 5 lb If your site does not meet the delivery clearances that are shown in Chapter 5 Planning for delivery and relocation requirements on page 25 the weight and hei...

Page 49: ...ortant If these steps are not taken the XIV system will not be able to restart Planning to receive delivery The professional movers or riggers are responsible for delivering and unloading the IBM XIV...

Page 50: ...models 281x 114 281x 214 and 281x 314 at least one shipping container is delivered for each XIV system that you order The container is a wooden pallet that is covered by a corrugated fiberboard cardb...

Page 51: ...ess than 15 modules subtract the 28 6 kg 63 lb for each module less than 15 to get the approximate weight requirement for your rack For model 281x 314 racks with less than 15 modules subtract the 29 7...

Page 52: ...28 IBM XIV Gen3 281x 11x 281x 21x and 281x 314 Planning Guide...

Page 53: ...ts You must ensure that the location of the XIV system meets space and floor requirements Procedure Complete the following steps to ensure that the planned installation location meets space and floor...

Page 54: ...d panels while equipment is being moved into or is relocated within the installation site When the equipment is moved the dynamic load on the casters is greater than when the equipment is stationary v...

Page 55: ...weight to the rack For information about the weight of an empty and filled door see Rear door heat exchanger feature on page 22 To ensure that all requirements are met obtain the service of a qualifi...

Page 56: ...ed on raised floor with 60 cm 60 cm 24 in 24 in tiles 1 Based on your planned layout ensure that the installation site can accommodate the locations of the cables exiting each XIV system 2 Plan for th...

Page 57: ...s customer Fibre Channel host cables network Ethernet cable and customer analog phone line Using overhead cabling provides many of the cooling and safety benefits that are provided by raised flooring...

Page 58: ...edures before the ruggedized rack installation depending upon whether the XIV system sets on a raised or a non raised floor For either type of installation work with a consultant or structural enginee...

Page 59: ...mounting plates to the concrete floor Each anchor must withstand 2268 kg 5000 lb of pull force 2 Purchase eight concrete anchors Preparing for the rear door heat exchanger If the optional rear door h...

Page 60: ...ncy shutdown All modified data is then saved to disks and the XIV system turns off within 5 minutes Customer responsibilities v You must supply enough branch circuits to prevent overloading from the e...

Page 61: ...on EMEA feature code 9894 is installed and both power feeds into the XIV system have voltages within the operational tolerance the power load is shared across both power feeds If a power feed fails th...

Page 62: ...240 V ac Maximum input current 30 A or 60 A Minimum input voltage 180 V ac Maximum input voltage 264 V ac Maximum ground leakage current 0 3 A Steady state input frequencies 50 3 Hz or 60 3 Hz Power l...

Page 63: ...he feature codes and description details for each main power cable Note The main power cables are provided with the connector part numbers listed in the following table Receptacle part numbers in the...

Page 64: ...250 V 30 A rated Single phase main power cables have two poles and three wires Three phase main power cables have three poles and four wires or four poles and five wires Plugs and receptacles for fea...

Page 65: ...ing electrical fire prevention safety and other laws or regulations might address or control the manner in which information technology equipment is installed within certain facilities and environment...

Page 66: ...ff v Temperature 5 45 C 41 113 F v Relative humidity 20 80 non condensing v Maximum wet bulb temperature 27 C 80 6 F Shipping v Temperature 40 60 C 40 140 F v Relative humidity 5 95 non condensing v M...

Page 67: ...tiles in front of the racks and one or two fully perforated tiles at the back of each two racks c For groupings of racks where a hot aisle and cold aisle layout is used use a cold aisle row of perfora...

Page 68: ...ments Number of modules Cubic feet per minute CFM 1 TB limited capacity or 2 TB 3 TB 4 TB or 6 TB 6 300 310 9 440 450 10 480 500 11 520 550 12 560 600 13 600 650 14 640 700 15 690 750 Temperature thre...

Page 69: ...SYSTEM_TEMPERATURE_IS_TOO_HIGH Actions to cool down the system must be taken 45 C 113 F SYSTEM_TEMPERATURE_IS_CRITICALLY_HIGH Manually shutdown the system by using the shutdown command Contamination i...

Page 70: ...contamination must be more than 60 RH 4 Data centers must be free of zinc whiskers 5 Acoustic declaration This information lists the acoustic sound power levels for the XIV system CAUTION Depending u...

Page 71: ...h such government regulations also depends upon a variety of additional factors including the duration of employee exposure and whether employees wear hearing protection IBM recommends that you consul...

Page 72: ...tional shock levels continued Class Axis g1 pw2 Notes v g is the peak g level of an approximate half sine pulse v pw is the pulse width in milliseconds 48 IBM XIV Gen3 281x 11x 281x 21x and 281x 314 P...

Page 73: ...be required by law prior to making any such connection Contact an IBM representative or reseller for any questions Host connections patch panel Host systems are connected to the XIV system through a...

Page 74: ...iSCSI ports Interface modules 5 9 have four Fibre Channel ports and four Ethernet iSCSI ports each For XIV systems with 10 Gb Ethernet ports all interface modules have four Fibre Channel ports and tw...

Page 75: ...ribes the ports that are available in the patch panel and the component to which each patch panel port connects A diagram of the utility patch panel is also shown in the Patch panel column Chapter 7 N...

Page 76: ...ports to connect the XIV system directly to a notebook computer on which the GUI and XCLI are installed The IBM service representative uses these ports to initial configure and service the XIV system...

Page 77: ...st provide the following information to the IBM service representative before the installation is started v IP address of the port v Net mask v Default IP gateway v Maximum transmission unit MTU Note...

Page 78: ...done by installing the relevant host attachment kit Review the balancing periodically and when traffic patterns change v Always employ multipathing for data connections If multipathing is not used a h...

Page 79: ...m application and overall performance requirements In an XIV system each interface module has four Fibre Channel ports For supported interoperability configurations see the System Storage Interoperati...

Page 80: ...v Each Fibre Channel switch has a connection to a separate Fibre Channel port on each of the six interface modules v Each volume can be accessed through 12 paths Twelve paths is the maximum number of...

Page 81: ...Each host is equipped with dual HBAs Each HBA or HBA port is connected to one of two Fibre Channel switches v Each Fibre Channel switch has a connection to three separate interface modules v Each volu...

Page 82: ...t gateway v Maximum transmission unit MTU Notes 1 If two or more iSCSI connections exist in your iSCSI network iSCSI ports for mirroring must be defined on switches with Flow Control Send On 2 MTU con...

Page 83: ...ation options for Fibre Channel networks For the best performance use a dedicated iSCSI network infrastructure Single switch configuration In this configuration a single Gigabit Ethernet switch interc...

Page 84: ...LC LC or LC SC connectors Management Straight copper gigabit CAT5e rated Ethernet cables with RJ 45 connectors Virtual private network VPN Straight copper CAT5e rated Ethernet cables with RJ 45 conne...

Page 85: ...t tools Table 36 Operating system and processor requirements Operating system Processor XCLI only IBM AIX 5 3 6 1 or 7 1 IBM PowerPC XCLI only HP UX 11i v3 Intel Itanium 64 bit MAC OS X 10 6 or 10 7 w...

Page 86: ...nager Max of 50ms Supported OS for XIVGUI XCLI XIVTOP Windows v Windows Server 2003 32 bit v Windows Server 2003 64 bit v Windows Server 2008 32 bit v Windows Server 2008 64 bit v Windows Server 2012...

Page 87: ...AIX 7 Oracle Solaris 11 SPARC Solaris 11 INTEL HPUX HPUX 11i v3 IA64 Chapter 8 Management tool requirements 63...

Page 88: ...64 IBM XIV Gen3 281x 11x 281x 21x and 281x 314 Planning Guide...

Page 89: ...ted network connection is the preferred method for obtaining remote support When using this method the XIV system is connected to the XIV Remote Support Center through one of the virtual private netwo...

Page 90: ...ternet for example due to a firewall you can use the XIV Remote Support Proxy to facilitate the connection to IBM For more information see the IBM XIV Storage System Remote Support Proxy Installation...

Page 91: ...Center Remote access by modem To use the modem for remote access you must connect a dedicated analog telephone line to the modem and give the telephone number to IBM The telephone line must support d...

Page 92: ...ifications to the IBM Troubleshooting Ticketing System in the IBM Service Center You can also configure the XIV system to automatically send alerts directly to you Call home cannot accept incoming com...

Page 93: ...lhome western hemisphere vnet ibm com Customer SMTP server must allow relaying to the following IBM email addresses based on geographical location v East EMEA Asia Australia Africa and the rest of the...

Page 94: ...70 IBM XIV Gen3 281x 11x 281x 21x and 281x 314 Planning Guide...

Page 95: ...install the rear door heat exchanger on any of your XIV systems Rear door heat exchanger operating specifications Rear door heat exchanger operating specifications provide detailed information for yo...

Page 96: ...heat exchanger Air impedance v Air pressure drop across the heat exchanger is equivalent to that of the IBM acoustic rear door Water source v User supplied compliant with specifications in this docum...

Page 97: ...warmer water a lower flow rate or both 80 75 70 65 60 55 50 Heat removal percentage Water flow rate gpm 6 7 8 9 10 Water temperature 12 C o 14 C o 16 C o 18 C o 20 C o xiv10117 Figure 19 Typical perfo...

Page 98: ...ger must meet the following requirements otherwise system failures might occur over time as a result of v Leaks that are caused by corrosion and pitting of the metal components of the heat exchanger o...

Page 99: ...emperature of the water inside the supply hose return hose and the heat exchanger must be kept above the dew point of the location where the heat exchanger is being used Attention Typical primary chil...

Page 100: ...delivery system for the secondary cooling loop provides chilled water to the rear door heat exchanger The delivery system includes pipes hoses and the required connection hardware to connect to the h...

Page 101: ...ng loop and secondary cooling loop Figure 23 on page 80 shows an example of a fabricated facilities solution The actual number of heat exchangers that are connected to a secondary loop depends on the...

Page 102: ...ture to specification Supplier built water chiller unit required features Temperature and flow metering monitoring Leak detection or water level sense and shutdown Local and remote monitoring and cont...

Page 103: ...es Temperature and flow metering monitoring Leak detection or water level sense and shutdown Local and remote monitoring and control Access port for filling and water treatment Return Supply CS CS Shu...

Page 104: ...Loop heat exchanger Supply CS CS Secondary side temperature feedback for controlled water temperature to specification Return Supply CS CS Shutoff valves Circuit setter flow control valves Pressure re...

Page 105: ...h 15 24 meters 50 feet Loop heat exchanger Loop heat exchanger Loop heat exchanger Pressure relief valve based on maximum pressure application Pressure relief valve based on maximum pressure applicati...

Page 106: ...y hoses with a 300 kW CDU Use shutoff valves for each supply line that exits the manifold to enable the flow of water to be stopped in individual legs of multiple circuit loops The shutoff valves prov...

Page 107: ...ble that provide water with acceptable pressure drop characteristics and that help prevent depletion of some corrosion inhibitors These hoses must be made of peroxide cured ethylene propylene diene mo...

Page 108: ...e manifold end of the hoses use similar quick connect couplings However if you want to use other types of connectors make sure that positive locking mechanisms are used to prevent loss of water when t...

Page 109: ...mbly female Raised floor Heat exchanger female coupling Supply hose assembly male xiv10131 Figure 27 Raised floor hose management example 1 hose exit through floor tile at the door hinge 190 5 mm 7 50...

Page 110: ...29 and Figure 30 on page 87 show how to route hoses under the rack with enough hose length to allow the hose to move freely as the door is opened and closed Note Existing tile cutouts for electrical...

Page 111: ...ta centers without a raised floor straight hose assemblies cannot make the sharp bend to exit between the floor and the rack door without kinking the hose Hose assemblies with right angle metal elbows...

Page 112: ...s on the door and to make it easier to open and close the door Hose coverings or protective devices are not provided by IBM Routing and protection of the hose assemblies exterior to the rack are your...

Page 113: ...Datacom Facilities Division 201 Boston Post Road West Marlborough MA 01752 Services supplier Table 40 provides supplier and contact information for services that can be provided for secondary loop par...

Page 114: ...illustration shows the Eaton Williams cooling distribution unit features The cooling distribution unit specifications are described in the following table Table 42 Eaton Williams cooling distribution...

Page 115: ...al Height 1825 mm 72 in Width 800 mm 31 5 in Depth 1085 mm 43 in Weight empty 396 kg 870 lb Weight filled 438 kg 965 lb Note Other industrial cooling distribution units can be used in a secondary cool...

Page 116: ...92 IBM XIV Gen3 281x 11x 281x 21x and 281x 314 Planning Guide...

Page 117: ...ive MD NC119 Armonk NY 10504 1785 USA INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION AS IS WITHOUT WARRANTY OF ANY KIND EITHER EXPRESS OR IMPLIED INCLUDING BUT NOT LIMITED TO TH...

Page 118: ...demark of Linus Torvalds in the United States other countries or both Microsoft Windows and the Windows logo are trademarks of Microsoft Corporation in the United States other countries or both Java a...

Page 119: ...IBM bernimmt keine Verantwortung f r die Einhaltung der Schutzanforderungen wenn das Produkt ohne Zustimmung von IBM ver ndert bzw wenn Erweiterungskomponenten von Fremdherstellern ohne Empfehlung vo...

Page 120: ...rderungen nach EN 55024 und EN 55032 Klasse A Japan Electronics and Information Technology Industries Association JEITA Notice This statement applies to products less than or equal to 20 A per phase T...

Page 121: ...Japan Voluntary Control Council for Interference VCCI Notice Korea Notice People s Republic of China Notice Russia Notice 0 12345 67 0 48 9 4 ABCD rusemi Notices 97...

Page 122: ...rence in which case the user will be required to correct the interference at his own expense Properly shielded and grounded cables and connectors must be used in order to meet FCC emission limits IBM...

Page 123: ...modules 18 interface modules 18 feature codes 0080 21 0082 22 0200 24 0203 20 1122 18 1123 18 1125 18 1126 18 1135 18 1136 18 1145 18 1146 18 1147 18 1148 18 1149 18 1150 18 1155 20 2015 18 2016 18 20...

Page 124: ...ice 20 raised floor hose requirements heat exchanger 84 reader feedback sending xxiii rear door heat exchanger maintenance 91 non raised floor requirements 87 operating specifications 71 preparing the...

Page 125: ......

Page 126: ...IBM Printed in USA SC27 5412 09...

Reviews: