IBM Elastic Storage System 3200 Hardware Planning And Installation Manual Download Page 38

Page: 38 / 156

NVMe transport protocol in IBM Elastic Storage System 3200

The IBM Elastic Storage System 3200 systems use the Non-Volatile Memory express (NVMe) drive

transport protocol.
• NVMe is designed specifically for flash technologies. It is a faster and less complicated storage drive

transport protocol than SAS.

• The NVMe-attached drives support multiple queues so that each CPU core can communicate directly

with the drive. This avoids the latency and overhead of core-to-core communication to give the best

performance.

• NVMe offers better performance and lower latencies exclusively for solid-state drives through multiple

I/O queues and other enhancements.

• High-performance IBM Spectrum Scale RAID supports the following RAID code options:

3WayReplication, 4WayReplication, 8+2p, and 8+3p.

• The NVMe transport protocol supports industry standard NVMe flash drives.

Enterprise-level software and support

IBM Elastic Storage System 3200 consists of two I/O server canisters that run the IBM Spectrum Scale

software, which is a part of the IBM Spectrum Storage family. For more information about the IBM

Spectrum Scale capabilities, see IBM Spectrum Scale.
Enterprise-level software and support are available based on the IBM Spectrum Scale software stack.

System topology

The following figure shows high-level architecture and topology.

IB EDR/HDR

2 x

100GbE

Midplane

24 PCle4 x2

PCIe4 x16

I/O Canister Node1

GbE

BMC

24 PCle4 x2

PCIe4 x16

I/O Canister Node 2

BMC

IB EDR/HDR

2 x
100GbE

HCA

Enet

HCA

Enet

HCA IB Enet

Boot Drv

6 por

1G Enet Sw

6 por

Enet

FPGA

USB

Serial

GbE

USB

Serial

GbE

AMD EPYC

Figure 5. IBM Elastic Storage System 3200 high-level architecture and topology

EMS node

A POWER9 EMS node (5105-22E) is a management server that is required for each ESS system of one or

more building blocks.
You need a POWER9 EMS node as a part of your ESS system. The POWER9 EMS node is ordered with the

initial building block although you can use an existing customer system. The additional building blocks

20 IBM Elastic Storage System 3200: Hardware Planning and Installation Guide

Summary of Contents for Elastic Storage System 3200

Page 1: ...IBM Elastic Storage System 3200 6 1 5 Hardware Planning and Installation Guide IBM SC31 5733 00 ...

Page 2: ...duct number 5765 DME IBM Spectrum Scale Data Access Edition for IBM ESS product number 5765 DAE IBM welcomes your comments see the topic How to submit your comments on page xvii When you send information to IBM you grant IBM a nonexclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you Copyright International Business Machines ...

Page 3: ...ion Technology Industries Association JEITA Notice 14 Japan Voluntary Control Council for Interference VCCI Notice 14 Korea Notice 15 People s Republic of China Notice 15 Russia Notice 15 Taiwan Notice 15 United States Federal Communications Commission FCC Notice 16 Chapter 2 Technical overview 17 System overview 17 Drives 21 Drive slots 22 Power modules 22 SSR access port 22 Hardware specificatio...

Page 4: ... server 5105 22E 61 Connect power cords to rack PDUs 61 ESS 5000 SCx SLx network cabling 61 Connect AC wall power to the rack PDUs 61 Power On switches storage enclosures and servers 61 Check servers with essutils tool 61 Best practices for network configuration Customer reference task 61 Prerequisites for installation completion by SSR 62 Completing the ESS 3200 installation at the customer site ...

Page 5: ...ndix B Switch VLAN configuration instructions 107 Appendix C Dual 24 port 48 ports MGMT switch ESS configuration 115 Appendix D Cables Adapters for SSR activities 119 Accessibility features for the system 123 Accessibility features 123 Keyboard navigation 123 IBM and accessibility 123 Glossary 125 Index 133 Index 133 v ...

Page 6: ...vi ...

Page 7: ...IMM slots within the server canister 26 11 DIMM slots 27 12 Rear view of an IBM Elastic Storage System 3200 27 13 Sample illustration to show space around the rack 34 14 Illustrating enclosure service envelope Dimensions in millimeters 34 15 Acoustical declaration with noise hazard notice 37 16 Label showing the orientation of rear view of the server canisters and power modules 41 17 Orientation o...

Page 8: ... cap front view 54 35 Replacing right ear cap 55 36 Release tab 55 37 Securing the enclosure 55 38 Cable management assembly 56 39 Cable management assembly installation 56 40 CMA release buttons 57 41 Installing inner CMA arm connector on inner rail connector 57 42 Installing outer CMA arm connector on outer rail connector 57 43 Installing CMA body connector E on the left CMA body rail 58 44 Orie...

Page 9: ...e configuration check window 70 61 Checking enclosure cabling and paths to disks 71 62 Checking disks for I O operations 72 63 Recovery group descriptor 72 64 Recovery group check for all disks 72 65 Setting FSP ipmi IP address EMS or 3200 72 66 Setting FSP ipmi static state and netmask EMS or 3200 73 67 Checking FSP HMC1 interface EMS or 3200 73 68 Configuring VLAN tag 74 69 Confirming VLAN tag 7...

Page 10: ...200 Ethernet port LEDs 89 81 Connecting a laptop to the serial port in the EMS node 91 82 EMS SSR menu 96 83 SSR access port 101 84 Management ports of each canister 101 85 EMS server P2P cabling 102 86 1 Gb network switch 107 87 11S label 108 88 Switch port and switch markings 108 89 RJ45 to serial cable and USB to serial cable 108 90 USB cable 109 91 Logical view of two switches 115 92 USB A to ...

Page 11: ...99 Adapter slot to access server via Ethernet 121 xi ...

Page 12: ...xii ...

Page 13: ...cs of the enclosures 32 10 Rack space requirements for the IBM Elastic Storage System 3200 33 11 Service clearance requirements 35 12 Model 5141 FN1 measurements 35 13 Clearances 35 14 Clearance information for 5101 22E 35 15 8831 S52 switch specification 36 16 Drive specifications 37 17 Shock testing results 38 18 Vibration testing results 38 19 Summary of onboard ports 42 20 Summary of supported...

Page 14: ...System 3200 fan LEDs 86 25 IBM Elastic Storage System 3200 power module status LED 87 26 IBM Elastic Storage System 3200 Ethernet port LEDs 89 27 Behavior of IBM Elastic Storage System 3200 server canister status LEDs 89 xiv ...

Page 15: ...e This unit provides ESS 3200 information including servicing and parts listings System administrators and IBM support team Problem Determination Guide This unit provides ESS 3200 information including events replacing servers issues maintenance procedures and troubleshooting System administrators and IBM support team Command Reference This unit provides information about ESS commands and scripts ...

Page 16: ...age xvi describes the typographic conventions used in this information UNIX file name conventions are used throughout this information Table 1 Conventions Convention Usage bold Bold words or characters represent system elements that you must use literally such as commands flags values and selected menu options Depending on the context bold typeface sometimes represents path names directories or fi...

Page 17: ... you hold down the control key while pressing c item Ellipses indicate that you can repeat the preceding item one or more times In synopsis statements vertical lines separate a list of choices In other words a vertical line means Or In the left margin of the document vertical lines indicate technical changes to the information How to submit your comments To contact the IBM Spectrum Scale developme...

Page 18: ...xviii IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 19: ...BM Japan Ltd 19 21 Nihonbashi Hakozakicho Chuo ku Tokyo 103 8510 Japan INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION AS IS WITHOUT WARRANTY OF ANY KIND EITHER EXPRESS OR IMPLIED INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF NON INFRINGEMENT MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE Some jurisdictions do not allow disclaimer of express or implied warrantie...

Page 20: ...ate programming techniques on various operating platforms You may copy modify and distribute these sample programs in any form without payment to IBM for the purposes of developing using marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written These examples have not been thoroughly teste...

Page 21: ... causing moderate or minor personal injury C001 DANGER A danger notice indicates the presence of a hazard that has the potential of causing death or serious personal injury D002 2 Locate the IBM Systems Safety Notices with the user publications that were provided with your system hardware 3 Find the matching identification number in the IBM Systems Safety Notices Then review the topics about the s...

Page 22: ...After you download the IBM System Safety Notices document open it 3 Under the language find the matching identification number Review the topics about the safety notices to ensure that you are in compliance Danger notices for the system Ensure that you are familiar with the danger notices for your system Use the reference numbers in parentheses at the end of each notice for example D005 to find th...

Page 23: ... this product or attached devices To disconnect 1 Turn off everything unless instructed otherwise 2 For AC power remove the power cords from the outlets 3 For racks with a DC power distribution panel PDP turn off the circuit breakers located in the PDP and remove the power from the Customer s DC power source 4 Remove the signal cables from the connectors 5 Remove all cables from the devices To con...

Page 24: ...asher contact should be free of any non conductive material to allow for metal to metal contact All PROTECTIVE EARTHING CONDUCTORS should terminate at this main protective earthing terminal or at points marked with R010 Caution notices for the system Ensure that you understand the caution notices for the system Use the reference numbers in parentheses at the end of each notice for example D005 to ...

Page 25: ...verify stabilizer brake function before each use Do not over force moving or rolling the LIFT TOOL with stabilizer brake engaged Do not raise lower or slide platform load shelf unless stabilizer brake pedal jack is fully engaged Keep stabilizer brake engaged when not in use or motion Do not move LIFT TOOL while platform is raised except for minor positioning Do not exceed rated load capacity See L...

Page 26: ...ON Removing components from the upper positions in the rack cabinet improves rack stability during a relocation Follow these general guidelines whenever you relocate a populated rack cabinet within a room or building Reduce the weight of the rack cabinet by removing equipment starting at the top of the rack cabinet When possible restore the rack cabinet to the configuration of the rack cabinet as ...

Page 27: ...llowing precautions Remove all devices in the 32U position compliance ID RACK 001 or 22U compliance ID RR001 and above Ensure that the heaviest devices are installed in the bottom of the rack cabinet Ensure that there are no empty U levels between devices installed in the rack cabinet below the 32U compliance ID RACK 001 or 22U compliance ID RR001 level unless the received configuration specifical...

Page 28: ...form any action that causes a hazard or makes the equipment unsafe Before you start the device ensure that other personnel are not in a hazardous position Place removed covers and other parts in a safe place away from all personnel while you are servicing the unit Keep your tool case away from walk areas so that other people cannot trip over it Do not wear loose clothing that can be trapped in the...

Page 29: ...arts listings c Ensure that the insulation is not worn or damaged 4 Check for any obvious nonstandard changes both inside and outside the unit Use good judgment about the safety of any such changes 5 Check inside the node for any obvious unsafe conditions such as metal particles contamination water or other fluids or marks of overheating fire or smoke damage 6 Check for worn damaged or pinched cab...

Page 30: ...without putting it down If it is necessary to put the device down place it onto its static protective bag If your device is an adapter place it component side up Do not place the device onto the cover of the system or onto a metal table Take additional care when you handle devices during cold weather Indoor humidity tends to decrease in cold weather causing an increase in static electricity Sound ...

Page 31: ...n EU Mitgliedsstaatenund hält die Grenzwerte der EN 55032 Klasse A ein Um dieses sicherzustellen sind die Geräte wie in den Handbüchern beschrieben zu installieren und zu betreiben Des Weiteren dürfen auch nur von der IBM empfohlene Kabel angeschlossen werden IBM übernimmt keine Verantwortung für die Einhaltung der Schutzanforderungen wenn das Produkt ohne Zustimmung von IBM verändert bzw wenn Erw...

Page 32: ...Klasse A Japan Electronics and Information Technology Industries Association JEITA Notice This statement applies to products less than or equal to 20 A per phase This statement applies to products greater than 20 A single phase This statement applies to products greater than 20 A per phase three phase Japan Voluntary Control Council for Interference VCCI Notice 14 IBM Elastic Storage System 3200 H...

Page 33: ...Korea Notice People s Republic of China Notice Russia Notice Taiwan Notice IBM Taiwan Contact Information Chapter 1 Notices 15 ...

Page 34: ... expense Properly shielded grounded and approved cables and connectors must be used in order to meet FCC emission limits IBM is not responsible for any radio or television interference caused by using other than approved cables and connectors or by unauthorized changes or modifications to this equipment Unauthorized changes or modifications could void the user s authority to operate the equipment ...

Page 35: ...tached SSD drives You can either use 12 drives in a half populated configuration or 24 drives in a fully populated configuration These drives are accessible from the front of IBM Elastic Storage System 3200 as shown in the following figure Note The minimum number of drives is 12 In a 12 drive configuration drives must be plugged into slots 1 6 and then 13 18 Figure 1 Front view of IBM Elastic Stor...

Page 36: ...attached SSD drives Support for industry standard 2 5 inch NVMe attached SSD drive options with the following storage capacities 3 84 TB 7 68 TB and 15 36 TB Table 3 Storage capacities and feature codes of NVMe attached SSD drives Feature code Description FRU Part number AJP4 3 84 TB 2 5 inch PCIe Gen4 NVMe attached SSD drive 01LL727 AJP5 7 68 TB 2 5 inch PCIe Gen4 NVMe attached SSD drive 01LL728 ...

Page 37: ...used The following figure shows the ESS network topology of a mixed ESS cluster that contains ESS 5000 ESS 3200 and ESS 3000 systems ESS 3000 P P Network 10 X X X 24 Management Provisioning 192 168 x x Clustering Data Network HDR EDR 100 GbE External Campus Network HMC 1 C11 T2 10 X X X 24 SSR Port Management Provisioning 192 168 x x FS P9 EMS ems1 C11 T4 10 111 222 101 30 C11 T1 C11 T3 ESS 3200 S...

Page 38: ...trum Scale software which is a part of the IBM Spectrum Storage family For more information about the IBM Spectrum Scale capabilities see IBM Spectrum Scale Enterprise level software and support are available based on the IBM Spectrum Scale software stack System topology The following figure shows high level architecture and topology 2 x IB EDR HDR 2 x 100GbE Midplane 24 PCle4 x2 PCIe4 x16 I O Can...

Page 39: ...third IBM Spectrum Scale quorum node in a configuration with one building block System management An EMS node in an IBM Elastic Storage System 3200 cluster provides system management functions IBM Elastic Storage System 3200 GUI runs on the EMS nodes and provides management and health monitoring capabilities The EMS node also runs a container with Ansible playbook that can provide orchestration of...

Page 40: ...e System 3200 with drives installed Power modules Power modules are subcomponents of enclosures A power module takes electrical power from the rack Power Distribution Units PDUs and distributes the power to other components in the enclosure For redundancy two power modules are installed in the enclosure Power module Power module Figure 8 Power module SSR access port The SSR access port is a design...

Page 41: ... EMS node in the basic configuration The EMS node acts as the management server and provides infrastructure for hardware monitoring and hosts GUI The EMS server has the following roles Quorum node GUI server Call home ESA server For more information on the POWER9 EMS FC ESZX node see Model 5105 22E server specifications Chapter 2 Technical overview 23 ...

Page 42: ...24 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 43: ...nstalls the system you must plan the physical configuration and the initial data configuration Certain physical site specifications must be met before you can set up your system This activity includes verifying that adequate space is available and that requirements for power network and environmental conditions are met Important The IBM SSR refers to these system configuration details when they pe...

Page 44: ...IMM slots per enclosure 8 per canister Initially every IBM Elastic Storage System 3200 ships with the AJP9 feature Feature Memory per enclosure AJP9 1 TB of memory 16 quantities of 64 GB DIMMs 8 per canister Server canister orientation for inserting or removing DIMMs Attention The canister top lid must be removed carefully to check the CPU and DIMM slots within the server Improper removal of the t...

Page 45: ...that the socket outlets are located near the equipment and are easily accessible The following figure shows the back of a IBM Elastic Storage System 3200 Each power module is located on the sides of IBM Elastic Storage System 3200 Figure 12 Rear view of an IBM Elastic Storage System 3200 Planning for cable connections to PDUs Each enclosure must be connected to a pair of power outlets by selecting...

Page 46: ...mation form 3a 8 Workstation Information Form 3B https www ibm com docs en power9 topic dypr workstation information form 3b 8 Plugs and receptacles https www ibm com docs en power9 topic pp plugs receptacles 8 Supported power cords https www ibm com docs en power9 topic pr supported power cords 8 Modification of IBM provided power cords https www ibm com docs en power9 topic pp modification provi...

Page 47: ...equired For redundancy two independent power circuits are required One circuit connects to each power supply in each enclosure Have you provided appropriate connectivity by preparing your environment The appropriate power requirements for each power supply unit are provided For more information see Power requirements for each power supply two per enclosure on page 31 Operating environment To use t...

Page 48: ...ace hazardous voltage on the metal parts of the system or the devices that attach to the system It is the responsibility of the customer to ensure that the outlet is correctly wired and grounded to prevent an electrical shock R001 part 1 of 2 CAUTION Do not install a unit in a rack where the internal rack ambient temperatures will exceed the manufacturer s recommended ambient temperature for all y...

Page 49: ...bserved The electrical distribution system must provide a reliable ground for each enclosure in the rack The 7965 S42 rack meet all the requirements and specifications Power requirements for each power supply two per enclosure Ensure that your environment meets the following power requirements Table 6 System power specifications Product kVA Amps Power Supplies Inlet Watts BTU hr Weight lbs 5141 FN...

Page 50: ...b cables and InfiniBand 100 Gb EDR that are greater than or equal to 3 meter in length The maximum ambient operating temperature when using only copper cable is 35 C which includes all Ethernet and InfiniBand cables less than 3 meter in length Dimensions and weight requirements for rack installation Ensure that space is available in a standard 19 rack that is capable of supporting the enclosure Th...

Page 51: ... by IBM development labs to comply with applicable safety and regulatory requirements These racks are also tested and verified to fit and function with IBM products The customer is responsible for verifying with the rack manufacturer that any non IBM racks comply with IBM specifications Note The 7965 S42 rack meet all the requirements and specifications Rack specifications The rack or cabinet must...

Page 52: ...e 13 Sample illustration to show space around the rack Figure 14 Illustrating enclosure service envelope Dimensions in millimeters 34 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 53: ...0 0 in 76 2 cm to 37 0 in 94 0 cm Rack envelope 39 4 in 1 0 m Enclosure width 19 0 in 48 3 cm Front width without rack ears 17 3 in 43 8 cm For more information on the layout of the room see Computer room layout See the Site preparation and physical planning section to help you prepare your physical site for the installation of IBM Elastic Storage System 3200 Additional space requirements Ensure t...

Page 54: ...t the weight of your drawer or device The rails must facilitate service access by allowing the drawer to be safely extended if necessary forward backward or both Some rails with IBM features for non IBM racks provide drawer specific anti tip brackets rear lock down brackets and cable management guides that require clearance on the rear side of the rails Note If the rack or cabinet has square holes...

Page 55: ...he feature codes of the NVMe drives see Table 3 on page 18 Acoustical declaration with noise hazard notice The following figure indicates the declared noise emissions values in accordance with ISO 9296 SSRs must be enrolled in a hearing conservation program and use hearing protection when servicing the system Lorem ipsum 8 3 6 8 3 6 66 66 0 3 0 3 8 4 6 8 4 6 67 67 0 3 0 3 8 6 6 8 6 6 69 69 0 3 0 3...

Page 56: ...wer by using a power cord or uses any voltage over 42 V ac or 60 V dc considered to be hazardous voltage must be Safety Certified by a Nationally Recognized Test Laboratory NRTL for the country in which it is installed Some of the items that require safety certification might include the rack or cabinet if it contains electrical components integral to the rack or cabinet fan trays power distributi...

Page 57: ...ible with the products plugged into them The power distribution unit or multi outlet strips current and power ratings are rated at 80 of the building supply circuit as required by the National Electrical Code and the Canadian Electrical Code The total load that is connected to the power distribution unit must be less than the rating of the power distribution unit For example a power distribution u...

Page 58: ...the products that are installed in the racks Contact your Installation Planning Representative if you are in doubt IP address allocation and usage As you plan your installation you must consider IP address requirements and service access for the system IBM Elastic Storage System 3200 uses 100GbE 100Gb EDR 200Gb HDR network for cluster communication and data transport For IP port usage requirement ...

Page 59: ...e AJZL CX 6 InfiniBand VPI in PCIe form factor InfiniBand HDR200 200 Gb HDR100 100 Gb EDR 100 Gb Ethernet 100 GbE AJZN CX 6 DX in PCIe form factor Ethernet 100 GbE Each canister has one port used for management functions and one additional port the SSR service port mini USB serially connected which is used by the SSR to check hardware and set the IP address Planning for cables Connections for IBM ...

Page 60: ...rage System 3200 The Ethernet port on each server canister provides system management and BMC connections The onboard 1 Gbps Ethernet port use RJ 45 connection A separate technician port provides access to each I O server canister for hardware check and setup The following table describes each port Table 19 Summary of onboard ports Onboard Port Speed Function 1 GbE RJ45 Port 1 Gbps Function Manage...

Page 61: ...face adapters The host interface adapters can be supported in any of the interface slots The following table provides an overview of the host interface adapters Table 20 Summary of supported host interface adapters Protocol Feature Ports FRU part number Quantity supported 200 Gb IB HDR Ethernet AJZL 2 per adapter 01LL648 2 4 100 Gb Ethernet AJZN 2 per adapter 01LL634 2 4 Note Each server canister ...

Page 62: ...e information about the supported environment for your system Environmental topics can include updates about the following items Host attachments Switches Firmware levels Other support hardware 44 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 63: ...ns There are dedicated 3200 ports configured on the management switch that have a role in both the service and management VLANS They are trunk ports It is important to carefully review the network document for more information For more information about instructions on switch VLAN configuration see Appendix B Switch VLAN configuration instructions on page 107 Hardware installation tasks performed ...

Page 64: ... the POWER9 protocol nodes if applicable and the EMS d After the EMS is checked and IP addresses Management FSP IP HMC1 port are set perform ping tests from the EMS to all other POWER nodes 3 Use the IBM Elastic Storage System 3000 Hardware Guide on the IBM Documentation website to do the following steps a Complete the installation procedure of the Elastic Storage System 3000 nodes b After the rac...

Page 65: ...TDAs see ESS Technical and Delivery Assessments TDAs on the IBM Worldwide Customized Installation Instructions WCII website Rack details Prepare the rack for installation work For information on preparing the rack for installation work see Prepare the rack for installation work on the IBM Worldwide Customized Installation Instructions WCII website Verify the position and installation of new system...

Page 66: ... bottom 8 Fold the sides and back of the carton down to uncover the rear of the IBM Elastic Storage System 3200 system If necessary carefully cut along the lower fold line of the sides and remove them 9 Carefully cut the raised section of the foam packing away from the rear of the enclosure 10 Carefully cut open the bag covering the rear of the enclosure 11 Remove the left power module from the en...

Page 67: ...square post holes from the front and rear ends of the two rails as shown in the following figure Figure 19 Removal of square post screw 3 Install the eight screws used for racks with round post holes on the front and rear ends of the two rails as shown in the following figure Figure 20 Installation of round post screw Note Before the rail kit is installed the inner chassis member rails must be sep...

Page 68: ...r bracket mounting screws with the appropriate rear rack post holes as shown in the following figure Before After Release Catch Figure 23 Installation of left rear bracket b Press and hold the release catch and push the bracket into place so that the mounting screws can be installed securely into the rack post holes c Release the catch to secure the rail to the post once the screws are fully inser...

Page 69: ...Figure 25 Removal of the middle screw g Push and hold the release catch outward and insert the left front bracket mounting screws into the left front rack post holes Verify that the rail is level Before After Release Catch Figure 26 Installation of the front bracket h Once the mounting screws are fully inserted into the rack post holes release the catch to secure the rail to the post i Install the...

Page 70: ...s See the following figure Front Rear Figure 28 Standoffs aligned with the keyholes b Slide the rail toward the back of the enclosure to secure the standoff on the smaller section of the keyhole to lock the rail in place which is accompanied by an audible click See the following figure Figure 29 Standoffs secured over the keyholes c Secure the rail in place by using one of the M4 screws in the hol...

Page 71: ...om the enclosure Install an IBM Elastic Storage System 3200 system only onto the IBM Elastic Storage System 3200 system rails supplied with the enclosure Load the rack from the bottom up to ensure rack stability Empty the rack from the top down To install an enclosure complete the following steps 1 Align the enclosure both horizontally and square to the rails while facing the front of the IBM Elas...

Page 72: ...ng holes as shown in the following figure Figure 33 Replacing left ear cap b Install the two screws on the rear side of the left bezel ear cap as shown in the following figure Figure 34 Displaying left ear cap front view c Repeat the above steps to install the right bezel ear cap on the right side of the enclosure 54 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 73: ...the rack Release Tab Figure 36 Release tab 7 Secure the enclosure on the left and right front of the enclosure to the left and right front rack posts by using the two M5 X 9 shipping screws as shown in the following figure Figure 37 Securing the enclosure At this point the rails and IBM Elastic Storage System 3200 enclosure are installed The enclosure is mounted on the rail with all the components...

Page 74: ...ld be secured by a strap to the cross bar during transportation to avoid damage This strap must be removed before installation Remove zip tie before use Cable Figure 38 Cable management assembly 1 Verify the direction of the CMA arm as shown in the following figure E F C A B D A Inner CMA arm connector B Inner rail connector C Outer CMA arm connector D Outer rail connector E CMA body connector F C...

Page 75: ...lling inner CMA arm connector on inner rail connector 4 Slide the outer CMA arm connector C onto the lower right outer rail connector D as shown in the following figure D C Figure 42 Installing outer CMA arm connector on outer rail connector 5 Slide the CMA body connector E onto the lower left CMA body rail F as shown in the following figure Chapter 4 Installing 57 ...

Page 76: ... position press the release tab on each inner member rail and simultaneously push the enclosure into the rack Connecting the components IBM SSR task After installing rails and the IBM Elastic Storage System 3200 enclosure in the rack the next step is to connect to the power and network Connecting Ethernet cables to the server canisters To provide the system management connectivity for your system ...

Page 77: ...st be installed in all empty host interface adapter slots Use the supplied power cords mentioned in Table 4 on page 27 to connect both power modules of the enclosure to their power sources If the power sources have circuit breakers or switches ensure that they are turned on The enclosure does not have power switches Notes Each enclosure has two power modules To provide power failure redundancy con...

Page 78: ...46 Mini USB cable 3 If you are using Mac use a USB C to USB A adapter to connect the serial cable to the system Figure 47 USB C to USB A adapter 4 If extra cable length is needed use a mini USB female to male extension cable for canisters that are higher up in the frame Figure 48 Mini USB female to male extension cable 60 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 79: ...servers on the IBM Worldwide Customized Installation Instructions WCII website Check servers with essutils tool For information see Check servers with essutils tool on the IBM Worldwide Customized Installation Instructions WCII website Best practices for network configuration Customer reference task Use this section for best practices and guidance when you fill out the Installation worksheet Using...

Page 80: ...e that each IP in the worksheet is on the same subnet Recommended subnet is 24 255 255 255 0 Management Network IPs Subnet 192 168 45 0 24 IP Address 192 168 45 51 Netmask 255 255 255 0 BMC Network IPs Subnet 10 0 0 0 24 IP Address 10 0 0 121 BMC Netmask 255 255 255 0 Logical interface mgmt Physical interface Port 1 Prerequisites for installation completion by SSR Customers must fill the Installat...

Page 81: ...ation on page 115 If the switch was not purchased from IBM there must be two isolated VLANS for ESS management Do note that the customer provided switch might not be supported by IBM Note ESS 3200 requires certain ports to be trunk ports On an IBM sold switch there are ports 1 12 These ports when combined with the vlag tag set at the BMC would route VLAN101 traffic to the BMC vlan If the switch is...

Page 82: ...nstalled The laptop must be able to connect to the RJ45 Ethernet cable by using an Ethernet port or a USB to Ethernet dongle It also needs to be able to connect USB to mini usb to check each IBM Elastic Storage System 3200 canister An Ethernet cable is required to connect to the EMS A USB to mini usb cable is required to connect to each IBM Elastic Storage System 3200 canister The SSR must access ...

Page 83: ...ccess port of the canister 1 left by using a Serial cable The following figure shows the Serial port connection SSR access port SSR access port Figure 50 SSR access port mini USB If the USB A port is not found on your laptop plug in the USB C to USB A adapter to connect the serial cable to the laptop b Turn on the laptop and select the OS that you want to boot If you are using Linux Mac OS open th...

Page 84: ... I lanplus H 127 0 0 1 U admin P Enclosure serial number A B raw 0x3c 0xcc 0x0 You should immediately be greeted with the O S login prompt If not you need to power cycle the canister If you do not see the O S login prompt immediately the canister might not be powered on Run the following command to confirm the chassis power status ipmitool I lanplus H 127 0 0 1 U admin P Enclosure serial number A ...

Page 85: ...ter For example if the enclosure serial number is 78E00TF the password for the left canister will be 78E00TFA The essutils tool opens Figure 52 The essutils tool f Set root password Highlight Advanced Tasks and press the Enter key Highlight the Command prompt as shown in the following figure and press the Enter key Figure 53 Command prompt You are taken to a shell as shown in the following figure ...

Page 86: ...s shown in the following figure and press the Enter key Figure 55 SSR tools h Highlight ESS 3200 SSR checks and press the Enter key Figure 56 ESS SSR checks Note If after hitting ESS 3200 SSR checks the terminal exits with an exception it is likely your stty session is not large enough We default the session to the following sizes stty rows 40 cols 130 As a workaround you can log in as root passwo...

Page 87: ... customer if 250 is free first Ping the canister from your laptop by using a terminal to ensure connectivity example 192 168 45 20 If you get a valid response ssh back into the canister to continue with the flow An example from PuTTY is as follows ssh 192 168 45 20 USERID essserv1 PASSWORD Enclosure serial number A B If you are uncomfortable with switching to Ethernet continue with the flow by usi...

Page 88: ...ge configuration check This option checks the valid status of the drive type placement adapter type placement and canister model Figure 60 Quick storage configuration check window The output displays with a PASS or ERROR message If the step fails with an error message debug the issue and try again 70 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 89: ...serv1 and continue with the code 20 flow l Highlight the Check enclosure cabling and paths to disks menu and press the Enter key This option checks the valid status of all paths to the NVMe drives Figure 61 Checking enclosure cabling and paths to disks The output displays with a PASS or ERROR message If the step fails with an error message debug the issue and try again Press the Enter key to conti...

Page 90: ... descriptor Figure 64 Recovery group check for all disks If there is any error that is detected you must replace or reset drives and try again Press the Enter key to continue n Highlight the Set FSP ipmi IP address EMS or 3200 menu press c key and then press the Enter key Figure 65 Setting FSP ipmi IP address EMS or 3200 72 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 91: ...5 255 0 24 If you want to modify highlight the option and press C key Then change the subnet and press Ctrl G to save the changes Press the Enter key to execute p Highlight the Check FSP HMC1 interface EMS or 3200 menu and press the Enter key This option confirms that the BMC IP address is set correctly in the previous command Figure 67 Checking FSP HMC1 interface EMS or 3200 Press the Enter key t...

Page 92: ...est Fails run the next option to fix t Highlight the Fix passwordless ssh menu and press Enter This fixes passwordless ssh issues that are found in the prior step u Check the memory ESS 3200 The result is InspectionPassed True If you do not see this result debug faulty DIMMs v Check the CPU ESS 3200 The result is InspectionPassed True If you do not see this result debug faulty CPUs w Do not run th...

Page 93: ... of the essutils tool complete the following steps a Select Advanced Tasks b Select Command Prompt c Run the following command and press Enter ipmitool sensor grep v discrete grep v na If the 4th column shows any value besides ok you must power cycle the canister and try again before you complete additional steps 6 Check whether product name and manufacturer name are correct by issuing the followi...

Page 94: ... step after the EMS is checked and configured Checking ESS management server and protocol nodes By using the following steps you can check the ESS protocol nodes and the ESS management server EMS Ensure that the EMS is the final node that you check in an order if applicable If an EMS is not in the order skip any ping tests that are specified The following hardware checks are the same for the proto...

Page 95: ...cks Perform the following steps if a new POWER9 EMS is included in the configuration Note Skip this section if the EMS has already been configured or if you are only adding additional IBM Elastic Storage System 3200 nodes to the existing setup By using the following steps you can check the EMS Ensure that the EMS is the first node that you check If you have any POWER9 5105 22E protocol nodes make ...

Page 96: ... Check for serviceable events EMS ONLY Gather serviceable event ID details EMS ONLY Erase serviceable event ID EMS ONLY Set FSP ipmi IP address EMS or 3200 HMC1 BMC Set FSP ipmi static state and netmask EMS or 3200 HMC1 BMC Check FSP interface EMS or 3200 HMC1 BMC Assign IP address to Management Interface EMS ONLY C11 T1 Assign IP address to FSP Interface EMS ONLY C11 T2 Check management interface...

Page 97: ...anagement interface EMS ONLY C11 T1 Check FSP interface EMS ONLY C11 T2 FSP interface is not applicable to the protocol nodes Check Campus interface POWER 9 EMS C11 T3 The IP addresses must match the addresses given on the TDA worksheet c Do the following final steps i Disconnect your laptop from EMS ii Ensure that no server or enclosure warning LEDs are on If required take the appropriate actions...

Page 98: ...a server nodes protocol nodes If the ping is not successful check the cabling and switch You might need to log in as root to confirm whether the IP address was set correctly For more information see IBM Elastic Storage System 5000 Problem Determination Guide 3 Press Enter to continue 4 Do the following final steps a Disconnect your laptop from EMS b Ensure that no server or enclosure warning LEDs ...

Page 99: ...p9 EMS The only difference is skip the following Assign IP address to FSP Interface EMS ONLY C11 T2 Check FSP interface EMS ONLY C11 T2 Perform any ping tests from the EMS if applicable thus protocol node setup would be done before EMS if a new environment Chapter 4 Installing 81 ...

Page 100: ...82 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 101: ...ve bays as shown in Figure 73 on page 83 From left of the enclosure the first three LEDs provide status of FRUs that are not visible from the cold aisle the fans server canisters and power modules The next six LEDs provide status of FRU groups and direct the user to the appropriate FRU for further investigation when there is a fault The last LED on the enclosure is not in use The following figure ...

Page 102: ...erver canisters experience a fault that requires a service action Server Canister OK Green ON Both server canisters are powered on and operating correctly Fan Fault Amber ON One or more fan modules experience a fault that requires a service action Fans OK Green ON All fan modules are powered on and operating correctly Power Module Fault Amber ON One or more power modules experience a fault that re...

Page 103: ...een Solid Refers drive power There are no detectable faults Blink The drive LED blinks green for an activity Amber ON The drive is in Failing state OFF The SSD does not have any power Fan module LEDs The IBM Elastic Storage System 3200 includes three LEDs with each of the six fan modules The available LEDs are of blue amber and green color These LEDs are used to monitor fan modules Note To get acc...

Page 104: ...r OFF ON The fan module is functioning properly ON ON A fan module fault is detected Power module LEDs These LEDs are used to monitor power modules of the IBM Elastic Storage System 3200 The power module status LEDs are visible from the rear of the enclosure The following figure provides a close view of the power module status LED 86 IBM Elastic Storage System 3200 Hardware Planning and Installati...

Page 105: ...tion power module continues to operate Flashing 1 0 Hz OFF Power module is in standby state AC present 12 V standby ON Power module is in cold standby state or always standby state OFF ON transition to OFF Indicates that the power cord is unplugged Server canister operator panel LEDs The IBM Elastic Storage System 3200 server canister consists three status LEDs on the bottom of the server canister...

Page 106: ...w of server canister operator panel LEDs Ethernet port LEDs The GbE port on the rear of server canister is a standard RJ45 style connector These are self driven LEDs indicate speed and link activity as described in Table 26 on page 89 A close of Ethernet port LEDs is shown in the following figure 88 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 107: ...link at 1000 MBps Flashing Flashing Indicates Ethernet link activity Server canister status LEDs The following table describes the possible behavior of server canister status LEDs Table 27 Behavior of IBM Elastic Storage System 3200 server canister status LEDs Canister status OK Green Canister fault Amber Behavior ON OFF The server canister boots and operates normally ON or OFF ON A server caniste...

Page 108: ...90 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 109: ...you are plugged into the correct port C11 T4 on the EMS If the issues still persist shut down the node hold the white button until blinking again and perform the following steps 1 Connect the laptop point to point over serial connection connecting the USB to RJ45 console cable between the auxiliary laptop and the serial port of the server with active ASMI session from the previous section Note The...

Page 110: ... the server will start to boot the OS You should see the output going across the screen and come to a login 6 Log in using the SSR credentials username essserv1 password serial number of server Note You must set the terminal variable correctly before attempting to run any commands Within PuTTY do the following export TERM xterm Continue with the rest of the flow using essutils to check the EMS and...

Page 111: ...ly to log in to the BMC you would do the following Log in to the BMC by using the following credentials User ID sysadmin Password Enclosure serial number A Note Change A with B for right canister It is possible depending on the firmware version that the password might have reset back to the default which is superuser In this situation do as follows Log in to the BMC by using the following credenti...

Page 112: ...tes to boot a data server call IBM service Assigning the management IP address This section covers the issues that are faced while you set the management IP address by using the essutils tool This task requires knowledge of the Linux command line and the vi editor When you see an interface name the interface name is mgmt for IBM Elastic Storage System 3200 1 Log in the IBM Elastic Storage System 3...

Page 113: ...th the correct information b Use the keyboard arrows to navigate the file and add the necessary information Example IPADDR IP ADDRESS NETMASK NETMASK It does not matter where you add these lines in this file 6 Save the file 7 Press escape on the keyboard and type wq Example 8 Bring down and up the interface ifdown interface name ifup interface name Example ifdown mgmt down ifup mgmt up 9 Check tha...

Page 114: ...No data available No data available No valid response received No data available IPMI response is NULL Invalid channel 1 root ess3200rw2b To fix this issue do the following 1 Login as root password is ibmesscluster 2 Run the following script opt ibm ess tools samples reboot_BMC sh You will be prompted for the BMC password which is the Serial number A left canister or B right canister and press the...

Page 115: ...f that fails to use Ctrl H you can also modify the terminal settings to interpret the backspace delete key properly When you edit commands in essutils for example when you change the IP address with c and save with Ctrl G it is possible to make a mistake that you feel cannot be corrected Remember Any options changed are not permanent Simply exit essutils completely and re start This will reset all...

Page 116: ...ddress and the mask 4 Verify that a correct IP address is set by using the essutils tool 5 Run the Check management interface C11 T1 option and press c to change the mgmt device to the enP1p8s0f0 device 6 Verify whether a correct IP is set sbin ifconfig enP1p8s0f0 Issues in the console redirection enablement using ipmitool IBM SSRs must enable console redirection when logged into the BMC over seri...

Page 117: ...ol lan print 1 7 Assign a management IP nmcli c del mgmt nmcli con add type ethernet con name mgmt ifname mgmt ipv4 addr 192 168 20 21 24 ipv4 method manual connection autoconnect yes nmcli c reload nmcli c up mgmt 8 Check the management IP sbin ifconfig mgmt 9 Set a VLAN tag bin ipmitool lan set 1 vlan id 101 10 Confirm the VLAN tag bin ipmitool lan print 1 grep i VLAN ID 11 Do a ping test sbin p...

Page 118: ...li c reload nmcli c up mgmt 3 Assign an IP to the FSP interface nmcli c del fsp nmcli con add type ethernet con name fsp ifname fsp ipv4 addr 192 168 20 21 24 ipv4 method manual connection autoconnect yes nmcli c reload nmcli c up fsp 4 Check the management interface sbin ifconfig mgmt 5 Check FSP interface sbin ifconfig fsp 6 Assign an IP to the campus interface nmcli c del campus nmcli con add t...

Page 119: ...etwork Customers must have that in place and ready to fill in or update the etc hosts file on the EMS node during the software installation For reference see Chapter 4 Installing on page 45 and IBM Elastic Storage System 3200 Quick Deployment Guide The high speed interfaces are on a separate switch and must be defined on a different subnet For instance if your management interfaces are all 192 168...

Page 120: ...Completing the ESS 3200 installation at the customer site SSR task on page 64 to log in perform the hardware checks and set the management IP address Reference Canister A1 Left SSR service port has a default IP address of 10 0 0 102 Canister B2 Right SSR service port has a default IP address of 10 0 0 101 SSR user ID is essserv1 SSR default password is the IBM Elastic Storage System 3200 serial nu...

Page 121: ... ESS 3500 proper switch configuration and VLAN tag should be set to route traffic from the BMC to the blue service FSP network ESS 3000 notes The ESS 3000 has a single interface per canister used for the management network only yellow network There is no BMC connection in ESS 3000 Campus or remote connection notes A POWER9 EMS campus connection must be set prior to deployment C11 T3 This allows re...

Page 122: ...eft 192 168 45 40 255 255 255 0 ESS 3200 canister 1 BMC interface left 10 0 0 131 255 255 255 0 ESS 3200 canister 2 management interface right 192 168 45 41 255 255 255 0 ESS 3200 canister 2 BMC interface right 10 0 0 132 255 255 255 0 ESS 3200 Building Block 2 higher position in frame IP address Netmask ESS 3200 canister 1 management interface left 192 168 45 42 255 255 255 0 ESS 3200 canister 1 ...

Page 123: ...03 255 255 255 0 IO node 2 management interface top node in building block 192 168 45 24 255 255 255 0 IO node 2 FSP HMC1 port interface top node in building block 10 0 0 104 255 255 255 0 ESS 3000 Building Block 1 lower position in frame IP address Netmask ESS 3000 Canister 1 management Interface left 192 168 45 60 255 255 255 0 ESS 3000 Canister 2 management Interface right 192 168 45 61 255 255...

Page 124: ...is will allow remote recovery debug of the EMS in case of an outage The gateway may be needed to for this IP address to work properly EMS HMC2 port IP EMS HMC2 port IP gateway Additional notes for customer LBS The root password should be set for the essserv1 SSR ID to execute commands When prompted set the password Account type Account ID Password Linux OS root ibmesscluster Customer has purchased...

Page 125: ...LOW PORTs 192 168 45 x 192 168 45 x 255 255 255 0 255 255 255 0 HMCN Network HMCN Network Lower Switch Ports Lower Switch Ports BLUE PORTs BLUE PORTs 10 0 0 x 10 0 0 x 255 255 255 0 255 255 255 0 ESS 3200 GREEN PORTs on the switch ESS 3200 GREEN PORTs on the switch Use YELLOW cable Use YELLOW cable These ports provide access for BOTH the OS These ports provide access for BOTH the OS Provisioning a...

Page 126: ... CumulusLinux Enter new UNIX password Copy and paste the output provided in the 11S serial number display step Retype new UNIX password Copy and paste the output provided in the 11S serial number display step passwd password updated successfully 5 Log in through SSH or console and log in with the new 11S password to validate the changes Note The default password must be set to the 11S serial numbe...

Page 127: ...ssword CumulusLinux 7 Download the VLAN configuration file H48712_interfaces rtf from here Note If you do not have access to the above link see Full output of the interface file on page 110 8 Gain sudo rights by using the following command sudo su 9 Copy the contents of the interface file to the file name etc network interfaces and save the file Note You can use vi or modify this file 10 Reload th...

Page 128: ...Cumulus switch must be modified to support IBM Elastic Storage System 3200 the general guidance are as follows 1 Free up at least two ports 1 IBM Elastic Storage System 3200 on the existing switch It is better if you can free up a block Ideally the current configuration is not scattered where it is easy to convert free ports for IBM Elastic Storage System 3200 usage 2 Take the existing interfaces ...

Page 129: ...auto swp36 iface swp36 bridge access 101 auto swp38 iface swp38 bridge access 101 auto swp40 iface swp40 bridge access 101 auto swp42 iface swp42 bridge access 101 auto swp44 iface swp44 bridge access 101 auto swp46 iface swp46 bridge access 101 auto swp48 iface swp48 bridge access 101 ODD Ports Upper ports PVID 102 for management network auto swp13 iface swp13 bridge access 102 auto swp15 iface s...

Page 130: ...e pvid 102 bridge vids 101 auto swp2 iface swp2 bridge pvid 102 bridge vids 101 auto swp3 iface swp3 bridge pvid 102 bridge vids 101 auto swp4 iface swp4 bridge pvid 102 bridge vids 101 auto swp5 iface swp5 bridge pvid 102 bridge vids 101 auto swp6 iface swp6 bridge pvid 102 bridge vids 101 auto swp7 iface swp7 bridge pvid 102 bridge vids 101 auto swp8 iface swp8 bridge pvid 102 bridge vids 101 au...

Page 131: ...switches If the customer is out of ports on a single management switch then a second one can be used to extend VLANs Connect the existing switch Switch 1 port 45 to the new switch Switch 2 port 47 and Switch 1 port 46 to Switch 2 port 48 It extends both the management and service VLANs ports to the new switch Appendix B Switch VLAN configuration instructions 113 ...

Page 132: ...114 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 133: ...odes These ports are used for all ESS models regardless they have dual MAC ports ESS 3200 and 3500 or not ESS 5000 This is different from the previous IBM provided TOR rack where each logical color network had dedicated ports Green and yellow ports share the same physical ports 1 through 12 Ports 13 through 20 named as FSP BMC in the blue color are to be used for systems that have dedicated FSPBMC...

Page 134: ...ers to connect to your computer if you do not have a DB 9 connection on it The serial port RJ 45 is located on the top right of the switch the serial configuration settings are 115200 bps 8 characters no parity one stop bit and no flow control Note The factory user is admin and the factory password is admin if the switch is personalized already at manufacturing For more information see Quick Start...

Page 135: ... dhcp exit exit copy running config startup config Up to this point the configuration is always the same for every switch the following lines are different for each switch You need to know the serial number of the switch to continue To get the serial run show version command as shown in the following example Vty 1 show version Unit 1 Serial Number EC2028001435 Hardware Version R02A Number of Ports...

Page 136: ...118 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 137: ...ng code on the server Figure 92 USB A to Ethernet adapter Figure 93 Mini USB to VGA HDMA adapter Note The figure shows mini USB ESS 3200 micro USB is need for ESS 3500 Figure 94 Serial USB mini B to USB cable Note The cable shown in the figure works for ESS 3200 ESS 3500 enclosures Copyright IBM Corp 2021 2022 119 ...

Page 138: ...Figure 95 POWER9 EMS serial to USB Figure 96 DB9 to USB cable for power nodes Figure 97 USB extension cable 120 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 139: ...Figure 98 Adapter to access server via Ethernet Figure 99 Adapter slot to access server via Ethernet Appendix D Cables Adapters for SSR activities 121 ...

Page 140: ...122 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 141: ...y used by screen readers Keys that are discernible by touch but do not activate just by touching them Industry standard devices for ports and connectors The attachment of alternative input and output devices IBM Documentation and its related publications are accessibility enabled Keyboard navigation This product uses standard Microsoft Windows navigation keys IBM and accessibility See the IBM Huma...

Page 142: ...124 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 143: ...central processor complex CPC central processor complex CPC A physical collection of hardware that consists of channels timers main storage and one or more central processors cluster A loosely coupled collection of independent systems or nodes organized into a network for the purpose of sharing resources and communicating with each other See also GPFS cluster cluster manager The node that monitors...

Page 144: ... that attaches to the storage enclosure drives In the case of multiple drawers in a storage enclosure the ESM attaches to drawer control modules ESM See environmental service module ESM F failback Cluster recovery from failover following repair See also failover failover 1 The assumption of file system duties by another node when a node fails 2 The process of transferring all control of the ESS to...

Page 145: ...qualified domain name FQDN The complete domain name for a specific computer or host on the Internet The FQDN consists of two parts the hostname and the domain name G GPFS cluster A cluster of nodes defined as being available for use by GPFS file systems GPFS portability layer The interface module that each installation must build for its specific hardware platform and Linux distribution GPFS Stora...

Page 146: ...at contains programs for such tasks as input output management and control of hardware and the scheduling of user tasks L LACP See Link Aggregation Control Protocol LACP Link Aggregation Control Protocol LACP Provides a way to control the bundling of several physical ports together to form a single logical channel logical partition LPAR A subset of a server s hardware resources virtualized as a se...

Page 147: ...An individual operating system image within a cluster Depending on the way in which the computer system is partitioned it can contain one or more nodes In a Power Systems environment synonymous with logical partition node descriptor A definition that indicates how ESS uses a node Possible functions include manager node client node quorum node and non quorum node node number A number that is genera...

Page 148: ...nvolving either one s operating system This permits high throughput low latency networking which is especially useful in massively parallel computer clusters RGD See recovery group data RGD remote key management server RKM server A server that is used to store master encryption keys RG See recovery group RG recovery group data RGD Data that is associated with a recovery group RKM server See remote...

Page 149: ...T TCP See Transmission Control Protocol TCP Transmission Control Protocol TCP A core protocol of the Internet Protocol Suite that provides reliable ordered and error checked delivery of a stream of octets between applications running on hosts communicating over an IP network V VCD See vdisk configuration data VCD vdisk A virtual disk vdisk configuration data VCD Configuration data that is associat...

Page 150: ...132 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 151: ...31 dimensions and weight 32 enclosures acoustic output 38 humidity without redundant AC power 31 power requirements for each power module 31 weight and dimensions 32 information overview xv inspections safety external device check 11 installation worksheet 101 interfaces 29 L location guidelines enclosure 26 N Network switch 93 notication FCC 12 notices environmental 12 O overview drive 21 of info...

Page 152: ... shock 38 vibration 38 SSR access port 59 SSR install 64 SSR port 94 static sensitive devices 12 submitting xvii T trademarks 2 V vibration specifications 38 W web documentation xv resources xv 134 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 153: ...31 dimensions and weight 32 enclosures acoustic output 38 humidity without redundant AC power 31 power requirements for each power module 31 weight and dimensions 32 information overview xv inspections safety external device check 11 installation worksheet 101 interfaces 29 L location guidelines enclosure 26 N Network switch 93 notication FCC 12 notices environmental 12 O overview drive 21 of info...

Page 154: ... shock 38 vibration 38 SSR access port 59 SSR install 64 SSR port 94 static sensitive devices 12 submitting xvii T trademarks 2 V vibration specifications 38 W web documentation xv resources xv 136 IBM Elastic Storage System 3200 Hardware Planning and Installation Guide ...

Page 155: ......

Page 156: ...IBM Product Number 5765 DME 5765 DAE SC31 5733 00 ...

Search results

Summary of Contents for Elastic Storage System 3200

Reviews:

Related manuals for Elastic Storage System 3200

Brands by name

Popular brands

IBM Elastic Storage System 3200, Hardware Planning And Installation Manual

Search results

Summary of Contents for Elastic Storage System 3200

Reviews:

Related manuals for Elastic Storage System 3200

Brands by name

Popular brands