background image

The

 

following

 

figure

 

shows

 

an

 

expansion

 

cabinet

 

containing

 

storage

 

controllers

 

and

 

mass

 

storage.

 

24

26

23

12
11
10
9
8
7
6
5
4
3
2
1

16
15
14
13

Storage nodes
System x3650

36

30
29
28
27

Serial Terminal Servers

32

33

34

31

Storage servers
(DS4800)

37

38

39

40

41

42

Storage servers
(DS4800)

Storage Expansion Units
(DS4000 EXP810)

Gigabit Ethernet switch

1-U blank

1-U blank

1-U blank
1-U blank

35

25

  

 

Cluster

 

components

 

This

 

section

 

describes

 

the

 

components

 

in

 

the

 

Cluster

 

1350.

 

Cluster

 

components

 

include:

 

v

   

Cluster

 

nodes

 

v

   

Management

 

node

 

v

   

Storage

 

nodes

 

v

   

Storage

 

servers

 

v

   

Storage

 

expansion

 

units

 

v

   

Fibre

 

Channel

 

adapters,

 

switches,

 

and

 

expansion

 

cards

 

v

   

Hard

 

disk

 

drives

 

 

4

 

IBM

 

System

 

Cluster

 

1350

 

Installation

 

and

 

Service

 

Guide

Summary of Contents for System Cluster 1350

Page 1: ...IBM System Cluster 1350 Installation and Service Guide...

Page 2: ......

Page 3: ...IBM System Cluster 1350 Installation and Service Guide...

Page 4: ...tion in Safety on page v and Appendix C Notices on page 35 Fourteenth edition May 2007 Copyright International Business Machines Corporation 2007 All rights reserved US Government Users Restricted Rig...

Page 5: ...1 Chapter 2 Cabinet placement and intercabinet cabling 13 Minimum service clearances 13 Types of intercabinet cabling 15 Cabinet placement guidelines 15 Installing a stability kit 16 Engaging the side...

Page 6: ...ndix C Notices 35 Trademarks 35 Important notes 36 Product recycling and disposal 37 Battery return program 37 Electronic emission notices 38 Federal Communications Commission FCC statement 38 Industr...

Page 7: ...e Safety Information Antes de instalar este produto leia as Informa es de Seguran a Pred instalac tohoto produktu si prectete pr rucku bezpecnostn ch instrukc L s sikkerhedsforskrifterne f r du instal...

Page 8: ...t with translated versions of the caution or danger statement in the IBM Safety Information book that comes with your server For example if a caution statement begins with a number 1 translations for...

Page 9: ...tallation and configuration procedures v Connect and disconnect cables as described in the following table when installing moving or opening covers on this product or attached devices To Connect To Di...

Page 10: ...l button on the device and the power switch on the power supply do not turn off the electrical current supplied to the device The device also might have more than one power cord To remove all electric...

Page 11: ...on a power supply or any part that has the following label attached Hazardous voltage current and energy levels are present inside any component that has this label attached There are no serviceable...

Page 12: ...Hazardous voltage current and energy levels might be present Only a qualified service technician is authorized to remove the covers where the following label is attached Statement 15 CAUTION Make sure...

Page 13: ...to dc power are disconnected at the dc power input terminals OFF Statement 20 CAUTION To avoid personal injury before lifting the unit remove all the blades to reduce the weight Statement 21 CAUTION H...

Page 14: ...that you choose can support the weight of the loaded rack cabinet Refer to the documentation that comes with your rack cabinet for the weight of a loaded rack cabinet v Make sure that all door openin...

Page 15: ...ly the wrist strap must have a good contact at both ends touching your skin at one end and firmly connected to the ESD connector on the front or back of the BladeCenter unit v Limit your movement Move...

Page 16: ...avoid inconvenient or problem situations v Attention These notices indicate possible damage to programs devices or data An attention notice is placed just before the instruction or situation in which...

Page 17: ...for other management traffic and user traffic Switches integrated with the cluster are used for the management Ethernet VLAN and the cluster Ethernet VLAN v Service processor networks All nodes in the...

Page 18: ...es illustrate a primary cabinet an expansion cabinet containing cluster nodes and an expansion cabinet containing storage controllers and mass storage 1 Gigabit Ethernet switch KVM switch Management N...

Page 19: ...72 71 70 69 68 67 66 39 40 41 42 43 44 45 46 Cabinet 2 88 87 86 85 84 83 82 81 80 79 78 77 111 110 109 108 107 106 105 104 103 102 101 100 99 98 97 96 91 90 89 Cabinet 3 240 239 238 237 236 235 234 23...

Page 20: ...2 Storage servers DS4800 Storage Expansion Units DS4000 EXP810 Gigabit Ethernet switch 1 U blank 1 U blank 1 U blank 1 U blank 35 25 Cluster components This section describes the components in the Clu...

Page 21: ...erver v IBM System x3655 server v IBM System x3455 server v IBM System x3755 server v IBM BladeCenter HS21 v IBM BladeCenter HS21 XM v IBM BladeCenter JS21 v IBM BladeCenter LS21 v IBM BladeCenter LS4...

Page 22: ...expansion cards The cluster supports the following Fibre Channel devices v IBM TotalStorage Fibre Channel Host Bus Adapter v Fibre Channel SCSI iSCSI single channel adapter v Fibre Channel SCSI iSCSI...

Page 23: ...K v Cisco Gigabit Interface Converter 1000 BASE SX v Cisco Gigabit Interface Converter 1000 Base T v Force10 10Gb XFP SR Optics Module v IBM 10GbE 850nm Fiber XFP Transceiver SR High speed adapters Th...

Page 24: ...ire InfiniBand host channel adapter PCI X v Voltaire InfiniBand host channel adapter PCI Express 10 100 1000 Ethernet switches The 10 100 1000 Ethernet switch provides a 1 Gb Ethernet trunk line betwe...

Page 25: ...for IBM BladeCenter v Brocade Entry SAN Switch Module for IBM BladeCenter v Brocade 4 Gb SAN Switch Module for IBM BladeCenter 20 port v InfiniBand Switch Module for IBM BladeCenter v IBM BladeCenter...

Page 26: ...et 14 U 20 slot spine enclosure v Myricom 14 U 10 Gb CLOS switch bundle 128 ports v Myricom 14 U 10 Gb Leaf switch bundle v M3 4SW32 16Q line card 16 ports quad v M3 THRU 16Q spine thru module 10 IBM...

Page 27: ...e PDUs from the rear of the system cabinet Rack PDUs provide power to components within a cabinet front end PDUs provide the connection to the external power source and distribute the power among the...

Page 28: ...12 IBM System Cluster 1350 Installation and Service Guide...

Page 29: ...ides of the rack are not required for operation but only for servicing the PDUs Front Front Back Back 112 5 inch 286 cm 36 inch 91 4 cm 36 inch 91 4 cm required clearance required clearance 86 inch 21...

Page 30: ...y as adequate cable lengths This chapter gives guidelines for intercabinet rack to rack cabling Use these guidelines to determine the best cable lengths for your installation Remember to install the s...

Page 31: ...LC to LC Cabinet placement guidelines Use the following guidelines when placing the cabinets v Cabinets can be placed side by side in contact with one another Remember that to service any PDU in a ca...

Page 32: ...g the side stabilizers The rack cabinet provides side stabilizers to give additional support to the rack unit Engage the side stabilizers when the rack is at the final installation location For more i...

Page 33: ...0 622 3 m 24 5 inches by 1 021 m 40 2 inches The values shown in the Table 2 assume a maximum rack weight of 1003 kilograms 2211 pounds Floor loading will vary by configuration If you need to know th...

Page 34: ...ing the fluid draining the fluid and connecting or disconnecting the plumbing connections when the unit arrives or is replaced by an IBM service representative You might want to plan for extra space a...

Page 35: ...rtual local area network VLAN provides VLAN to manage the components in the cluster This VLAN includes the following connections v RS 485 connections to all cluster nodes and storage nodes These enabl...

Page 36: ...ary cabinet After you have connected the intracabinet cables inside the primary cabinet move on to each expansion cabinet and use the information printed on each cable label to connect the cables in t...

Page 37: ...he console Use the following guidelines for cabling the RCM switch v Use the information on each end of each cable to create a site map v When routing a CAT5 KVM cable from a cabinet containing cluste...

Page 38: ...ssible remove the cable from the harness Otherwise use a pair of wire cutters to cut off the connectors at both ends of the defective cable This prevents someone from mistakenly reconnecting the cable...

Page 39: ...are all turned off 2 Open the side and rear doors of the cabinet 3 From the side of the cabinet make sure that all the power cables between the rack power distribution units and the front end power di...

Page 40: ...devices have no power switch and turn on automatically when the power distribution units are turned on Make sure that the following components have power applied KVM switch Cisco 10 100 switch Cisco G...

Page 41: ...management node using the Web interface and make sure that each adapter is present Ping each communication device switches terminal server power management module and KVM switch Verifying the hardware...

Page 42: ...Related topics See Appendix A Error and event logs on page 29 26 IBM System Cluster 1350 Installation and Service Guide...

Page 43: ...o enable the remote console function Each rack unit in the configuration includes one or two terminal servers to connect each node in the rack through a DB9 to RJ45 serial cable The terminal servers a...

Page 44: ...odes on the management server at the console prompt type Isnode a Mode To display a list of managed nodes on the management server at the console prompt type Isnode To display the management server at...

Page 45: ...ode and description of the error For example 301 Keyboard Input Error 164 Memory size has changed Cluster System Management log Cluster System Management CSM log files can be viewed in the var log csm...

Page 46: ...30 IBM System Cluster 1350 Installation and Service Guide...

Page 47: ...or new device drivers at the Cluster 1350 InfoCenter Web site Go to http publib boulder ibm com cluster v Check common answers to questions about IBM clusters To subscribe to the CSM mailing list go t...

Page 48: ...ring System at http www ibm com shop publications order Getting help and information from the World Wide Web On the World Wide Web the IBM Web site has up to date information about IBM systems optiona...

Page 49: ...not the name of the machine type 3 Make sure that you have your customer number associated with the Support Line contract which is unique to this contract After the customer number is verified custome...

Page 50: ...34 IBM System Cluster 1350 Installation and Service Guide...

Page 51: ...HOUT WARRANTY OF ANY KIND EITHER EXPRESS OR IMPLIED INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF NON INFRINGEMENT MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE Some states do not allow...

Page 52: ...ted States other countries or both Adaptec and HostRAID are trademarks of Adaptec Inc in the United States other countries or both Linux is a trademark of Linus Torvalds in the United States other cou...

Page 53: ...lectromagnetic compatibility gaskets and connectors which may contain lead and copper beryllium alloys that require special handling and disposal at end of life Before this unit is disposed of these m...

Page 54: ...ses and can radiate radio frequency energy and if not installed and used in accordance with the instruction manual may cause harmful interference to radio communications Operation of this equipment in...

Page 55: ...uct is in conformity with the protection requirements of EU Council Directive 89 336 EEC on the approximation of the laws of the Member States relating to electromagnetic compatibility IBM cannot acce...

Page 56: ...Chinese Class A warning statement Japanese Voluntary Control Council for Interference VCCI statement 40 IBM System Cluster 1350 Installation and Service Guide...

Page 57: ...with ISO 7779 and declared in conformance with ISO 9296 Noise emission values are different for racks that contain BladeCenter units Each BladeCenter unit has two blowers for cooling An optional acou...

Page 58: ...42 IBM System Cluster 1350 Installation and Service Guide...

Page 59: ...e the Program You may 1 use the Program to the extent of authorizations you have acquired and 2 make and install copies to support the level of use authorized providing you reproduce the copyright not...

Page 60: ...MIC CONSEQUENTIAL DAMAGES EVEN IF IBM IS INFORMED OF THEIR POSSIBILITY SOME JURISDICTIONS DO NOT ALLOW THE EXCLUSION OR LIMITATION OF INCIDENTAL OR CONSEQUENTIAL DAMAGES SO THE ABOVE EXCLUSION OR LIMI...

Page 61: ...iod Limitation of Liability Section 5 The following paragraph is added to this Section The limitations and exclusions specified in the Agreement will not apply to damages caused by IBM with fraud or g...

Page 62: ...e Section All banking charges incurred in the People s Republic of China will be borne by you and those incurred outside the People s Republic of China will be borne by IBM UNITED KINGDOM Limitation o...

Page 63: ...console description 7 CSM event log viewing 29 D description 10 Gigabit Ethernet switch 9 description continued cluster nodes 5 console 7 hard disk drives 6 high speed Myrinet switches and line cards...

Page 64: ...cabinet connections 24 primary cabinets turning the power on 24 primary cluster VLAN description 19 product noise emission values 41 R rack serial number locating 31 rack stability engaging the outri...

Page 65: ......

Page 66: ...Part Number 44R5023 Printed in USA 1P P N 44R5023...

Reviews: