background image

v

   

High-speed

 

adapters

 

v

   

Console

 

v

   

KVM

 

switches

 

v

   

InfiniBand

 

switches

 

and

 

devices

 

v

   

InfiniBand

 

host

 

channel

 

adapters

 

v

   

Fibre

 

Channel

 

adapters,

 

switches,

 

and

 

expansion

 

cards

 

v

   

10/100/1000

 

Ethernet

 

switches

 

v

   

I/O

 

modules

 

v

   

Terminal

 

servers

 

v

   

High-speed

 

Myrinet

 

switches

 

and

 

line

 

cards

 

v

   

Myrinet

 

BladeCenter

 

connectivity

 

v

   

Power

 

distribution

 

unit

 

(PDU)

Cluster

 

nodes

 

A

 

cluster

 

must

 

contain

 

at

 

least

 

four

 

cluster

 

nodes.

 

The

 

cluster

 

nodes

 

perform

 

the

 

computational

 

tasks

 

in

 

the

 

cluster.

 

Cluster

 

nodes

 

are

 

also

 

known

 

as

 

compute

 

nodes.

 

The

 

cluster

 

nodes

 

are

 

a

 

combination

 

of

 

the

 

following

 

components:

 

v

   

IBM

 

e326m

 

server

 

v

   

IBM

 

System

 

x3550

 

server

 

v

   

IBM

 

System

 

x3650

 

server

 

v

   

IBM

 

System

 

x3655

 

server

 

v

   

IBM

 

System

 

x3455

 

server

 

v

   

IBM

 

System

 

x3755

 

server

 

v

   

IBM

 

BladeCenter

 

HS21

 

v

   

IBM

 

BladeCenter

 

HS21

 

XM

 

v

   

IBM

 

BladeCenter

 

JS21

 

v

   

IBM

 

BladeCenter

 

LS21

 

v

   

IBM

 

BladeCenter

 

LS41

 

v

   

IBM

 

BladeCenter

 

QS20

 

(cell

 

blade)

Management

 

node

 

Each

 

cluster

 

contains

 

one

 

management

 

node,

 

which

 

provides

 

system

 

management

 

for

 

all

 

modules

 

in

 

the

 

cluster.

 

The

 

Cluster

 

1350

 

management

 

node

 

is

 

typically

 

a

 

server

 

running

 

Linux.

 

v

   

IBM

 

System

 

x3650

 

server

 

v

   

IBM

 

System

 

x3655

 

server

You

 

can

 

also

 

use

 

a

 

326m

 

server

 

or

 

the

 

IBM

 

BladeCenter

 

Advanced

 

Management

 

Module

 

as

 

the

 

management

 

node

 

in

 

a

 

cluster

 

environment

 

running

 

a

 

64-bit

 

Linux

 

operating

 

system.

 

Storage

 

nodes

 

The

 

optional

 

storage

 

nodes

 

manage

 

the

 

mass

 

storage.

 

The

 

cluster

 

supports

 

up

 

to

 

64

 

storage

 

nodes.

 

The

 

total

 

number

 

of

 

storage

 

and

 

compute

 

nodes

 

cannot

 

exceed

 

1024.

 

 

Chapter

 

1.

 

System

 

overview

 

5

Содержание System Cluster 1350

Страница 1: ...IBM System Cluster 1350 Installation and Service Guide...

Страница 2: ......

Страница 3: ...IBM System Cluster 1350 Installation and Service Guide...

Страница 4: ...tion in Safety on page v and Appendix C Notices on page 35 Fourteenth edition May 2007 Copyright International Business Machines Corporation 2007 All rights reserved US Government Users Restricted Rig...

Страница 5: ...1 Chapter 2 Cabinet placement and intercabinet cabling 13 Minimum service clearances 13 Types of intercabinet cabling 15 Cabinet placement guidelines 15 Installing a stability kit 16 Engaging the side...

Страница 6: ...ndix C Notices 35 Trademarks 35 Important notes 36 Product recycling and disposal 37 Battery return program 37 Electronic emission notices 38 Federal Communications Commission FCC statement 38 Industr...

Страница 7: ...e Safety Information Antes de instalar este produto leia as Informa es de Seguran a Pred instalac tohoto produktu si prectete pr rucku bezpecnostn ch instrukc L s sikkerhedsforskrifterne f r du instal...

Страница 8: ...t with translated versions of the caution or danger statement in the IBM Safety Information book that comes with your server For example if a caution statement begins with a number 1 translations for...

Страница 9: ...tallation and configuration procedures v Connect and disconnect cables as described in the following table when installing moving or opening covers on this product or attached devices To Connect To Di...

Страница 10: ...l button on the device and the power switch on the power supply do not turn off the electrical current supplied to the device The device also might have more than one power cord To remove all electric...

Страница 11: ...on a power supply or any part that has the following label attached Hazardous voltage current and energy levels are present inside any component that has this label attached There are no serviceable...

Страница 12: ...Hazardous voltage current and energy levels might be present Only a qualified service technician is authorized to remove the covers where the following label is attached Statement 15 CAUTION Make sure...

Страница 13: ...to dc power are disconnected at the dc power input terminals OFF Statement 20 CAUTION To avoid personal injury before lifting the unit remove all the blades to reduce the weight Statement 21 CAUTION H...

Страница 14: ...that you choose can support the weight of the loaded rack cabinet Refer to the documentation that comes with your rack cabinet for the weight of a loaded rack cabinet v Make sure that all door openin...

Страница 15: ...ly the wrist strap must have a good contact at both ends touching your skin at one end and firmly connected to the ESD connector on the front or back of the BladeCenter unit v Limit your movement Move...

Страница 16: ...avoid inconvenient or problem situations v Attention These notices indicate possible damage to programs devices or data An attention notice is placed just before the instruction or situation in which...

Страница 17: ...for other management traffic and user traffic Switches integrated with the cluster are used for the management Ethernet VLAN and the cluster Ethernet VLAN v Service processor networks All nodes in the...

Страница 18: ...es illustrate a primary cabinet an expansion cabinet containing cluster nodes and an expansion cabinet containing storage controllers and mass storage 1 Gigabit Ethernet switch KVM switch Management N...

Страница 19: ...72 71 70 69 68 67 66 39 40 41 42 43 44 45 46 Cabinet 2 88 87 86 85 84 83 82 81 80 79 78 77 111 110 109 108 107 106 105 104 103 102 101 100 99 98 97 96 91 90 89 Cabinet 3 240 239 238 237 236 235 234 23...

Страница 20: ...2 Storage servers DS4800 Storage Expansion Units DS4000 EXP810 Gigabit Ethernet switch 1 U blank 1 U blank 1 U blank 1 U blank 35 25 Cluster components This section describes the components in the Clu...

Страница 21: ...erver v IBM System x3655 server v IBM System x3455 server v IBM System x3755 server v IBM BladeCenter HS21 v IBM BladeCenter HS21 XM v IBM BladeCenter JS21 v IBM BladeCenter LS21 v IBM BladeCenter LS4...

Страница 22: ...expansion cards The cluster supports the following Fibre Channel devices v IBM TotalStorage Fibre Channel Host Bus Adapter v Fibre Channel SCSI iSCSI single channel adapter v Fibre Channel SCSI iSCSI...

Страница 23: ...K v Cisco Gigabit Interface Converter 1000 BASE SX v Cisco Gigabit Interface Converter 1000 Base T v Force10 10Gb XFP SR Optics Module v IBM 10GbE 850nm Fiber XFP Transceiver SR High speed adapters Th...

Страница 24: ...ire InfiniBand host channel adapter PCI X v Voltaire InfiniBand host channel adapter PCI Express 10 100 1000 Ethernet switches The 10 100 1000 Ethernet switch provides a 1 Gb Ethernet trunk line betwe...

Страница 25: ...for IBM BladeCenter v Brocade Entry SAN Switch Module for IBM BladeCenter v Brocade 4 Gb SAN Switch Module for IBM BladeCenter 20 port v InfiniBand Switch Module for IBM BladeCenter v IBM BladeCenter...

Страница 26: ...et 14 U 20 slot spine enclosure v Myricom 14 U 10 Gb CLOS switch bundle 128 ports v Myricom 14 U 10 Gb Leaf switch bundle v M3 4SW32 16Q line card 16 ports quad v M3 THRU 16Q spine thru module 10 IBM...

Страница 27: ...e PDUs from the rear of the system cabinet Rack PDUs provide power to components within a cabinet front end PDUs provide the connection to the external power source and distribute the power among the...

Страница 28: ...12 IBM System Cluster 1350 Installation and Service Guide...

Страница 29: ...ides of the rack are not required for operation but only for servicing the PDUs Front Front Back Back 112 5 inch 286 cm 36 inch 91 4 cm 36 inch 91 4 cm required clearance required clearance 86 inch 21...

Страница 30: ...y as adequate cable lengths This chapter gives guidelines for intercabinet rack to rack cabling Use these guidelines to determine the best cable lengths for your installation Remember to install the s...

Страница 31: ...LC to LC Cabinet placement guidelines Use the following guidelines when placing the cabinets v Cabinets can be placed side by side in contact with one another Remember that to service any PDU in a ca...

Страница 32: ...g the side stabilizers The rack cabinet provides side stabilizers to give additional support to the rack unit Engage the side stabilizers when the rack is at the final installation location For more i...

Страница 33: ...0 622 3 m 24 5 inches by 1 021 m 40 2 inches The values shown in the Table 2 assume a maximum rack weight of 1003 kilograms 2211 pounds Floor loading will vary by configuration If you need to know th...

Страница 34: ...ing the fluid draining the fluid and connecting or disconnecting the plumbing connections when the unit arrives or is replaced by an IBM service representative You might want to plan for extra space a...

Страница 35: ...rtual local area network VLAN provides VLAN to manage the components in the cluster This VLAN includes the following connections v RS 485 connections to all cluster nodes and storage nodes These enabl...

Страница 36: ...ary cabinet After you have connected the intracabinet cables inside the primary cabinet move on to each expansion cabinet and use the information printed on each cable label to connect the cables in t...

Страница 37: ...he console Use the following guidelines for cabling the RCM switch v Use the information on each end of each cable to create a site map v When routing a CAT5 KVM cable from a cabinet containing cluste...

Страница 38: ...ssible remove the cable from the harness Otherwise use a pair of wire cutters to cut off the connectors at both ends of the defective cable This prevents someone from mistakenly reconnecting the cable...

Страница 39: ...are all turned off 2 Open the side and rear doors of the cabinet 3 From the side of the cabinet make sure that all the power cables between the rack power distribution units and the front end power di...

Страница 40: ...devices have no power switch and turn on automatically when the power distribution units are turned on Make sure that the following components have power applied KVM switch Cisco 10 100 switch Cisco G...

Страница 41: ...management node using the Web interface and make sure that each adapter is present Ping each communication device switches terminal server power management module and KVM switch Verifying the hardware...

Страница 42: ...Related topics See Appendix A Error and event logs on page 29 26 IBM System Cluster 1350 Installation and Service Guide...

Страница 43: ...o enable the remote console function Each rack unit in the configuration includes one or two terminal servers to connect each node in the rack through a DB9 to RJ45 serial cable The terminal servers a...

Страница 44: ...odes on the management server at the console prompt type Isnode a Mode To display a list of managed nodes on the management server at the console prompt type Isnode To display the management server at...

Страница 45: ...ode and description of the error For example 301 Keyboard Input Error 164 Memory size has changed Cluster System Management log Cluster System Management CSM log files can be viewed in the var log csm...

Страница 46: ...30 IBM System Cluster 1350 Installation and Service Guide...

Страница 47: ...or new device drivers at the Cluster 1350 InfoCenter Web site Go to http publib boulder ibm com cluster v Check common answers to questions about IBM clusters To subscribe to the CSM mailing list go t...

Страница 48: ...ring System at http www ibm com shop publications order Getting help and information from the World Wide Web On the World Wide Web the IBM Web site has up to date information about IBM systems optiona...

Страница 49: ...not the name of the machine type 3 Make sure that you have your customer number associated with the Support Line contract which is unique to this contract After the customer number is verified custome...

Страница 50: ...34 IBM System Cluster 1350 Installation and Service Guide...

Страница 51: ...HOUT WARRANTY OF ANY KIND EITHER EXPRESS OR IMPLIED INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF NON INFRINGEMENT MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE Some states do not allow...

Страница 52: ...ted States other countries or both Adaptec and HostRAID are trademarks of Adaptec Inc in the United States other countries or both Linux is a trademark of Linus Torvalds in the United States other cou...

Страница 53: ...lectromagnetic compatibility gaskets and connectors which may contain lead and copper beryllium alloys that require special handling and disposal at end of life Before this unit is disposed of these m...

Страница 54: ...ses and can radiate radio frequency energy and if not installed and used in accordance with the instruction manual may cause harmful interference to radio communications Operation of this equipment in...

Страница 55: ...uct is in conformity with the protection requirements of EU Council Directive 89 336 EEC on the approximation of the laws of the Member States relating to electromagnetic compatibility IBM cannot acce...

Страница 56: ...Chinese Class A warning statement Japanese Voluntary Control Council for Interference VCCI statement 40 IBM System Cluster 1350 Installation and Service Guide...

Страница 57: ...with ISO 7779 and declared in conformance with ISO 9296 Noise emission values are different for racks that contain BladeCenter units Each BladeCenter unit has two blowers for cooling An optional acou...

Страница 58: ...42 IBM System Cluster 1350 Installation and Service Guide...

Страница 59: ...e the Program You may 1 use the Program to the extent of authorizations you have acquired and 2 make and install copies to support the level of use authorized providing you reproduce the copyright not...

Страница 60: ...MIC CONSEQUENTIAL DAMAGES EVEN IF IBM IS INFORMED OF THEIR POSSIBILITY SOME JURISDICTIONS DO NOT ALLOW THE EXCLUSION OR LIMITATION OF INCIDENTAL OR CONSEQUENTIAL DAMAGES SO THE ABOVE EXCLUSION OR LIMI...

Страница 61: ...iod Limitation of Liability Section 5 The following paragraph is added to this Section The limitations and exclusions specified in the Agreement will not apply to damages caused by IBM with fraud or g...

Страница 62: ...e Section All banking charges incurred in the People s Republic of China will be borne by you and those incurred outside the People s Republic of China will be borne by IBM UNITED KINGDOM Limitation o...

Страница 63: ...console description 7 CSM event log viewing 29 D description 10 Gigabit Ethernet switch 9 description continued cluster nodes 5 console 7 hard disk drives 6 high speed Myrinet switches and line cards...

Страница 64: ...cabinet connections 24 primary cabinets turning the power on 24 primary cluster VLAN description 19 product noise emission values 41 R rack serial number locating 31 rack stability engaging the outri...

Страница 65: ......

Страница 66: ...Part Number 44R5023 Printed in USA 1P P N 44R5023...

Отзывы: