manualshive.com logo in svg

IBM System Cluster 1350, Installation And Service

The IBM System Cluster 1350 is a high-performance computing solution. Ensure successful installation and maintenance with the Installation And Service Manual. Download it for free from manualshive.com to access detailed instructions and troubleshooting tips. Enhance your productivity with this comprehensive manual for the IBM System Cluster 1350.

Share
Download
background image

Contents

Figures

. . . . . . . . . . . . . . vii

Tables . . . . . . . . . . . . . . . ix

Safety and environmental notices . . . xi

Safety notices .

.

.

.

.

.

.

.

.

.

.

.

.

. xi

Safety Information .

.

.

.

.

.

.

.

.

.

. xi

Environmental notices .

.

.

.

.

.

.

.

.

.

. xv

Product recycling and disposal .

.

.

.

.

.

. xv

Part 1. Introduction to Cluster 1350

1

Chapter 1. System overview . . . . . . 3

Related Topics .

.

.

.

.

.

.

.

.

.

.

.

.

. 9

Part 2. Installation . . . . . . . . . 11

Chapter 2. Unpacking the eServer
Cluster 1350 . . . . . . . . . . . . 13

Chapter 3. Placing the cabinets . . . . 15

Customer responsibilities .

.

.

.

.

.

.

.

.

. 15

Installer responsibilities .

.

.

.

.

.

.

.

.

. 15

Cabinet placement .

.

.

.

.

.

.

.

.

.

. 15

Chapter 4. Cabling. . . . . . . . . . 17

Overview of Cluster 1350 cabling .

.

.

.

.

.

. 17

VLAN options .

.

.

.

.

.

.

.

.

.

.

. 17

General information

.

.

.

.

.

.

.

.

.

.

. 24

Attaching the cables

.

.

.

.

.

.

.

.

.

.

. 24

1-GB Ethernet cabling .

.

.

.

.

.

.

.

.

.

. 24

High-speed (Myrinet) switch cabling .

.

.

.

.

. 25

10/100/1000 Ethernet cabling .

.

.

.

.

.

.

. 26

Fibre Channel cabling .

.

.

.

.

.

.

.

.

.

. 27

KVM cabling .

.

.

.

.

.

.

.

.

.

.

.

.

. 28

Remote Console Manager (RCM) cabling

.

.

.

. 29

Replacing a defective cable in a harness .

.

.

.

. 29

Chapter 5. Power up the cluster . . . . 31

Initial Cluster 1350 power-on procedure .

.

.

.

. 31

Checking connections in the Expansion cabinets

31

Checking connections in the Primary cabinet .

. 31

Power-on the Expansion cabinets .

.

.

.

.

. 32

Power-on the Primary cabinet .

.

.

.

.

.

. 32

Lights out or brown out .

.

.

.

.

.

.

.

.

. 33

Related topics

.

.

.

.

.

.

.

.

.

.

.

.

. 33

Chapter 6. Software installation . . . . 35

Software Version Matrix .

.

.

.

.

.

.

.

.

. 35

Download link for drivers and firmware

.

.

. 36

Install a supported distribution of Linux.

.

.

.

. 36

Installing Red Hat Linux 7.3 or 8 .

.

.

.

.

. 37

Installing SuSE Linux 8 or 8.1 .

.

.

.

.

.

. 39

Installing SuSE Linux Enterprise Server (SLES) 7
or 8 .

.

.

.

.

.

.

.

.

.

.

.

.

.

.

. 42

Install Cluster Systems Management (CSM)

.

.

. 44

Pre-installation tasks .

.

.

.

.

.

.

.

.

. 44

Installing CSM on the Management Node .

.

. 46

Configure the Storage nodes.

.

.

.

.

.

.

.

. 46

Prerequisites .

.

.

.

.

.

.

.

.

.

.

.

. 46

Issues .

.

.

.

.

.

.

.

.

.

.

.

.

.

. 47

Copy the system image out to all nodes in the
cluster .

.

.

.

.

.

.

.

.

.

.

.

.

.

.

. 48

Test the configuration .

.

.

.

.

.

.

.

.

.

. 48

Chapter 7. Cluster management . . . . 51

Chapter 8. Remote access . . . . . . 53

Remote power

.

.

.

.

.

.

.

.

.

.

.

.

. 53

Remote console .

.

.

.

.

.

.

.

.

.

.

.

. 53

Chapter 9. Cluster power down . . . . 55

Power down the system .

.

.

.

.

.

.

.

.

. 55

Lights out or brown out .

.

.

.

.

.

.

.

.

. 55

Related topics

.

.

.

.

.

.

.

.

.

.

.

.

. 55

Part 3. Service . . . . . . . . . . . 57

Chapter 10. Hardware/software problem
determination . . . . . . . . . . . . 59

How to use this information.

.

.

.

.

.

.

.

. 59

60

Isolating network, node, and Linux problems .

. 60

Isolating hardware problems

.

.

.

.

.

.

. 63

Isolating software problems .

.

.

.

.

.

.

. 69

SNMP monitoring .

.

.

.

.

.

.

.

.

.

. 71

Setting up SNMP alerts from Myrinet

.

.

.

. 71

Resetting RSA cards

.

.

.

.

.

.

.

.

.

. 72

Checking service processor logs

.

.

.

.

.

. 72

Problem determination references .

.

.

.

.

. 72

Chapter 11. Management, Cluster and
Storage Nodes . . . . . . . . . . . 75

Disk drive failure on the Management Node .

.

. 75

Disk drive failure on a Cluster Node .

.

.

.

.

. 75

Disk drive failure on a Storage Node .

.

.

.

.

. 76

Systemboard failures .

.

.

.

.

.

.

.

.

.

. 76

Other Cluster Node Problems .

.

.

.

.

.

.

. 76

x335 problems

.

.

.

.

.

.

.

.

.

.

.

. 76

BladeCenter problems .

.

.

.

.

.

.

.

.

. 77

Additional Information

.

.

.

.

.

.

.

.

.

. 77

Chapter 12. Power problems . . . . . 79

No power to multiple devices .

.

.

.

.

.

.

. 79

No power to an individual device .

.

.

.

.

. 79

© Copyright IBM Corp. 2003

iii

Summary of Contents for System Cluster 1350

Page 1: ...eServer Cluster 1350 Cluster 1350 Installation and Service IBM...

Page 2: ......

Page 3: ...eServer Cluster 1350 Cluster 1350 Installation and Service IBM...

Page 4: ...ries Your international Access Code 1 845 432 9405 IBMLink United States customers only IBMUSM10 MHVRCFS Internet e mail mhvrcfs us ibm com If you would like a reply be sure to include your name addre...

Page 5: ...stribution of Linux 36 Installing Red Hat Linux 7 3 or 8 37 Installing SuSE Linux 8 or 8 1 39 Installing SuSE Linux Enterprise Server SLES 7 or 8 42 Install Cluster Systems Management CSM 44 Pre insta...

Page 6: ...101 Installation procedure 101 Remove the rails from the cabinet 101 Remove the Cisco Gigabit Switch from the rails 101 Install the Cisco Gigabit Switch and rails into the cabinet 101 Configure and se...

Page 7: ...Federal Communications Commission FCC statement 144 Industry Canada Class A emission compliance statement 144 Australia and New Zealand Class A statement 144 United Kingdom telecommunications safety...

Page 8: ...vi Installation and Service...

Page 9: ...of the cabinet 83 12 Mount switch rails to the Cisco 24 port 10 100 Switch 94 13 Install switch rails from the rear of the cabinet 95 14 Mount switch rails to the Cisco 48 port 10 100 Switch 97 15 Ins...

Page 10: ...viii Installation and Service...

Page 11: ...22 9 Type 6 VLAN with multiple Cisco 400x switches 23 10 Cluster 1350 supported software and firmware versions June 2003 35 11 Troubleshooting the shared VLAN 60 12 Network troubleshooting for a clus...

Page 12: ...x Installation and Service...

Page 13: ...e of this document do not perform any procedures until you receive a translated copy IBM does not accept responsibility or liability for failure to follow these procedures correctly Safety Information...

Page 14: ...mation book For example if a caution statement begins with a number 1 translations for that caution statement appear in the IBM NetBAY Rack Safety Information book under statement 1 Be sure to read al...

Page 15: ...e one hand only to connect or disconnect signal cables v Never turn on any equipment when there is evidence of fire water or structural damage v Disconnect the attached power cords telecommunications...

Page 16: ...the rack cabinet and are easily accessible v Each rack cabinet might have more than one power cord Be sure to disconnect all power cords in the rack cabinet before servicing any device in the rack cab...

Page 17: ...hest position v Ensure that there is no stabilizer bracket installed on the rack cabinet v Do not use a ramp inclined at more than ten degrees v Once the rack cabinet is in the new location do the fol...

Page 18: ...tteries in communication adapters The batteries must be recycled or disposed of properly Recycling facilities might not be available in your area In the United States IBM has established a collection...

Page 19: ...Part 1 Introduction to Cluster 1350 Chapter 1 System overview 3 Related Topics 9 Copyright IBM Corp 2003 1...

Page 20: ...2 Installation and Service...

Page 21: ...Management Node and console monitor Expansion cabinets may contain Storage Nodes or mass storage devices as well as computing nodes called Cluster Nodes Expansion cabinets do not contain a Management...

Page 22: ...00 Mb Ethernet Switch Port Server Power Management Module 12 11 10 9 8 7 6 5 4 3 2 1 16 15 14 13 Cluster Nodes x335 22 21 Cluster Nodes x335 23 17 18 24 25 26 27 28 29 30 31 32 33 34 20 19 Figure 1 Ex...

Page 23: ...0 99 98 97 96 91 90 89 Cabinet 3 506 505 504 503 502 501 500 499 498 497 496 495 Blank Blank Blank Blank Blank Blank Blank Blank 510 509 508 507 Cabinet 14 92 Power Management Module 33 34 36 37 38 35...

Page 24: ...ich provides system management for all modules in the cluster The Cluster 1350 Management Node is an IBM eServer xSeries 345 x345 running a supported Linux distribution 24 Cl1350pi3 26 25 23 12 11 10...

Page 25: ...ver in the cluster controls up to sixteen IBM EXP700 Disk Storage Expansion Units each of which expands the capacity of the Storage Server by fourteen disk drives Another mass storage solution is the...

Page 26: ...requires a Myrinet PCI adapter in each Cluster Node and Storage Node The Myrinet Switch uses an optical cable High Speed Cisco Ethernet Switch copper The Cluster 1350 can also use the Cisco Catalyst 4...

Page 27: ...345 Installation Guide ftp ftp pc ibm com pub pccbbs pc_servers_pdf 48p9726 pdf xSeries 345 User s Guide ftp ftp pc ibm com pub pccbbs pc_servers_pdf 48p9717 pdf xSeries 345 Hardware Maintenance Manu...

Page 28: ...ion http www apcc com support kbase cfm v Cisco 10 100 MB and 1 GB Ethernet switches General Product information http www cisco com univercd cc td doc product lan Catalyst 3550 Series XL Hardware Inst...

Page 29: ...3 Related topics 33 Chapter 6 Software installation 35 Software Version Matrix 35 Download link for drivers and firmware 36 Install a supported distribution of Linux 36 Installing Red Hat Linux 7 3 or...

Page 30: ...12 Installation and Service...

Page 31: ...of the normal setup process __ 4 Using the order placed for the system identify the Primary cabinet and verify its contents If equipment was removed prior to shipping check the Bill of Materials to en...

Page 32: ...14 Installation and Service...

Page 33: ...their approximate final location Each cabinet is labeled to help in this process The IBM Service team will take care of final cabinet placement and perform the rest of the cabling and installation st...

Page 34: ...ck frame Do not extend or exchange any rack mounted units when the stabilizer is not installed Take the following steps to finish placing the cabinets __ 1 Inspect the cabinets components and cable co...

Page 35: ...et trunk line shared with the management VLAN for certain VLAN types only This serves as a high speed trunk line for all Ethernet communications within the cluster Optional Secondary Cluster VLAN Prov...

Page 36: ...co 3550 Storage Nodes Ethernet 2 connects to Cisco 3550 Ethernet 1 connects to Cisco 3508 GBIC FAStT200HA Connects to Cisco 3550 Uses both jacks FAStT700 Connects to Cisco 3550 Uses both jacks Table 2...

Page 37: ...nects to Cisco 4003 Gbit Fiber GBIC connects to Sup III uplink iTouch port server Connects to Cisco 3550 APC switch Connects to Cisco 3550 Cisco 3550 10 100 switch Copper GBIC connects to Cisco 3508 C...

Page 38: ...ter Storage Nodes Ethernet 2 connects to Cisco 3550 Ethernet 1 connects to copper Cisco 3508 GBIC Myrinet adapter FAStT200HA Connects to Cisco 3550 FAStT700 Connects to Cisco 3550 Table 5 Type 5 VLAN...

Page 39: ...vice Management VLAN Gbit Primary Cluster VLAN Myrinet customer public high speed VLAN Management Node v Ethernet 1 Alias connects to Cisco 400x v Ethernet 2 connects to Sup I or Sup III v Ethernet 1...

Page 40: ...onnects to Cisco 400x Storage Nodes Ethernet 2 connects to Cisco 3550 Ethernet 1 connects to Cisco 400x FAStT200HA Connects to Cisco 3550 Uses both jacks FAStT700 Connects to Cisco 3550 Uses both jack...

Page 41: ...tomer public high speed VLAN Management Node Ethernet 2 connects to Cisco 3550 Ethernet 1 connects to Cisco 3508 copper GBIC Fiber Channel PCI connects to public network KVM switch Connects to Cisco 3...

Page 42: ...to each Expansion cabinet and use the information printed on each cable label to properly attach the cables found there Once you have reattached any cables in the Primary cabinet and Expansion cabine...

Page 43: ...shows a schematic of the Myrinet optical cabling in a large cluster VLAN types 2 5 and 6 would follow this model ATTENTION All intercabinet cables have labels at both ends of each cable You can use t...

Page 44: ...6 shows a schematic of the cabling in a large cluster VLAN types 2 3 5 and 6 would follow this model ATTENTION All intercabinet cables have labels at both ends of each cable You can use the informati...

Page 45: ...8 on page 28 shows a schematic diagram of Fibre Channel Cabling in a large cluster ATTENTION All intercabinet cables have labels at both ends of each cable You can use the information on the label to...

Page 46: ...x335s can be daisy chained onto a single KVM switch port up to 40 cluster nodes But the Management Node and all the Storage Nodes each require a separate KVM switch port Certain systems may require a...

Page 47: ...d all the Storage Nodes may also be daisy chained with up to sixteen per ACT port Multiple RCMs may not be daisy chained together The RCM may be connected to an Ethernet network to allow for remote ac...

Page 48: ...Use a wire tie to attach the cable to the harness that contains the defective cable This identifies the replacement cable as belonging to this harness 4 Label the replacement cable so it is clearly id...

Page 49: ...all outlet or other appropriate receptacle d Turn on the breaker switch for the customer s source power e Ensure the PDU circuit breakers are turned on 6 Verify that all internal PDUs are powered up b...

Page 50: ...Primary cabinet Power on the following devices in the order listed 1 Storage Expansion Units v Flip the circuit breakers on the back of the device to the ON position 2 Storage Controllers v Flip the c...

Page 51: ...stem appears to be functionally sound IBM will turn control over to the party installing the software Lights out or brown out The following sequence should occur in a lights out scenario 1 The system...

Page 52: ...34 Installation and Service...

Page 53: ...rienced with Red Hat Linux DHCP NFS and Linux networking and administration Software Version Matrix The Cluster 1350 requires certain levels of a supported Linux distribution and Cluster System Manage...

Page 54: ...00 x345 BIOS ISMP Diagnostics Remote Supervisor Adapter F W v1 08 v1 04 v1 04 v1 17 x360 BIOS Diagnostics Remote Supervisor Adapter F W v1 08 v3 01 v1 08 ServeRAID Driver 6 10 20 Download link for dri...

Page 55: ...er and save your configuration changes Exit the configuration utility You will get a message that the drives are resynching 3 Insert the Red Hat 7 3 Linux product CD and restart the Management Node 4...

Page 56: ...on your system 11 Set the root account password 12 Create an admin account to log into after installation is complete 13 When prompted to select the packages you want installed during the installation...

Page 57: ...ith the following lines search clusters com any other site specific domains nameserver 172 20 0 1 6 Populate the var named directory using the named files found on the diskette shipped with the Cluste...

Page 58: ...K 6 Select Partitioning then Discard and then Custom Partitioning You will manually partition the drive First delete all the partitions on sda Create the following partitions v A boot partition with a...

Page 59: ...r create the etc sysconfig network ifcfg eth2 file and customize it with site specific network information It should contain the same directives as ifcfg eth1 4 Update the etc resolv conf file with th...

Page 60: ...0 to primary and drive 1 to secondary Press ESC and then Enter and save your configuration changes Exit the configuration utility You will get a message that the drives are resynching 3 Insert the SuS...

Page 61: ...e latest level kernel available Update the configuration files Now that the Management Node can communicate with other devices in the cluster take the following steps 1 Update etc modules conf with th...

Page 62: ...8 Enable the named dhcpd and NFS services by issuing the following command chkconfig nfsserver on chkconfig named on chkconfig dhcpd on 9 Reboot the Management Node by issuing the following commands s...

Page 63: ...wnload the merge ic sh script from http publib boulder ibm com cluster 1350downloads htm and place the script in the tmp directory Issue the following command merge ic sh tarfile 1 tarfile 2 tarfile 3...

Page 64: ...csmdriverdownload html 7 Issue the command rpower a query and check that a valid status either on or off is returned for each node defined 8 Issue the command rconsole a to check that you have valid C...

Page 65: ...ias scsi_hostadapter2 qla2x00 must be the last SCSI host adapter listed in the file If there are other SCSI host adapter boards installed on your system and the scsi_hostadapter alias is used define a...

Page 66: ...l nodes in the cluster Because of the way the Red Hat 7 3 and 8 loads SCSI drivers and assigns them to dev sda dev sdb and so on problems can result if more than one SCSI host adapter board Adaptec or...

Page 67: ...configuration This can be done by using the fdisk l command 3 If present configure the modem according to the manufacturer s instructions 4 The system is now ready for the customer to connect their ne...

Page 68: ...50 Installation and Service...

Page 69: ...des a powerful way to administer the daily operations of a Cluster 1350 For more information on such topics as Overview Monitoring Remote Control Set up and Technical Reference refer to http www ibm c...

Page 70: ...52 Installation and Service...

Page 71: ...installed or when network access to the servers is not available or failed The terminal servers are required by the Install function in CSM and must be included to enable the Remote console function E...

Page 72: ...54 Installation and Service...

Page 73: ...following devices have no power switch and must be unplugged if the PDUs are not powered down v KVM Switch v Cisco 10 100 Switch v Cisco Gigabit Switch v iTouch terminal server 4 Unplug the PDUs from...

Page 74: ...56 Installation and Service...

Page 75: ...nstall the console switch and rails into the cabinet 81 Configure and setup the console switch after device replacement 84 Upgrading the console switch FLASH level 84 Replacement of NetBAY Advanced Co...

Page 76: ...0 Power Management Module replacement and configuration 111 Replacement 111 Uncable the Power Management Module 111 Remove the tray from the cabinet 111 Remove the Power Management Module from the tra...

Page 77: ...y be an x335 or BladeCenter containing at least four Blade servers The nodes are configured to execute customer applications or provide other services required by the customer such as file server netw...

Page 78: ...the node is connected For the service processor network the output includes the hostname of the Falcon card to which the node is connected and the internal service processor name for the node CSM dis...

Page 79: ...interface card If following the steps in Table 11 on page 60 did not correct the problem continue with the steps shown in Cluster with one network Cluster with one network Ping failure on one or some...

Page 80: ...ems on page 69 for software problem resolution 2 If there are no errors it indicates a network problem Go to Table 14 on page 63 and continue with the steps shown there b If telnet fails it indicates...

Page 81: ...blem b If telnet fails try using a serial communications program like Hyperterminal to connect to the node If you still can not connect it indicates a node hardware problem Go to Isolating hardware pr...

Page 82: ...ainst ports that are working correctly 4 Verify the InReach terminal server is powered up and functional by pinging the unit at 172 30 20 1 5 Ensure the serial port COM 1 is configured to redirect out...

Page 83: ...n node Service processor log may be full The log is cleared by connecting to the service processor via the Falcon card Otherwise go to Node on page 72 for node problem determination rpower to node fai...

Page 84: ...7 Verify the 10 100 ethernet link from the RSA card to the Cisco 3550 or 400x switch 8 Flash the ASM to the latest firmware level 9 Flash the RSA to the latest firmware level 10 Check RSA configuratio...

Page 85: ...check that the adapter device driver is configured If the adapter device driver is configured go to Storage on page 73 and continue with storage subsystem problem determination If the adapter device...

Page 86: ...igured to redirect output to the terminal server Take the following steps v Restart the node and watch the monitor screen v When the message Press F1 for Configuration Setup appears press F1 v From th...

Page 87: ...ad cables 6 Reboot the failing node s to reset connection to the KVM switch File system failure Check disks using fdisk l v If fdisk l completes go to GPFS on page 72 and continue with the file system...

Page 88: ...ls ctrmc shows that RMC is not running on the management server Follow problem determination section in Monitoring HOWTO located at http www 1 ibm com servers eserver clusters library csmadm html lsrs...

Page 89: ...llowing Myrinet software packages are required v GM software This is the base software required to use Myrinet 2000 network It is the message passing system for Myrinet networks and includes a driver...

Page 90: ...clusters library csmremot html Set Up HOWTO http www 1 ibm com servers eserver clusters library csmsetup html GPFS Linux IBM General Parallel File System for Linux http www 1 ibm com servers eserver c...

Page 91: ...d Storage Solutions ftp ftp pc ibm com pub pccbbs options 06p8884 pdf ServeRAID 4x Ultra160 SCSI Controllers Hardware Maintenance Manual ftp ftp pc ibm com pub pccbbs pc_servers 19k6408 pdf FAStT Host...

Page 92: ...74 Installation and Service...

Page 93: ...not mirrored a complete re install of the Management Node is required See Chapter 6 Software installation on page 35 for detailed instructions Disk drive failure on a Cluster Node The x335 supports ho...

Page 94: ...e 35 for a listing of the software and firmware levels used in the Cluster 1350 5 Make the following configuration settings v Devices and I O Ports PORT 3F8 IRQ4 v Remote Console Redirection Enabled C...

Page 95: ...at the PDUs in the cluster are connected to 220V source power BladeCenters connected to PDUs plugged into 115V power will not function properly Additional Information Additional hardware maintenance a...

Page 96: ...78 Installation and Service...

Page 97: ...sockets on the Frame Power Blocks 6 Verify voltage at the Power Out ports on the PDU using a Multimeter If no power is present replace the PDU FRU 9N9671 Otherwise continue with the next step 7 Swap...

Page 98: ...80 Installation and Service...

Page 99: ...and rails into the cabinet To install a replacement console switch proceed as follows 1 Select the location of an added console switch according to the following rules v If a second 1 GB Ethernet Swit...

Page 100: ...nuts on the vertical cabinet rails Install four clip nuts in front and four in back as shown in the figure below 77193 Left Rail Right Rail IBM NetBAY 2x8 console switch Screws Screws Cable Managemen...

Page 101: ...ghboring mounting screws of components already installed loosen these mounting screws then tighten once all of the component rails are installed e At the front of the cabinet place the cover brackets...

Page 102: ...using a BootP address configure your BootP server to provide an IP address to the console switch and skip the next four steps 8 At the Terminal Applications menu select option 3 and specify the IP ad...

Page 103: ...assign the IP address for the console switch a In the terminal emulation window enter 1 to select Network Configuration b Compare the IP address shown for the console switch to the IP address of the T...

Page 104: ...86 Installation and Service...

Page 105: ...y 2 Press F2 The Advanced menu window appears The highlight is in the Commands menu 3 Using the Up and Down arrow keys move the highlight to Snapshot and press Enter The device settings are now saved...

Page 106: ...y selecting Advanced Menus Setup Security You must always provide a password to access the fields on the screen The default password is oscar You can change passwords set wait time for locking to take...

Page 107: ...hree screws that secure the port server 2 Slide the port server out of the tray 3 Record the MAC address from the back of the port server Install the port server and rails 1 Remove all four rubber fee...

Page 108: ...nfigure the device 1 Connect a laptop computer running a terminal emulation program such as HyperTerminal to the command port on the back panel of the port server using a DB9 to RJ45 Serial cable 2 Se...

Page 109: ...rol enable IN Reach_Priv define port 21 40 flow control enable IN Reach_Priv define port 1 20 speed 9600 IN Reach_Priv define port 21 40 speed 9600 IN Reach_Priv define port 1 20 que disable IN Reach_...

Page 110: ...92 Installation and Service...

Page 111: ...Slide the rails out the rear of the cabinet Remove the Cisco 24 port 10 100 Switch from the rails Unscrew the Cisco 10 100 Switch from the rails There are four holes on each side of the devices Instal...

Page 112: ...ical cabinet rails in Slot 17 Install four clip nuts in front and four in back as shown in the figure below The clip nuts may still be on the vertical cabinet rails after the rails were removed Figure...

Page 113: ...Figure 12 on page 94 c Insert the mounting screws in the rear vertical cabinet rails as shown in Figure 13 Insert two on each side Do not tighten the screws If you have difficulty with neighboring mou...

Page 114: ...inet To remove the tray from the cabinet do the following 1 Remove the mounting screws from the front vertical cabinet rails and remove the cover bracket 2 Remove the mounting screws from the rear ver...

Page 115: ...Install four clip nuts in front and four in back as shown in the figure below The clip nuts may still be on the vertical cabinet rails after the rails were removed Figure 14 Mount switch rails to the...

Page 116: ...hown in Figure 14 on page 97 c Insert the mounting screws in the rear vertical cabinet rails as shown in Figure 15 Insert two screws on each side Do not tighten the screws If you have difficulty with...

Page 117: ...ation window enter enable This will put you in administrative mode 5 At the prompt type ibm and hit enter The prompt will change from a to a to indicate you are in administrative mode 6 Entershow run...

Page 118: ...ommand ipconfig v On the switch use the command show running Additional information Catalyst 5000 Family Ethernet and Fast Ethernet Switching Modules Installation and Configuration Note including Tran...

Page 119: ...he rails out the rear of the cabinet Remove the Cisco Gigabit Switch from the rails Unscrew the Cisco Gigabit Switch from the rails There are four holes on each side of the devices Install the Cisco G...

Page 120: ...Install clip nuts on the vertical cabinet rails in Slot 20 Install four clip nuts in front and four in back as shown in the figure below The clip nuts may still be on the vertical cabinet rails after...

Page 121: ...on page 102 c Insert the mounting screws in the rear vertical cabinet rails as shown in Figure 17 Insert two on each side Do not tighten the screws If you have difficulty with neighboring mounting sc...

Page 122: ...is will put you in administrative mode 5 At the prompt enter ibm and hit enter The prompt will change from a to a to indicate you are in administrative mode 6 Enter show run to show the current config...

Page 123: ...e1 It should fail Additional information Catalyst 5000 Family Ethernet and Fast Ethernet Switching Modules Installation and Configuration Note including Translated Safety warnings 10 languages http ww...

Page 124: ...106 Installation and Service...

Page 125: ...mal duct and how it fits within the cabinet and attaches to the switch Item Part No Qty Description 1 24P7877 2 Bracket Cisco 2 24P7878 1 Rail right 3 24P7879 1 Cover 4 24P7885 1 Rail duct 5 1410 42L...

Page 126: ...108 Installation and Service...

Page 127: ...he connections to the Storage and Cluster Nodes The line cards plug into slots in the Switch chassis Management Module Manages and routes the Myrinet traffic polling the ports and building tables to c...

Page 128: ...assis and fasten the rack mount screws 7 Connect the optical cables to the connectors on the Switch Save the dust caps for future use 8 Connect the power cord to the Myrinet Switch This powers up the...

Page 129: ...the Power Management Module you must remove the tray from the cabinet Uncable the Power Management Module 1 Note the positions of all cable connections to the Power Management Module 2 Obtain the IP a...

Page 130: ...ng screws from the rear vertical cabinet rails 5 Slide the tray out the rear of the cabinet Remove the Power Management Module from the tray 1 Unplug the power cables from the power bricks that lie on...

Page 131: ...side holes on each side of the Power Management Module align with the two outer most holes on each side of the tray as shown in Figure 20 b Insert two screws on each side of the tray in the two outerm...

Page 132: ...y in from the rear of the cabinet b Tighten one screw on each side of the sliding bracket to prevent the bracket from extending as you slide the tray in the cabinet c Install the clip nuts on the cabi...

Page 133: ...es and the cable to the PDU out through the cable management slot in the tray If the tray catches as you are sliding it into the cabinet push up on the tray from underneath b Insert the mounting screw...

Page 134: ...sliding brackets so that the holes line up with the front vertical cabinet rails as shown in the figure below Insert the mounting screws in the front vertical cabinet rails e Tighten the mounting scre...

Page 135: ...Module Configure and setup after device replacement 1 Configure the new Power Management Module with the same IP address of the Power Management Module you removed 2 Verify that the firmware level is...

Page 136: ...fm The online search engine for APC documentation is available at http sturgeon apcc com techref nsf umanuals openform Use AP 9212 as a search parameter Relevant documents include v MasterSwitch Power...

Page 137: ...t and up to twelve rack PDUs To remove the Power Distribution Units take the following steps 1 Shut down all devices 2 Remove the side cover on the side of the rack that the failing PDU is located on...

Page 138: ...120 Installation and Service...

Page 139: ...Part 4 Appendixes Copyright IBM Corp 2003 121...

Page 140: ...122 Installation and Service...

Page 141: ...get the no hard drive found message from Linux when installing an x335 with IDE drives A The file csminstall csm 1 3 0 kickstart RedHat7 3 172 20 3 x kickstart needs to be changed where x is the IP ad...

Page 142: ...he install still cycles then edit the csminstall Linux SIS scripts hostname sh file and comment out the shutdown line near the bottom of the file Now using the console watch the boot and the error mes...

Page 143: ...tic portion of the bootup Press F2 to run diagnostics then F3 to view log file POST BIOS errors can be read by pressing F1 key during boot process and then selecting View Error Logs from menu This giv...

Page 144: ...126 Installation and Service...

Page 145: ...S mounts Existing NFS mounted file systems are inaccessible after a CSM installation on a cluster node 1 Remount the NFS file systems 2 If there is an existing tftpboot partition on cluster nodes an e...

Page 146: ...ohci alias scsi_hostadapter4 aic7xxx Edited modules conf alias eth0 e1000 alias scsi_hostadapter aic7xxx alias scsi_hostadapter1 ips alias eth1 e1000 alias eth1 e1000 alias parport_lowlevel parport_p...

Page 147: ...hen assigning names of the RSA and Service Processor If a name is not recognized verify that there are no trailing blanks after the name Light path points to PCI LED If Light Path diagnostics points t...

Page 148: ...130 Installation and Service...

Page 149: ...to the Management VLAN Again one port assigned to the Management VLAN needs to be reserved to make the connection to the switch itself It is the same story as above for the management port on the SUP...

Page 150: ...er debug commands To see spanning tree info on a port by port basis issue the following command show spanning tree brief Switch commands for 4006 running IOS These commands will work with 3550 running...

Page 151: ...es issue the following commands conf t int range mode port port switchport host end To see the VLAN setup issue the following command show vlan To set the switch as the spanning tree root Run the comm...

Page 152: ...n ports going to compute and storage nodes issue the following commands set port host To see the VLAN setup issue the following command show vlan To set the switch as the spanning tree primary set spa...

Page 153: ...Miscellaneous CISCO switch commands for IOS To see what ports are blocked by the spanning tree issue the following command show sp br Appendix D Setting up network switches 135...

Page 154: ...136 Installation and Service...

Page 155: ...e license to use the Program You may 1 use the Program to the extent of authorizations you have acquired and 2 make and install copies to support the level of use authorized providing you reproduce th...

Page 156: ...ES INCLUDING WITHOUT LIMITATION LOST PROFITS LOST SAVINGS OR ANY INCIDENTAL SPECIAL OR OTHER ECONOMIC CONSEQUENTIAL DAMAGES EVEN IF IBM IS INFORMED OF THEIR POSSIBILITY SOME JURISDICTIONS DO NOT ALLOW...

Page 157: ...used according to the Program information You have to check the usability according to the Program information within the money back guaranty period Limitation of Liability Section 5 The following par...

Page 158: ...ftware in the operation of a Cisco networking product only b make not more than one 1 copy of the Cisco Software which you may use only for purposes of backup and disaster recovery You may not otherwi...

Page 159: ...the Cisco Software you may only use such upgrades if at the time you receive them you have a valid license to use the Cisco Software which was upgraded or updated Appendix E International License Agr...

Page 160: ...142 Installation and Service...

Page 161: ...e following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICAT...

Page 162: ...ions to this equipment Unauthorized changes or modifications could void the user s authority to operate the equipment This device complies with Part 15 of the FCC Rules Operation is subject to the fol...

Page 163: ...55022 The limits for Class A equipment were derived for commercial and industrial environments to provide reasonable protection against interference with licensed communication equipment Attention Th...

Page 164: ...nt of Health and Human Services DHHS regulation 21 CFR Subchapter J This compliance is indicated by markings on the laser component assembly Note that the Class 1 conformity label may not be visible w...

Page 165: ...improve the environmental quality of OEM products but at this time environmental achievements cannot be assumed for all OEM devices Energy Savings Four processor boards do the work of several of the f...

Page 166: ...used with the exception of static bags v The sum concentration of incidental levels of lead cadmium mercury and hexavalent chromium is less than 0 01 by weight v Inks are water based with no heavy met...

Page 167: ...installing on management node 46 known problems 127 pre installation tasks 44 problem determination 70 CSM Cluster Systems Management 44 D defective cable replacing 29 determining problems 59 Distribu...

Page 168: ...9 R RCM cabling 29 Red Hat Linux Storage Node configuration 46 remote access 53 remote console 53 remote power 53 Remote Console Manager cabling 29 removal Cisco 4000 Series switch 107 Power Distribut...

Page 169: ......

Page 170: ...IBMR Printed in U S A...

Reviews:

No comments

Related manuals for System Cluster 1350

SafeNet Luna SA Configuration Manual preview
Luna SA
Brand: SafeNet Pages: 109
IBM totalstorage 200 Service Manual preview
totalstorage 200
Brand: IBM Pages: 180
IBM eServer 380 xSeries User Reference Manual preview
eServer 380 xSeries
Brand: IBM Pages: 112
Supero SUPERSERVER 6027R-TRF User Manual preview
SUPERSERVER 6027R-TRF
Brand: Supero Pages: 102
IBM Flex System p270 Compute Node Installation And Service Manual preview
Flex System p270 Compute Node
Brand: IBM Pages: 510
H3C UniServer R4300 G5 Installation, Quick Start preview
UniServer R4300 G5
Brand: H3C Pages: 16
Supermicro SUPERSERVER 8045C-3R User Manual preview
SUPERSERVER 8045C-3R
Brand: Supermicro Pages: 118
B&B VESR4X4 User Manual preview
VESR4X4
Brand: B&B Pages: 70
Synology DiskStation Series Upgrade Installation Instructions preview
DiskStation Series
Brand: Synology Pages: 6
Supero SuperServer 6024H-82 User Manual preview
SuperServer 6024H-82
Brand: Supero Pages: 122
Asus RS160-E4 PA4 User Manual preview
RS160-E4 PA4
Brand: Asus Pages: 186
Antrica ANT-35000A User Manual preview
ANT-35000A
Brand: Antrica Pages: 68
StarTech.com SV1115IPEXT Instruction Manual preview
SV1115IPEXT
Brand: StarTech.com Pages: 67
HP Windows Server 2008 R2 Administrator'S Manual preview
Windows Server 2008 R2
Brand: HP Pages: 18
HP TruCluster Server V5.1B-1 Specification preview
TruCluster Server V5.1B-1
Brand: HP Pages: 19
HP VT5900-H Quick Setup Manual preview
VT5900-H
Brand: HP Pages: 24
HP Virtual Connect FlexFabric-20/40 F8 Module Quickspecs preview
Virtual Connect FlexFabric-20/40 F8 Module
Brand: HP Pages: 23
HP ProLiant SL335s G7 Installation Sheet preview
ProLiant SL335s G7
Brand: HP Pages: 2

Brands by name

Popular brands

Load more brands