manualshive.com logo in svg

IBM RS/6000 SP, Service Manual

Share
Download
IBM RS/6000 SP Service Manual Download Page 112

Readers’ Comments — We’d Like to Hear from You

GA22-7443-04

GA22-7443-04

IBM

Cut or Fold
Along Line

Cut or Fold
Along Line

Fold and Tape

Please do not staple

Fold and Tape

Fold and Tape

Please do not staple

Fold and Tape

PLACE

POSTAGE

STAMP

HERE

IBM Corporation
Department 55JA, Mail Station P384
2455 South Road
Poughkeepsie NY 12601-5400

_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

___________________________________________________________________________________________________

Summary of Contents for RS/6000 SP

Page 1: ...RS 6000 SP SP Switch Service Guide GA22 7443 04 IBM...

Page 2: ......

Page 3: ...RS 6000 SP SP Switch Service Guide GA22 7443 04 IBM...

Page 4: ...Countries Your International Access Code 1 845 432 9405 IBMLink United States customers only IBMUSM10 MHVRCFS Internet e mail mhvrcfs us ibm com If you would like a reply be sure to include your name...

Page 5: ...5 SP Switch power MAP 0610 1 13 SP Switch function MAP 0620 1 17 Chapter 2 Locations 2 1 Naming standard for RS 6000 SP components 2 1 Format structure 2 1 Location diagrams of the RS 6000 SP compone...

Page 6: ...witch fans 4 3 Replacing the switch fans 4 3 Removing the switch front chassis cable 4 3 Replacing the switch front chassis cable 4 4 Removing the switch supervisor card 4 4 Replacing the switch super...

Page 7: ...ng path in rear of RS 6000 SP frame 1 93 m frame 2 10 2 8 Frame cabling routing path in rear of RS 6000 SP frame 2 01 m frame 2 10 2 9 Frame cable routing paths in rear of RS 6000 SP multi switch fram...

Page 8: ...vi RS 6000 SP SP Switch Service Guide...

Page 9: ...table for SP Switch adapters 1 24 1 10 Switch problem priority listing 1 26 2 1 External cable routing 2 11 2 2 SPS Switch data cable chart 2 13 2 3 SPS 8 Switch data cable chart 2 13 3 1 Service proc...

Page 10: ...viii RS 6000 SP SP Switch Service Guide...

Page 11: ...a unit SPSFD001 DANGER An electrical outlet that is not correctly wired could place hazardous voltage on metal parts of the system or the devices that attach to the system It is the responsibility of...

Page 12: ...nfiguration connect the primary power cable only after connecting all electrical signal cables SPSFD007 DANGER High voltage present Perform Lockout safety procedures to remove primary power to the fra...

Page 13: ...50 60 Hz Power Receptacle Safety Check have been performed on all customer power source outlets and cable connectors SPSFD015 DANGER Ensure that the customer s branch distribution circuit breakers cus...

Page 14: ...frame balance and position during service operations SPSFC008 CAUTION Outer edges of chassis may be sharp Care must be taken when removing and installing chassis SPSFC009 CAUTION The ground strip may...

Page 15: ...onments can contain equipment transmitting on system links with laser modules that operate at greater than class 1 power levels For this reason never look into the end of an optical fiber cable or ope...

Page 16: ...hed a collection process for reuse recycling or proper disposal of used sealed lead acid nickel cadmium and nickel metal hydride batteries and battery packs from IBM equipment For information on prope...

Page 17: ...rocedures the system Start MAP and MAPs and parts catalog for the frames and power subsystems Use this book to begin a diagnostic procedure to isolate a problem to a specific major component of the SP...

Page 18: ...n v Send your comments by e mail to mhvrcfs us ibm com Be sure to include the name of the book the order number of the book and if applicable the specific location of the text you are commenting on fo...

Page 19: ...es them obsolete This edition contains minor changes and corrections throughout the book GA22 7443 01 This edition replaces GA22 7443 00 and makes it obsolete Added cross book links for reference link...

Page 20: ...xviii RS 6000 SP SP Switch Service Guide...

Page 21: ...tch external data cables multi frame only Attention 1 Switch data plug jack connector pins are easily bent Check for bent pins on male plugs or bent pin guides on female jacks if a cable is difficult...

Page 22: ...hassis cable complete assembly On external bulkhead On planar J34 J1 J32 J3 J4 J31 J33 J2 J1 J2 P1 P2 Supervisor bus card 48 V dc 12 V dc Switch planar J35 J34 J33 5 V dc 5 V dc 5 V dc 5 V dc Switch p...

Page 23: ...dified switch cabling from standard configurations therefore be careful about relying on node and frame information Any connector jack numbers will be correct regardless of the customer s cable config...

Page 24: ...s with switch_responds v Problem s returned from errpt a N Worm v Problem s detected by CE customer Go to SP Switch function MAP 0620 on page 1 17 Notes 1 out top is located in the primary node To fi...

Page 25: ...are being experienced or this is an N 1 fan or power supply failure then no immediate service is required and service can be deferred until a later date If problems are being experienced service can b...

Page 26: ...ormed some basic inspections and found that the switch supervisor control cable S00 SP P102 appears to be okay 1 Disconnect S00 PC P4 and S00 PC P4 at the power supply 2 Using a digital multimeter mea...

Page 27: ...0600 010 Step 0600 010 With cable S00 PC P4 reconnected at the switch power supply 1 the measured resistance values were still outside the acceptable range 1 Reconnect cable S00 PC P6 at switch power...

Page 28: ...e at Step 0600 012 5 5 of 5 All replaced Call next level of support Step 0600 012 You performed the recommended action in Table 1 4 1 Component replaced or reseated 2 Reconnect all cables inside the S...

Page 29: ...intakes This indicates that there is a problem in the switch supervisor card 1 Have the customer remove the switch from the active configuration and power off the SP Switch 2 Set the circuit breaker...

Page 30: ...m the inner chassis 6 Put the switch into service position refer to Service position procedures on page 3 9 7 What problem type is given in the condition v If the condition states that you have a P33...

Page 31: ...ted and you removed power supply card PS1 but the measured resistance between pins 12A and 12B is still outside the specified range 1 If this is the first time through this step a Remove power supply...

Page 32: ...1 position 8 Does the PSxFail condition still exist v If yes a Replace the SP Switch inner chassis assembly b Go to Step 0600 017 on page 1 10 v If no go to Step 0600 017 on page 1 10 Step 0600 027 Y...

Page 33: ...er to Service position procedures on page 3 9 6 Go to Step 0600 017 on page 1 10 Step 0600 031 You have a PSFuseGood problem that did not go away when you removed power supply PS2 1 Put the circuit br...

Page 34: ...then restart SP Switch description and problem determination MAP 0590 on page 1 1 c If this is the proper SP Switch call the next level of support Step 0610 003 The Power LED is lit and it is flashing...

Page 35: ...from one of five power harnesses The sets are as follows PDU BH P1 Frame slots 1 2 3 4 PDU BH P2 Frame slots 5 6 7 8 PDU BH P3 Frame slots 9 10 11 12 PDU BH P4 Frame slots 13 14 15 16 PDU BH P5 Frame...

Page 36: ...S00 BH_J1 pin 5 9 P6 pin 2 S00 BH J1 pin 5 9 P4 pin 2 S00 BH J1 pin 1 6 P3 pin 16 P3 pin 17 p6 pin 1 P3 pin 17 p4 pin 1 6 On the fan assembly with circuit breaker in the On 1 position check for front...

Page 37: ...ound in this appendix 2 Refer to Service position procedures on page 3 9 for placing or removing the switch into or from service position Step 0620 001 A message in Perspectives indicated that you hav...

Page 38: ...a text line by the following sequence ErrorMessage Examples of error messages 1 uninitialized 3 R faulty link from VOP 9 Does var adm SPlogs css out top file report any problems v If yes use the SPS...

Page 39: ...css out top file address those errors first Note If the problem is on all nodes in the frame check for any hardware problems with the SP Switch Also check for switch to switch problems on all jacks o...

Page 40: ...ndentNode 4 If this occurs on all nodes of a frame check for a logical to physical frame number mismatch 5 If there is a mismatch have the customer update the configuration or you can correct the cabl...

Page 41: ...problem Action Go to Step 0620 004 Step 0620 004 You were directed here by an Error Condition listed in Table 1 7 on page 1 19 which lists functional problems reported in var adm SPlogs css out top f...

Page 42: ...rapped port or external switch connection 4 4 of 5 v Node connections not on same switch as primary node v If this is a standard node go to Step 0620 005 to check secondary processor node connection v...

Page 43: ...010 Step 0620 010 The processor must be powered on for the switch to recognize the port 1 Power on this processor node and check the Power green LED 2 Does the Power green LED stay lit indicating the...

Page 44: ...2A9 D SPS adapter Problem detected with internal clock 762 300 through 762 399 D SPS adapter system or I O planar Problem detected with POS registers 762 400 through 762 499 D SPS adapter software TB...

Page 45: ...rrupt test failed 763 8xx See note D SPS MX adapter FIFO test failed 763 9xx See note D SPS MX adapter switch cable system or I O planar DMA engine test failed 763 Ax3 See note D SPS MX adapter termin...

Page 46: ...764 9xx See note D SP System Attachment Adapter switch cable system or I O planar DMA engine test failed 764 Ax3 See note D SP System Attachment Adapter terminator Card wrap test failed 764 Ax4 See no...

Page 47: ...ce at Step 0620 018 on page 1 28 3 3 of 7 Data cable a Reseat switch data cable at switch adapter of this processor node b Run advanced diagnostics on the device css0 and its associated switch port c...

Page 48: ...on page 1 36 to verify fix v If this is not the only switch in this system go to Step 0620 016 Step 0620 016 The system you are working on either has an external clock or the system uses more than on...

Page 49: ...be okay v If yes go to Step 0620 022 v If no a Fix the obvious connection problem b Go to Step 0620 043 on page 1 36 to verify fix Step 0620 022 The var adm SPlogs css out top file indicated a switch...

Page 50: ...0620 043 on page 1 36 to verify fix Step 0620 024 Problem reported with all switch data cables from one or more frames This may be caused by a clocking or grounding problem between frames Note The mas...

Page 51: ...his SP Switch 4 Set the switch clock selection on this SP Switch to the original correct setting 5 From the control workstation of the primary node reinitialize the switch by entering Estart 6 Check v...

Page 52: ...there still problems reported on all data cables connected to this SP Switch v If yes a You have isolated the clock problem to the reported SP Switch b Return to Step 0620 028 on page 1 31 v If no a...

Page 53: ...e switch data cable corresponding to the selected clock at the SP Switch 2 Run advanced diagnostics on css0 on the test processor node and its associated switch port v Do not perform cable wrap test v...

Page 54: ...one of the failing components 5 Do the css0 diagnostics fail with indication of a clock problem v If yes go to Step 0620 037 v If no go to Step 0620 037 Step 0620 037 You have run the css0 diagnostics...

Page 55: ...essor node and its associated switch port v Do not perform cable wrap test v Refer to Running diagnostics in a processor node in RS 6000 SP System Service Guide 3 Look for an SRN indicating a clock pr...

Page 56: ...following command From the control workstation enter dsh w nodelist usr lpp ssp css css_restart_node OR if all processor nodes have lost switch clocks enter dsh a usr lpp ssp css css_restart_node whe...

Page 57: ...schematics manufacturing documents service documents and customer publications Format structure The RS 6000 SP system is structured in a modular fashion with different levels of assembly which can be...

Page 58: ...es Refer to the lists of two character designations associated with each major assembly throughout this chapter Example SC denotes a switch card Connection location ZZZZ v 1st character is the connect...

Page 59: ...numbered position 2 In a F C 2030 1 frame switch assemblies take up an entire shelf partition They are identified by the even numbered position 3 Processor node slots are numbered up to N16 4 A High n...

Page 60: ...wer Switch with LED Left Skirt Right Skirt Switch AsmS2 Switch AsmS4 Switch AsmS6 Switch AsmS8 Switch AsmS10 Switch AsmS12 Switch AsmS14 Switch AsmS16 SP SwitchFrame Locations FrontView Front Cover an...

Page 61: ...ower unit must have a power module in position D right most slot For N 1 operation a power module may be installed in position C next to slot D 5 There are no skirts on the 49 inch frame 6 A High node...

Page 62: ...e RS 6000 SP frame locations with numbered processor nodes and the three phase SEPBU Frame FRA This list shows the designations specifically for the RS 6000 SP frame G1 Right hand rear ground G2 Left...

Page 63: ...G6 Front door ground G7 Rear door ground G8 Ground SW Power on switch LD LED card FC Front cover RC Rear cover Example E01 FRA G1 Chapter 2 Locations 2 7...

Page 64: ...ions Fan 5 P6 P4 P5 Fan 4 Fan 3 Fan 2 Fan 1 CB LED Card J1 J2 Switch Planar Power Supply 2 Supervisor Card Power Supply 1 Supervisor Bus Card Air Baffle Figure 2 5 SPS SPS 8 assembly 2 8 RS 6000 SP SP...

Page 65: ...2 10 and Figure 2 8 on page 2 10 show back views of the RS 6000 SP frame showing the horizontal and vertical paths of cable routing from connector to connector with the depth amplified on the drawing...

Page 66: ...service loop for node movement into service position Note For a multi switch frame F C 2030 1 refer to Figure 2 7 Figure 2 7 Frame cabling routing path in rear of RS 6000 SP frame 1 93 m frame Figure...

Page 67: ...E3 E1 V3 H5 7 2030 80 E3 E2 V6 H6 8 2340 92 E3 E2 V6 H6 9 2510 99 E3 E1 V2 H7 10 2210 87 E3 E1 V2 H7 11 2390 94 E3 E2 V7 H8 12 2690 106 E3 E2 V7 H8 13 2870 113 E3 E1 V1 H9 14 2570 101 E3 E1 V1 H9 15...

Page 68: ...routing paths in rear of RS 6000 SP multi switch frame F C 2030 1 1 93 m frame Figure 2 10 Frame cable routing paths in rear of RS 6000 SP multi switch frame F C 2030 1 2 01 m frame 2 12 RS 6000 SP S...

Page 69: ...H PA 46H9722 E00 S00 BH J33 E00 N13 BH PA 46H9723 E00 S00 BH J34 E00 N14 BH PA 46H9724 E00 S00 BH J16 E00 N15 BH PA 46H9725 E00 S00 BH J15 E00 N16 BH PA Note PA refers to connector on SPS adapter Note...

Page 70: ...2 14 RS 6000 SP SP Switch Service Guide...

Page 71: ...be sensitive to electrostatic discharge ESD To prevent ESD damage to FRUs or to prevent system failures observe the following procedures v Keep the FRU in its original static dissipative shipping cont...

Page 72: ...itory for a node or a series of nodes Also retrieves a topology files out of the SDR Eclock Primary or Control Node Controls the clock source for each switch board within an SP cluster ifconfig All no...

Page 73: ...n css snap uses a number of undocumented utilities to collect information Some of these like read_regs and the tbXdump routines can be destructive when used on a running system After using css snap to...

Page 74: ...emoves the 12 volt power from the supervisor card 3 Reinsert the supervisor harness to perform the supervisor card self test 4 Check green and yellow LEDs on front of the unit This self test should in...

Page 75: ...Frame Status tab is selected 4 The Controller responds attribute displays the status of the frame supervisor v OK displayed in a green box indicates that the frame supervisor is responding v No respon...

Page 76: ...From an AIX window enter spmon G m i framex spmon G m 1 framex spmon G m 2 framex spmon G m 3 framex 2 Topology file method a From an AIX window enter Eclock The display will tell you the current cloc...

Page 77: ...stomer to use the switch feature during extended repair action The customer must stop all parallel jobs prior to starting the repair Once the repair is complete the customer must stop all parallel job...

Page 78: ...possible use See Selecting appropriate switch clocks on page 3 6 9 The customer can re initialize the switch using the Estart command Cables connected to the switch assembly and processor nodes which...

Page 79: ...chassis sleeve by pushing on the inner chassis from the rear of the switch assembly Replacing a switch assembly from service position 1 If the inner chassis or supervisor power cable needed to be repl...

Page 80: ...ter Bootlist panel d Choose Normal Mode e Choose Alter Current Bootlist f Set the bootlist the way it was before the node was serviced 8 Close the console window 9 On the control workstation set the n...

Page 81: ...orkstation a Insert the diskette in the control workstation diskette drive b Log on as root c Select a name in a temporary directory to store the microcode image such as tmp microcode or tmp escon d b...

Page 82: ...ns repeat the microcode download If unsuccessful replace the adapter 7133 Disks can also be updated however the method varies depending upon which disks are attached If they are 4 5 GB or 9 1 GB Scorp...

Page 83: ...on these components This chapter describes the removal and replacement of RS 6000 SP product specific Field Replaceable Unit FRU components Handling static sensitive devices Attention Adapters planar...

Page 84: ...ch assembly to Off 0 3 Detach all cables from rear of switch assembly noting where external frame cables are attached If wrap plugs are installed remove them and save for the new switch 4 If this is a...

Page 85: ...SP Switch assembly 1 Transfer shock mounts from the old fan to the new fan 2 Using another fan as an example route the fan cable and orient the fan with airflow indicator pointing toward the rear of t...

Page 86: ...l procedure Route cable along raceway hooking retaining material where needed and plugging Fan connectors P2 P3 P4 P5 and P6 Plug connectors P7 P8 and P9 2 Perform Replacing a switch assembly from ser...

Page 87: ...tive devices on page 4 1 before removing or installing ESD sensitive devices Perform these procedures to remove the supervisor power cable from an SP Switch assembly 1 Perform Placing a switch assembl...

Page 88: ...assembly from the service position Removing the switch power cards Note Refer to Handling static sensitive devices on page 4 1 before removing or installing ESD sensitive devices Attention The hexhea...

Page 89: ...power supply card 2 Rotate card thumb locks inward to seat card 3 Plug connector P4 PS1 or P6 PS2 4 Perform Replacing a switch assembly from service position on page 3 9 to remove the switch assembly...

Page 90: ...4 8 RS 6000 SP SP Switch Service Guide...

Page 91: ...ture view 2 5 4 SPS SPS 8 Switch assembly feature view 3 5 6 Switch cables feature 5 8 Multi switch frame F C 2030 1 5 10 This chapter presents the Parts Catalog listing all RS 6000 SP Switch parts an...

Page 92: ...SPS SPS 8 Switch assembly feature view 1 5 2 RS 6000 SP SP Switch Service Guide...

Page 93: ...itch assembly reference only 1 26H7255 1 Front chassis assembly 2 77G0961 1 Card power 3 46H9305 1 Card switch supervisor 4 26H7212 2 Screw hex Hd M4 x 6 5 26H7395 1 Fan assembly 6 84X4841 2 Nut hex M...

Page 94: ...SPS SPS 8 Switch assembly feature view 2 5 4 RS 6000 SP SP Switch Service Guide...

Page 95: ...SPS 8 Switch assembly reference only 1 11P0655 1 Inner chassis assembly SPS includes all assembly in shaded area 1 11P0656 1 Inner chassis assembly SPS 8 includes all assembly in shaded area 2 1624766...

Page 96: ...SPS SPS 8 Switch assembly feature view 3 8 7 6 5 4 3 2 1 Air flow 5 6 RS 6000 SP SP Switch Service Guide...

Page 97: ...ont chassis 2 32G1547 1 Screw hex M4 x 5 3 46H9778 2 Cup guide 2 01 m order kit 3 77G1079 2 Pin guide 2 01 m order kit 3 46H9778 2 Cup guide new style 3 46H9779 2 Pin guide new style 3 51H9428 2 Kit c...

Page 98: ...witch data node 13 2110 mm 11J6104 AR Cable Switch data node 14 2165 mm 11J6105 AR Cable Switch data node 15 2165 mm 11J6106 AR Cable Switch data node 16 2310 mm 11P0006 AR Cable Switch data node xx 2...

Page 99: ...Chapter 5 Parts catalog 5 9...

Page 100: ...Multi switch frame F C 2030 1 5 10 RS 6000 SP SP Switch Service Guide...

Page 101: ...G2877 4 Panel Switch Blank 8 54G2947 4 Panel Blank 7 inch 9 1624776 18 Screw Hex Fl Hd M5 x 12 10 26H7198 1 Extender Frame 11 08J5557 4 Chocks Rubber 12 04H9469 6 Duct Long 11J5189 1 Cable 48 V dc fra...

Page 102: ...5 12 RS 6000 SP SP Switch Service Guide...

Page 103: ...om or any other country where such provisions are inconsistent with local law INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION AS IS WITHOUT WARRANTY OF ANY KIND EITHER EXPRESS OR...

Page 104: ...on European Union EU statement This product is in conformity with the protection requirements of EU Council Directive 89 336 EEC on the approximation of the laws of the Member States relating to elect...

Page 105: ...ll be required to take adequate measures Radio protection for Germany Dieses Ger t ist berechtigt in bereinstimmung mit Dem deutschen EMVG vom 9 Nov 92 das EG Konformit tszeichen zu f hren Der Ausstel...

Page 106: ...A 4 RS 6000 SP SP Switch Service Guide...

Page 107: ...5 5 77G1079 5 7 81F7977 5 7 84X4841 5 3 93G1065 5 11 A active configuration removing a switch assembly from the 3 7 active configuration restoring a switch assembly to 3 8 adapter microcode packages i...

Page 108: ...ation tests using 3 4 placing a SPS assembly into service position 3 9 Procedures ESD 3 1 purpose of book xv task procedures overview xv R rear view of frame locations 2 5 removing 4 1 switch assembly...

Page 109: ...ctive configuration restoring 3 8 switch assembly removing 4 2 switch assembly replacing 4 2 switch cables feature 5 8 switch clock source determining the correct 3 6 switch clock source selecting the...

Page 110: ...X 4 RS 6000 SP SP Switch Service Guide...

Page 111: ...atisfied Satisfied Neutral Dissatisfied Very Dissatisfied Accurate h h h h h Complete h h h h h Easy to find h h h h h Easy to understand h h h h h Well organized h h h h h Applicable to your tasks h...

Page 112: ..._ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _...

Page 113: ......

Page 114: ...IBM GA22 7443 04...

Reviews:

No comments

Brands by name

Popular brands

Load more brands