manualshive.com logo in svg

Cray CS400-AC, Replacement Procedures, Page: 6 / 49

Share
Download
Cray CS400-AC Replacement Procedures Download Page 6

Part Number

Description

22302-0412-10

GPU Node IFB, 4U K20/40 GB522N, 2 GPU Hot-Swap, KP

22302-0412-20

GPU Node IFB, 4U K80 GB522N, 2 GPU Hot-Swap, KP

22302-0402-02

GPU Bridge Board/Riser, GB522 Expansion Blade, (MIC/PHI, K20/K40, K80)

22303-0082-01

GPU Front PCBA/LED/push button switch assembly (MIC/PHI, K20/K40, K80 expansion

blades)

101210300

Chassis, GB522M Expansion Blade, with cover/cables/brackets, up to 2X MIC/PHI (not incl.)

101210400

Chassis, GB522N Expansion Blade, with cover/cables/brackets, up to 2X K20/K40 (not incl.)

101210500

Chassis, GB522N Expansion Blade, with cover/cables/brackets, up to 2X K80 (not incl.)

100972402

GPU Card, TESLA ATLAS K40 12GB 235W Passive

101142501

GPU Card, STELLA DUO K80 24GB 300W Passive

130-00149A

MIC Card, XEON PHI 7120P Passive 61C 1.25GHZ 16GB 300W

Rackmount Servers (2U)

101137200

Chassis, 2828X, 2U S2600WT2 dual Xeon 8X 2.5" HDD, up to 2X 1100W (Intel: 936032,

R2208WT2YS)

101125300

Chassis, 2828X, 2U S2600WTT dual Xeon 8X 3.5" HDD, up to 2X 1100W (Intel: 936035,

R2308WTTYS)

101142900

Power supply, 1100W, 80+ platinum (2828X)

150-00145A

Power supply, 1600W, 80+ platinum (2820XT)

190-00137A

Rail kit, 1U/2U, full extension & tool-less, 609.6-762MM 800MM MAX (2828X)

100993600

RMM4 lite remote management module, KVM

Motherboards, DIMMs and Processors

101123200

Intel Kennedy Pass motherboard, dual Xeon Haswell, 8X DIMM, FDR IB (Connect-IB) on-

board

101132800

Intel Kennedy Pass motherboard, dual Xeon Haswell, 8X DIMM, (No InfiniBand on-board)

101123800

Intel Taylor Pass motherboard, dual Xeon Haswell, 16X DIMM, QSFP FDR IB

101132900

Intel Taylor Pass motherboard, dual Xeon Haswell, 16X DIMM, (No InfiniBand on-board)

101181500

Heatsink, 1U Passive, Std - 91.5 x 91.5, 47 fins, AL base, heatpiped/copper fins

101181600

Heatsink, 1U Passive, Wide - 91.5 x 110, 57 fins AL base, heatpiped/copper fins

167-00509A

Battery backup, RAID smart lithium-ion 1500 mAh

100944700

DIMM, 8GB DDR4-2133 Reg dual rank 2RX8

100961800

DIMM, 16GB DDR4-2133 Reg dual rank ECC 1.2V 1GX4

100961801

DIMM FRU,16GB DDR4-2133 REG DUAL RANK ECC 1.2V 1GX4 (HYNIX)

100961802

DIMM FRU,16GB DDR4-2133 REG DUAL RANK ECC 1.2V 1GX4 (SAMSUNG)

101107700

DIMM, 32GB DDR4-2133 Reg dual rank ECC 1.2V 1GX4

CCS Parts Repair and Replacement

HR90-2009 

 

 6

CS400-AC Hardware Replacement Procedures

Summary of Contents for CS400-AC

Page 1: ...CS400 AC Hardware Replacement Procedures HR90 2009...

Page 2: ...N Replacement Procedures 23 GB522MN Expansion Blade Removal 23 GB522MN Cover Removal 24 GB522MN Cover Installation 25 GB522MN Separate Join Expansion and Compute Blades 25 GB522M and GB522N Exploded...

Page 3: ...a portion of the smock s sleeves in direct contact with the skin of your arms Skin contact is essential for a dissipative path to earth ground through your wrist strap Tuck hair that exceeds shoulder...

Page 4: ...efined in the Cray Cluster Supercomputer Support Operations Handbook Troubleshooting Procedures and Requirements Cray Service provides detailed troubleshooting requirements and procedures to diagnose...

Page 5: ...assis GB522N expansion blade up to 2X K80 101195200 Chassis GB822XA 6X 2 5 HDD bay 002 00372B Fan module assembly air cooled systems for SR5110 SR8204 SR8116 subracks 23101 0295 01 Fan module replacem...

Page 6: ...y 1100W 80 platinum 2828X 150 00145A Power supply 1600W 80 platinum 2820XT 190 00137A Rail kit 1U 2U full extension tool less 609 6 762MM 800MM MAX 2828X 100993600 RMM4 lite remote management module K...

Page 7: ...SSD 2 5 6 Gb s 20nm Intel S3500 101178700 Disk drive SATA 300 GB SSD 2 5 6 Gb s 20nm Intel S3500 101125800 Disk drive SAS 300GB 10K 6 2 5 6Gb s 64MB Savvio 101178800 Disk drive SATA 800 GB SSD 2 5 6...

Page 8: ...nm MLC HHHL P3600 101267300 PCIe3 0 1 6 TB SSD 1 2 height 20 nm MLC HHHL P3600 101268500 PCIe3 0 x16 HCA ConnectX 4 VPI single port QSFP EDR 100 Gb s InfiniBand 101278400 PCIe3 0 x16 HCA ConnectX 4 VP...

Page 9: ...ord C14 to C13 17AWG 10A 250V 1 2 m 4 ft 085 00361A Power cord C14 to C13 17AWG 10A 250V 1 8 m 6 ft 085 00360A Power cord C14 to C13 17AWG 10A 250V 3 0 m 10 ft 085 00294A Power cord C14 to C19 14AWG 1...

Page 10: ...9 C14 to C19 250 V 14 AWG 1 8 m 6 ft 15 A 3 0 m 10 ft 13 A 1 5 m 59 in C14 to C13 250 V 10 A 17 AWG 1 2 m 47 in C14 C13 3 0 m 10 ft 1 8 m 6 ft 1 5 m 59 in LS25 to LS26 250 277 V LS 25 LS 26 1 2 m 47 i...

Page 11: ...GreenBlade chassis The following custom Intel and Mellanox PCI brackets are available for popular expansion add on cards If a bracket is not listed for the card that you want to add please contact yo...

Page 12: ...TCBT FCBT Brkt 004 01318A 51010 2396 10 Brkt Gasket Kit 002 00398A 90301 0411 00 Mellanox ConnectX 3 MCX353A QCBT Brkt 004 01222C 51010 2395 02 Mellanox Connect IB ConnectX 2 3 MCB192A FCAT MCB194A FC...

Page 13: ...arches or other lists GB522 Overview Video GB522 Blade Overview 5 52 GB522 Compute Blade Videos Remove and Install Blade Remove and Install Cover Replace Disk Drive Replace Motherboard 4 55 Remove CPU...

Page 14: ...Short instructional videos for many of the GB522X replacement procedures are available Refer to this page for a complete list of all the videos GB522 Overview and Replacement Videos on page 13 GB522X...

Page 15: ...lade 3 Connect the cables to the GB522X boot the operating system and close the rear doors of the cabinet GB522X Cover Removal 1 Remove the screw that secures the cover to the chassis Refer to the fol...

Page 16: ...R D TH E RE AR TO W ARD THE REAR GB522X Exploded Views The following three exploded views of GB522X models show the internal components of each chassis Refer to these illustrations when replacing comp...

Page 17: ...GB522X Replacement Procedures HR90 2009 17 CS400 AC Hardware Replacement Procedures...

Page 18: ...rt Numbers on page 5 for available PCIe add on cards Refer to PCI Card Brackets for a list of mounting brackets to be used with the available PCIe add on cards About this task This procedure describes...

Page 19: ...et is needed to install most PCI cards into a GreenBlade chassis Cray has custom brackets and EMI gaskets for supported add on cards EMI gasket Remove manufacturer s bracket 4 Attach the slot 1 PCI ri...

Page 20: ...efer to the corresponding number in the figure for each procedure GB522X SSD Replacement High Mount Bracket Removal 1 Remove the GreenBlade chassis from the subrack and place it on a stable ESD safe w...

Page 21: ...SD and attach it to the bracket with the four M3 x 4 0 screws 9 Attach the high mount bracket drive assembly to the chassis 10 Connect the SATA signal and power connectors GB522X HDD Replacement First...

Page 22: ...depending on the HDD model 5 Remove the HDD from the drive bracket Installation 6 Install the replacement HDD and attach it to the drive bracket with the four M3 x 4 0 screws 7 Position the HDD brack...

Page 23: ...Exploded Views GPU Coprocessor Replacement NOTE Short instructional videos for many of the GB522M N replacement procedures are available Refer to this page for a complete list of all the videos GB522...

Page 24: ...emove the two screws that secure the cover to the expansion chassis Refer to the following figure 2 Press down on the latch button and slide the cover toward the rear of the chassis 3 Lift and remove...

Page 25: ...xpansion blade The cutouts on the side fit around the pins rivets inside the chassis The pins on the underside of the cover fit into the recesses in the rear panel 2 Slide the cover forward until it l...

Page 26: ...A R D T H E R E A R Remove 6 screws 2 Unseat the connectors at the front handle end of the blade first 3 Then unseat the connectors at the rear of the blade 4 Pull the blades apart by lifting the exp...

Page 27: ...rear connectors Lift straight up Pull blades apart Bridge board PCIe Join the Blades 1 Position the expansion blade over the compute blade and line up the PCI connectors and chassis guides 2 Mate each...

Page 28: ...ures These detailed exploded views show screw locations component placement and the intended assembly of components Detailed step by step information describing the location of components and screws f...

Page 29: ...ssembly 10P to 8P 6P GPU gasket GB522 GPU bridge board KP Air duct GPU bracket MIC coprocessor card MIC GPU mounting bracket front GB522M MIC chassis assembly GPU front LED switch cable assembly Power...

Page 30: ...mbly Power connector rear GPU 6P CS GB 522N GPU Coprocessor Replacement Refer to the exploded views of the expansion blades when following these procedures GB522M and GB522N Exploded Views on page 28...

Page 31: ...d rear GreenBlade mounting brackets to the replacement GPU Coprocessor 3 Connect the power cable connector s to the GPU Coprocessor do this before placing the card in the chassis 4 Position the GPU Co...

Page 32: ...enBlade chassis Refer to GB522X Exploded Views on page 16 Motherboards are shipped without DIMMs processors or heatsinks installed We recommend swapping DIMMs processors and heatsinks from the defecti...

Page 33: ...ve the blank InfiniBand IB cover from the front panel 3 Check that an EMI gasket is in position on the inside of the front panel 4 Check that a motherboard insulator is in position in the bottom of th...

Page 34: ...shipped with processors installed Processors heatsinks and memory DIMMs must be removed from the defective motherboard and installed on the replacement motherboard Remove Heatsink The heatsink is atta...

Page 35: ...hol 6 Clean the processor with a new cloth dampened with isopropyl alcohol Take your time to prevent any alcohol or thermal paste debris from contaminating the processor socket 7 Use a dry cloth to dr...

Page 36: ...r needs to be removed in the future Socket with processor 10 Remove the processor Cray Service recommends using a vacuum pen to install and remove processors a Carefully lift the processor out of the...

Page 37: ...sor into the socket Hold the processor down with your finger as you release the vacuum pencil 12 Close the load plate Carefully lower the load plate down over the processor 13 Lock the load plate a Pu...

Page 38: ...lly tighten b Proceed to screw B and engage screw threads by giving it two rotations Continue by engaging screws C and D c Continue by giving each screw using the same pattern two rotations each time...

Page 39: ...stalled Processors heatsinks and DIMMs must be removed from the defective motherboard and installed on the replacement motherboard Remove DIMM 1 Press down on the DIMM latches to unseat the DIMM from...

Page 40: ...above the socket Align the notch on the bottom edge of the DIMM with the key in the DIMM socket 5 Insert the bottom edge of the DIMM into the socket A When the DIMM is inserted push down on the top ed...

Page 41: ...tallation CS400 AC Fan Assembly Replacement Prerequisites 002 00372B Fan module 22302 0270 01 Fan interface board 23101 0295 01 Dual fan assembly with wire harness About this task The figure below pro...

Page 42: ...is procedure describes how to replace either of the two printed circuit board assemblies PCBAs in an iSCB module Reverse the process to replace the PCBAs Note The two PCBAs are connected by a 28 pin c...

Page 43: ...3 screws from the I O network PCBA Gre enB lad e CO M Plugs into 9 pin connector on CPU board 002 00374C iSCB Module SR5110 SR8204 SR8116 PCBA CPU board 22309 0005 04 PCBA I O network board 22302 031...

Page 44: ...ane and power backplane in an SR5110 subrack Refer to the following exploded view of the SR5110 that shows screw locations and the intended assembly of parts N O D E N O D E Procedure 1 Power off all...

Page 45: ...is easier to remove the power backplane plate with attached power PCBA and air duct and midplane as a single unit There are 9 screws in the midplane The screw in the bottom middle of the midplane atta...

Page 46: ...CS400 Subrack SR5110 SR6110 SR8204 SR8116 sits on a pair of support brackets mounted to the rack These support brackets are included in all preconfigured Cray CS400 cluster supercomputer cabinets A s...

Page 47: ...t on a pair of support angles that are mounted to the rack The support angles create a shelf The subrack is secured to the vertical rails of the rack with two screws through the mounting holes of each...

Page 48: ...B module 7 Remove the PSUs 8 Remove all GB522X blades Subrack Removal Front 9 Remove the front bezel 10 Write down the positions of the three DIP switches This will make it easier to properly set the...

Page 49: ...face and onto the lift platform 2 Position the lift in front of the rack and set the brake 3 Remove any blank filler panel s 4 Carefully slide the subrack off the lift platform and onto the support an...

Reviews:

No comments