manualshive.com logo in svg

Silicon Graphics Origin 350, User Manual

Share
Download
Silicon Graphics Origin 350 User Manual Download Page 173

007-4566-001

147

Chapter 5

5.

NUMAlink Module

This chapter describes the function and physical components of the NUMAlink module
in the following sections:

•

“Overview” on page 147

•

“External Components” on page 149

•

“Technical Specifications” on page 153

Overview

The NUMAlink module is a high-speed switch that routes network packets between
compute modules, MPX modules, and PCI expansion modules. The NUMAlink module
consists of eight ports. Four ports can connect to compute modules and/or MPX
modules. The other four ports, which carry USB signals, can connect to compute
modules, MPX modules, and/or PCI expansion modules.

Note:

The USB signals enable the compute modules, MPX modules, and PCI expansion

modules to communicate with the L2 controller. The compute modules and/or MPX
modules that connect to the four ports that do not carry USB signals communicate with
the L2 controller directly or via a USB hub.

Summary of Contents for Origin 350

Page 1: ...SGI Origin 350 Server System User s Guide 007 4566 001 ...

Page 2: ...t the prior written permission of Silicon Graphics Inc LIMITED RIGHTS LEGEND The electronic software version of this document was developed at private expense if acquired under an agreement with the USA government or any contractor thereto it is acquired as commercial computer software subject to the provisions of its applicable license agreement as specified in a 48 CFR 12 212 of the FAR or if ac...

Page 3: ...007 4566 001 iii Record of Revision Version Description 001 June 2003 Original publication ...

Page 4: ......

Page 5: ...utions 4 Safety Measures 4 Installing a Rack 5 Preinstallation Activities 6 Site Plan Verification 6 Tools Required 7 Power Receptacle Verification 7 Unloading and Moving System Equipment 10 Unloading the Equipment from the Truck 10 Inspecting the Shipping Crate 12 Transporting the Shipping Crate 13 Removing a Short Rack from the Shipping Crate 13 Removing a Tall Rack from the Shipping Crate 16 Po...

Page 6: ...le on Slide Rails from a Rack 39 Rackmounting Modules with Shelf Rails 42 Removing a Module on Shelf Rails from a Rack 44 Cabling the System Modules to Each Other 45 Cabling the Server System to a Power Source 48 Connecting a Single module or Dual module Server System to a Power Source 48 Connecting a Multiple module Server System to a Power Source 49 Connecting the System Console 51 Operating the...

Page 7: ...I Expansion Devices 87 Storage Expansion 89 SGI TP900 Storage Module 90 2Gb SGI TP9100 Storage System 91 SGI TP9400 and SGI TP9500 Storage Systems 93 Tape Devices 94 L2 Controller 97 USB Hub 99 Power Components 99 Rack 103 3 Compute Module 107 System Features 108 IP53 Node Board 114 Processors CPUs 115 Primary and Secondary Cache 116 Local Memory DIMMs 116 Bedrock ASIC 119 IO9 Card 119 Interface B...

Page 8: ... Interface Board 138 PCI Riser Card 138 Power Supplies 139 External Components 139 Front Panel Items 139 Rear Panel Items 140 System Configurations 142 Internal Configurations 142 External Configurations 143 Technical Specifications 146 5 NUMAlink Module 147 Overview 147 External Components 149 Front Panel Components 149 Rear Panel Components 151 Technical Specifications 153 6 Installing and Remov...

Page 9: ... L1 Controller Error Messages 206 SGI Electronic Support 208 A Technical Specifications 211 Environmental System Specifications 212 Compute Module Specifications 213 MPX Module Specifications 215 PCI Expansion Module Specifications 216 NUMAlink Module Specifications 217 Rack Specifications 218 SGI TP900 Storage Module Specifications 219 Power Bay Module Specifications 220 USB Hub Specifications 22...

Page 10: ...nformation 237 Manufacturer s Regulatory Declarations 237 Server Model Number 237 CE Notice and Manufacturer s Declaration of Conformity 237 Electromagnetic Emissions 238 FCC Notice USA Only 238 Industry Canada Notice Canada Only 239 VCCI Notice Japan Only 239 Chinese Class A Regulatory Notice 239 Korean Class A Regulatory Notice 239 Shielded Cables 240 Electrostatic Discharge 240 Laser Compliance...

Page 11: ...g the Chassis Rail from the Slide Rail 28 Figure 1 13 Attaching the Rear Mounting Bracket to the Slide Rail 29 Figure 1 14 Attaching Chassis Rails to the Module Chassis 30 Figure 1 15 Mounting Hole Pattern of Rack Vertical Rails 31 Figure 1 16 Placing the Barnuts on the Rack Rails 33 Figure 1 17 Attaching the Slide Rail to the Rack 34 Figure 1 18 Installing Clip Nuts in Rack Rails 35 Figure 1 19 P...

Page 12: ...Alink Module 74 Figure 2 6 Examples of Base Configurations in 17U and 39U Racks 77 Figure 2 7 Examples of NUMAlink Configurations in 17U and 39U Racks 79 Figure 2 8 Component Example of NUMAlink Configuration 82 Figure 2 9 Front and Rear Views of Compute Module 84 Figure 2 10 NUMAlink Module 85 Figure 2 11 MPX Module 86 Figure 2 12 PCI Expansion Module 88 Figure 2 13 PCI Card Slot Numbering on the...

Page 13: ...out 137 Figure 4 3 Front Panel Items 139 Figure 4 4 Rear Panel Items 141 Figure 4 5 System with One MPX Module and One Base Compute Module 144 Figure 4 6 System with PCI Expansion Module MPX Module NUMAlink Module System Expansion Compute Module and a Base Compute Module 145 Figure 5 1 Block Diagram of NUMAlink Module 148 Figure 5 2 Front View of NUMAlink Module 150 Figure 5 3 Rear View of NUMAlin...

Page 14: ...s 188 Figure 6 25 Opening Module Cover to Install DIMMs 190 Figure 6 26 Removing the Plastic Air Baffle 191 Figure 6 27 Inserting a DIMM 192 Figure 6 28 Opening Module to Remove DIMM 193 Figure 6 29 Removing the Plastic Air Baffle 194 Figure 6 30 Removing a DIMM 195 Figure 6 31 L1 Controller Display on Base Compute Module 196 Figure 6 32 Opening the Module to Access the L1 Controller Display 197 F...

Page 15: ...229 Figure A 9 Pin Number Locations for External SCSI Port 230 Figure A 10 Stereo Jack Connector Conductors 232 Figure A 11 Pin Number Locations for USB Type A Connector 233 Figure A 12 Pin Number Locations for USB Type B Connector 234 Figure A 13 Pin Number Locations for the PS 2 Keyboard and Mouse Connectors 235 ...

Page 16: ......

Page 17: ...ns 131 Table 4 1 DIMM Slots and Corresponding Bank Pairs 136 Table 4 2 Memory DIMM Specifications 137 Table 4 3 Bandwidth Characteristics of the MPX Module 146 Table 4 4 MPX Module Specifications 146 Table 5 1 NUMAlink Module Technical Specifications 153 Table 5 2 NUMAlink Module Port Specifications 153 Table 5 3 Bandwidth Characteristics of the NUMAlink Module 153 Table 6 1 LED Status and Power S...

Page 18: ...able A 13 Tall Rack Specifications 218 Table A 14 TP900 Storage Module Specifications 219 Table A 15 Power Bay Module Specifications 220 Table A 16 Power Supply Specifications 220 Table A 17 USB Hub Specifications 221 Table A 18 Compute Module Connectors 222 Table A 19 MPX Module Connectors 224 Table A 20 L2 Controller Connectors 225 Table A 21 Ethernet Connector Pin Assignments 229 Table A 22 SCS...

Page 19: ...is module The 4U PCI expansion module adds PCI slots but no processors no memory and no IO9 card There are two versions of the PCI expansion module one module has 12 PCI slots that support 3 3 V or universal PCI cards and the other module has 6 PCI slots that support 5 V or universal PCI cards and 6 slots that support 3 3 V or universal PCI cards For information about this module see PCI Expansion...

Page 20: ...ion Because the installation and removal of an IO9 PCI card which installs in the lowermost slot is more complicated and can cause damage to your system if not performed properly it can only be installed and removed by a trained SGI system support engineer Installing and removing disk drives Installing and removing power supplies Installing and removing DIMMs Installing and removing the L1 control...

Page 21: ...emove the following customer replaceable units CRUs PCI and PCI X cards disk drives power supplies memory DIMMs and the L1 system controller display Chapter 7 Troubleshooting describes how to troubleshoot your system by using the L1 controller and L1 controller messages and by reading your system LEDs Appendix A Technical Specifications contains environmental and physical specifications for the Or...

Page 22: ...ipped with system and available online 007 1364 xxx This is the complete reference guide on using the installation program inst to install software For information on using the Software Manager to install software see the online Personal System Administration Guide SGI L1 and L2 Controller Software User s Guide 007 3938 00x hard copy shipped with system and available online This guide describes th...

Page 23: ...information about man pages SGI systems include a set of IRIX man pages formatted in the standard UNIX man page style Important system configuration files and commands are documented on man pages These are found online on the internal system disk or CD ROM and are displayed using the man command For example to display the man page for the Add_disk command type the following on a command line man A...

Page 24: ...ds files routines path names signals messages and programming language structures variable The italic typeface denotes variable entries and words or concepts being defined Italic typeface is also used for book titles user input This fixed space font denotes literal items that the user enters in interactive sessions Output is shown in nonbold fixed space font Brackets enclose optional portions of a...

Page 25: ...each page You can contact SGI in any of the following ways Send e mail to the following address techpubs sgi com Use the Feedback option on the Technical Publications Library website http docs sgi com Contact your customer service representative and ask that an incident be filed in the SGI incident tracking system Send mail to the following address Technical Publications SGI 1600 Amphitheatre Pkwy...

Page 26: ......

Page 27: ...ack on page 5 Unpacking and Inspecting Server System Modules on page 23 Setting the Server System on a Table Top on page 23 Installing the Server System in a Rack on page 25 Note The rackmounting kit enables the module to be mounted in an SGI rack and in an industry standard 19 inch wide rack Cabling the System Modules to Each Other on page 45 Cabling the Server System to a Power Source on page 48...

Page 28: ... 48 Connecting the System Console on page 51 If you have ordered system modules and an empty rack or racks with the intention of rackmounting and cabling your own server system follow the instructions in these sections Safety Precautions on page 3 Installing a Rack on page 5 Unpacking and Inspecting Server System Modules on page 23 Installing the Server System in a Rack on page 25 Cabling the Syst...

Page 29: ...Console on page 51 Safety Precautions Before you install an Origin 350 server system you should familiarize yourself with the safety precautions discussed in the following subsections Hazard Statements on page 3 ESD Precautions on page 4 Safety Measures on page 4 Hazard Statements During the installation of the computer system be alert for hazard advisory statements with icons which signify the fo...

Page 30: ...ESD precautions during the entire installation process to eliminate possible ESD damage to the equipment Wear an SGI approved wrist strap when you handle an ESD sensitive device Connect the wrist strap cord directly to earth ground Caution Observe all ESD precautions Failure to do so can result in damage to the equipment Safety Measures Observe the following safety measures when you install the sy...

Page 31: ...cuit breakers to the OFF O position before you plug in the system power cord Warning Use the following guidelines to prevent the rack from toppling over Otherwise people could be seriously injured and or equipment could be damaged Follow these guidelines to prevent the rack from toppling over Make sure that only one module is extended out of the rack at one time Install all equipment in the lowest...

Page 32: ...ng and Inspecting Server System Modules on page 23 to begin your installation Preinstallation Activities Perform the following preinstallation activities days or weeks before you receive your system perform site verifications gather appropriate tools to complete the installation and ensure that the correct power receptacle is installed and properly wired These activities are explained in the follo...

Page 33: ... Set the voltmeter to a high AC voltage range 2 Check the voltage between socket X and socket Y see Figure 1 1 The meter should read between 200 and 240 VAC 3 Check the voltage between socket X and the ground socket The meter should read approximately 120 VAC 4 Check the voltage between socket Y and the ground socket The meter should read approximately 120 VAC 5 Check the voltage between the groun...

Page 34: ...esistance measured in step 7 is more than 1 ohm contact a site approved electrician Do not proceed with the installation Figure 1 1 30 amp Single phase Power Receptacle for North American Sites For international sites follow these steps to ensure that a single phase power receptacle is properly wired 1 Set the voltmeter to a high AC voltage range 2 Check the voltage between socket 1 and socket 2 s...

Page 35: ...to a low resistance setting 7 Measure between the ground socket and an appropriate earth ground location and ensure that resistance is less than 1 ohm 8 Repeat steps 1 through 7 for any additional single phase power receptacles Caution If a voltage reading is incorrect or if the resistance measured in step 7 is more than 1 ohm contact a site approved electrician Do not proceed with the installatio...

Page 36: ...ing the Equipment from the Truck on page 10 Inspecting the Shipping Crate on page 12 Transporting the Shipping Crate on page 13 Unloading the Equipment from the Truck If your loading dock is the same height as the transportation vehicle use a pallet jack to unload the system from the transportation vehicle The pallet jack should have 48 in tines or forks Follow any instructions that are printed on...

Page 37: ...hree people are available to help unload the equipment Move all crates slowly and carefully Figure 1 3 shows the lift openings and dimensions of a tall rack shipping crate This figure also shows where to position the pallet jack Figure 1 3 Dimensions of Tall Rack Shipping Crate Pallet jack position Side view End view 50 5 1524 mm 81 5 2070 1 mm 51 25 1301 75 mm 40 1016 mm ...

Page 38: ...t 1 Ensure that the crates and cartons arrive unopened 2 Inspect the shipping crate for signs of external damage such as dents holes crushed corners and water marks 3 Ensure that the tilt watch has not been tripped 4 If the crate is damaged file a damage claim with the carrier immediately In addition notify your local Customer Support Center CSC for any missing incorrect or damaged items For CSC c...

Page 39: ...events damage to the equipment that could result from thermal shock and condensation Removing a Short Rack from the Shipping Crate Warning Be careful when you unpack and move the short rack system Ensure that the rack remains on a level surface and that the rack weight remains evenly distributed across the four casters If you must lift the casters over an obstacle such as a door threshold use prop...

Page 40: ...or the bolts 7 Align the holes in the edge of the ramp with the pegs in the base of the crate Ensure that the ramp is secure 8 Remove the gate pins from the left and right ends of the gate Then remove the gate 9 Pull the rack down the ramp Warning The maximum weight of the short rack is 488 lb 221 kg Use caution when you roll the rack down the ramp ...

Page 41: ...Installing a Rack 007 4566 001 15 Figure 1 5 Removing a Short Rack from the Shipping Crate Peg ...

Page 42: ...environment in which you are installing it and that the system crate is in a stable upright position 2 Remove the bands that secure the crate Note Brace the wooden ramp as you remove the horizontal band that surrounds the crate and the wooden ramp The ramp moves freely after you remove this band 3 Place the ramp so that the three holes in the edge of the ramp align with the pegs in the base of the...

Page 43: ...en you roll the tall rack down the ramp Personal injury and system damage could result if the rack becomes unbalanced or gains too much momentum when it rolls down the ramp 7 Bolt the tip tray to the front of the rack before you move the rack to its designated location This tray prevents the rack from tipping while you move the rack ...

Page 44: ...peration Figure 1 6 Removing a Tall Rack from the Shipping Crate 3 Pegs Ramp 4 Cardboard sidewalls Foam cushion Cardboard cover 5b Front mounting bracket Tip tray Bolt Front mounting bracket 5c Bolt Rear mounting bracket 5a Tip tray 7 6 2 ...

Page 45: ...ngle rack system follow these steps 1 Grasp the rear of the rack and roll the rack to its designated location 2 Remove the ESD bag 3 If you are installing a tall rack adjust the leveling bolts as shown in Figure 1 7 until the rack is level Figure 1 7 Leveling Bolts 4 Ensure that the circuit breaker on the power distribution unit is in the OFF O position Then connect the power cord to a grounded po...

Page 46: ...e downs Figure 1 8 Seismic Tie down Attachment Points Positioning and Leveling a Multiple rack Clustered System Caution To avoid ESD damage to the electronic components be sure to position the racks before you remove the ESD bags that cover the rack assemblies To position and level a multiple rack clustered system follow these steps 1 Grasp the rear of each rack and roll the rack to its designated...

Page 47: ... in Figure 1 10 6 If your system has additional racks repeat steps 4 and 5 until all of the racks are bolted together 7 Ensure that the circuit breakers on the power distribution units are in the OFF O position Then connect the power cords to grounded power outlets Plugging in the power cords grounds the racks 8 Secure the racks with seismic tie downs if you are installing the system in an earthqu...

Page 48: ...22 007 4566 001 1 Installation and Operation Figure 1 10 Joining Locations Joining holes of Location 1 Location 2 Location 3 location 4 Strap Washer Screw ...

Page 49: ...ion notify your local Customer Support Center CSC for any missing incorrect or damaged items For CSC contact information see http www sgi com support supportcenters html Setting the Server System on a Table Top If your server system is a single module the base compute module system or a dual module a base compute module cabled to an MPX module for example system and you choose to operate it on a t...

Page 50: ...24 007 4566 001 1 Installation and Operation Figure 1 11 Location of Table mounting Feet ...

Page 51: ...e Rails on page 25 Removing a Module on Slide Rails from a Rack on page 39 Rackmounting Modules with Shelf Rails on page 42 Removing a Module on Shelf Rails from a Rack on page 44 Rackmounting Modules with Slide Rails This section describes how to rackmount modules with slide rail assemblies You can use the instructions to rackmount base compute modules system expansion compute modules and MPX mod...

Page 52: ...er the system has one or two power supplies on the amount of DIMMs installed and on whether you have one or two disk drives in your system Required front clearance for module 8 25 in 20 96 cm Required rear clearance for module 10 in 25 40 cm Required side clearance for module 6 in 15 24 cm right side No clearance requirement for left side Required front clearance for rack 36 in 91 cm Required rear...

Page 53: ...d the rear mounting brackets from the shipping container 2 Extend each slide rail assembly until the safety latch snaps into place 3 Press the safety latch and remove the chassis rail from the slide rail as shown in Figure 1 12 10 32 x 1 2 in Phillips screw Shoulder washer Barnut 8 8 4 Secures the slide rails to the rack rails 10 32 x 1 2 in Phillips screw Barnut 4 2 Secures the slide rails to the...

Page 54: ...position of the mounting bracket on the slide rail according to the depth of the rack 5 Place a barnut next to the mounting bracket Secure the mounting bracket to the slide rail by inserting two 10 32 x 1 2 in screws through the assembly and into the barnut as shown in Figure 1 13 6 Repeat steps 4 and 5 to attach a mounting bracket to the other slide rail Safety latch Safety latch Slide rail Chass...

Page 55: ...Installing the Server System in a Rack 007 4566 001 29 Figure 1 13 Attaching the Rear Mounting Bracket to the Slide Rail Rear mounting bracket Slide rail Barnut ...

Page 56: ...to the right side of the module chassis Ensure that the rail is installed in the correct direction see Figure 1 14 Caution Use only the 1 4 in 0 64 cm length screws Longer screws damage internal components in the module 3 Using five 10 24 x 1 4 in screws attach the second rail to the left side of the module chassis Again ensure that the rail is installed in the correct direction Figure 1 14 Attach...

Page 57: ...e top mounting hole in the 2U space is hole 6 See Figure 1 15 Note A module in the rack is identified by the lowest U number that it occupies For example in Figure 1 15 the module resides in U5 the fifth unit within the rack Figure 1 15 Mounting Hole Pattern of Rack Vertical Rails To determine how many mounting holes you must count use the following formula 3 x the lowest U number that the module ...

Page 58: ...ulder washers and four barnuts 2 Place one of the barnuts inside the rack and align it with the second and third holes of the selected 2U of space see Figure 1 16 Note The holes in the barnuts are not centered The barnuts need to be placed in such a way that the holes are closest to the inside edge of the rack rails See Figure 1 16 3 Insert two screws with shoulder washers through the rack rail to...

Page 59: ...Installing the Server System in a Rack 007 4566 001 33 Figure 1 16 Placing the Barnuts on the Rack Rails Barnut 3 2 1 4 5 6 3 2 1 4 5 6 2U of space Inside edge ...

Page 60: ...he screws on the front and rear end of the rails Do not tighten firmly at this point because all screws will be firmly tightened once the module is installed in the rack 7 Repeat steps 5 and 6 to attach the second slide rail to the other side of the rack Figure 1 17 Attaching the Slide Rail to the Rack 3 2 1 4 5 6 7 3 2 1 4 5 6 7 Tighten screws Slide rail assembly Rack rail Barnut ...

Page 61: ...ck Rails Clip nuts secure the modules to the rack To install the clip nuts slide the clip nuts over the fifth hole of the selected 2U of space on each of the front rails See Figure 1 18 for details Figure 1 18 Installing Clip Nuts in Rack Rails 2 3 4 5 6 7 1 8 2U space 5th hole 5 6 ...

Page 62: ...place 2 With one person holding each side of the module align the chassis rails of the module with the slide rails of the rack 3 Slide the chassis rails into the slide rails until the chassis rails are stopped by the safety latches 4 Press the safety latches on both sides of the module to fully seat the chassis rails into the slide rails see Figure 1 19 5 Firmly tighten all screws the eight screws...

Page 63: ...Installing the Server System in a Rack 007 4566 001 37 Figure 1 19 Pressing the Safety Latches 2 3 4 5 6 1 Safety latch Slide rail extended locked in place 2 3 4 5 6 1 Safety latch Push latches ...

Page 64: ...Once the module is installed in the rack you can adjust the position of the module in the rack upward and sideways To adjust the position of the module loosen the front mounting screws adjust the module to the desired position and then tighten the mounting screws Caution Do not lift the module by its bezel it is not designed to handle the weight of the module Instead use the chassis ears to move t...

Page 65: ...at the rear of the module Warning Components may be hot To avoid injury allow the components to cool for approximately five minutes before you proceed with these instructions 3 Remove the two screws that secure the module to the front rails of the rack 4 Carefully pull the module from the rack until it is stopped by the safety latches 5 With one person holding each side release the safety latches ...

Page 66: ...40 007 4566 001 1 Installation and Operation Figure 1 21 Releasing the Safety Latches 2 3 4 5 6 1 Safety latch Slide extended locked in place 2 3 4 5 6 1 Safety latch Push latches ...

Page 67: ...e the slide rails back into the rack push down on the slide latches as shown in Figure 1 22 Note Before you can reinstall a module into the rack fully extend the slide rails from the rack until they lock into place Figure 1 22 Releasing the Slide Latches Slide latch ...

Page 68: ...p 1 position the left shelf rail at a 90 degree angle to the front and rear rack rails see Figure 1 23 3 Insert the top front bracket tab into one of the narrow slots in the front rack rail 4 Insert the top rear bracket tab into the narrow slot in the rear rack rail Note Verify that the tabs are the same height to ensure that the module is level in the rack 5 Lower the bottom of the shelf rail unt...

Page 69: ... the rack until the module ears are snug against the rack rails See Figure 1 24 10 Fasten the module to the front rails of the rack with the screws and clip nuts provided See Figure 1 24 11 Fasten the module to the rear rails of the rack with the screws and clip nuts provided Front rear bracket tabs Rail Shelf rail Shelf rail Rear view Push in fasteners Torx screws EMI gasket bracket ...

Page 70: ... Powering the Server System On and Off on page 53 2 Disconnect all of the cables at the rear of the module Warning Components may be hot To avoid injury allow the components to cool for approximately five minutes before you proceed with these instructions 3 Remove the two screws and clip nuts that secure the module to the front rails of the rack 4 Remove the two screws and clip nuts that secure th...

Page 71: ...e up of a single module you can skip this section and proceed to Cabling the Server System to a Power Source on page 48 for instructions to connect your system to power Cabling two modules to each other that consist of a base compute module and a module to expand the server system s functionality such as a system expansion compute module entails connecting a cable from base compute module s NUMAli...

Page 72: ...NUMAlink 3 cable the NUMAlink port of the top PCI expansion module connects to the NUMAlink module s 2 B port Using another NUMAlink 3 cable the NUMAlink port of the lower PCI expansion module connects to the NUMAlink module s 3 C port NUMAlink module Using a NUMAlink 3 cable the NUMAlink module s G 7 port connects to the system expansion compute module s NUMAlink port Using another NUMAlink 3 cab...

Page 73: ...tem Controller Fault 1 3 2 4 Console PCI expansion module PCI expansion module L2 controller SGIconsole Base compute module TP900 SCSI ports NUMAlink port NUMAlink port LAN2 port System expansion compute module NUMAlink module FAULT OUTPUT GOOD CHANNEL 2 CHANNEL 1 L1 PORT CB 1 PWR 48 VDC 12 VDC G F E D H A B C L1 port XIO NUMAlink XIO NUMAlink 7 6 5 4 8 1 2 3 ...

Page 74: ...Source If you are operating your server system on a table top connect the base compute module to a wall power receptacle If your module resides in a rack connect the module to a power distribution unit PDU or a power strip See Figure 1 27 for the location of the module s power connector Figure 1 27 Power Connector on the Rear of the Base Compute Module Figure 1 28 shows the connecting of a dual mo...

Page 75: ... section describes how to cable the multiple modules that make up a multiple module server system to a power source Figure 1 29 shows a sample of a multiple module server system that includes the following modules and other items L2 controller Two PCI expansion modules NUMAlink module System expansion compute module Base compute module TP900 storage module MPX module Base compute module ...

Page 76: ...r Source Power distribution unit PDU Power source USB hub Power adapter Components within rack FAU LT OU TPU T GO OD FAU LT OU TPU T GO OD I D RANG E CHANN EL 1 CHANN EL 2 I D RANG E CHANN EL 1 CHANN EL 2 System expansion compute module Base compute module PCI expansion module PCI expansion module TP900 storage module Power bay NUMAlink module L2 controller ...

Page 77: ... system console can be a server that runs the SGIconsole remote multiserver management system or a personal computer PC SGIconsole provides a central server control environment that has the following features Support for SGI clusters partitioned systems and large single system image servers Expandable to support additional servers Rackmountable space efficient platform Software applications and to...

Page 78: ...hat the circuit breaker of the power source is on 2 Power on the system console 3 Ensure that the system console has the following network settings Baud 38400 No parity 8 data bits 1 stop bit Hardware flow control on RTS CTS 4 Type cu l ttyd2 for an IRIX based console or cu l ttys0 S38400 for a Linux based console and then press Enter to display the L1 prompt If the console uses another operating ...

Page 79: ...individual module at a system console or manually as follows Preparing to Power On on page 53 Powering On at the System Console on page 54 Powering On Manually on page 56 Powering Off at the System Console on page 58 Powering Off Manually on page 59 Preparing to Power On To prepare to power on your system follow these steps 1 Confirm that all the modules and other system items are plugged in secur...

Page 80: ...owering On at the System Console To power on and boot your system using the system console follow these steps Note You must manually power on the TP900 storage module by placing the power switch es in the ON I position You must turn this module on before rebooting the system 1 If not yet done so connect a system console to the server system as described in Connecting the System Console on page 51 ...

Page 81: ...oller detects in the system and their system controller addresses If a module that you want to power on does not appear in the list it will not power on Ensure that the module s L1 controller is running and that the module is cabled properly 7 From the L2 prompt L2 power on an individual module by entering the following command If you want to power on the entire system proceed to Step 8 L2 r rack ...

Page 82: ...eyboard input from the L2 controller to the normal console by typing control d L2 ctrl d 10 When the power on procedure completes the following System Maintenance Menu appears on the system console System Maintenance Menu 1 Start System 2 Install System Software 3 Run Diagnostics 4 Recover System 5 Enter Command Monitor Option 11 Select option 1 Start System to boot the IRIX operating system Power...

Page 83: ...with LED in the front of the module to power on the rest of the module s internal components Note The Origin 350 base and AC powered NUMAlink modules do not have a power switch To power on their L1 controllers plug the modules to the PDU b For the TP900 storage module press the power button on its rear panel to ON I c For the MPX module the base compute module and the system expansion compute modu...

Page 84: ... L2 r rack s slot pwr d For example to power off an Origin 350 base compute module in rack 1 slot 18 enter the following command L2 r 1 s 18 pwr d The slot number is the unit number of the module within the rack If you want to power off several selected modules from the rack at the same time enter the rack number followed by the slot numbers of the modules that you want to power off For example to...

Page 85: ...r power switches on each of the modules that you want to power off You may power off the modules in any order For the PCI expansion module or DC NUMAlink module press the power switch on the module s rear panel to the OFF O position to turn off the module s L1 controller Then push on the On Off switch with LED in the front of the module to power off the rest of the module s internal components The...

Page 86: ...ser s Guide 007 3938 00x for more information on L1 commands To connect two Origin 350 server systems to each other with a NUMAlink 3 cable follow these steps 1 Power off both servers see Powering the Server System On and Off on page 53 2 Connect the NUMAlink 3 cable to the NUMAlink connectors on both servers 3 Connect a system console to the master server as described in Connecting the System Con...

Page 87: ...ervice required LED This LED illuminates yellow to indicate that an item is not functioning properly for example a fan is off but the server is still operating Failure LED This LED illuminates red to indicate that a failure has occurred and the server is down Power button Press this button to power on the server Alternatively you can power on the server system at a system console Reset button Pres...

Page 88: ... is directed to the L1 command processor Console mode from L1 Output from the system is visible and all input is directed to the system The L1 controller is ready to accept commands when you see a prompt of the following form 001c01 L1 See the SGI L1 and L2 Controller Software User s Guide 007 3938 00x for a detailed list of L1 commands Service required LED Reset Failure LED NMI Power button with ...

Page 89: ...l T as follows Ctrl T escaping to L1 system controller 001c01 L1 At this point you can enter any L1 command When the command completes execution the L1 returns to console mode re entering console mode 001c01 console CTRL T to escape to L1 To permanently engage the L1 mode press Ctrl T and then enter the l1 command as follows Ctrl T escaping to L1 system controller 001c01 L1 l1 L1 command processor...

Page 90: ......

Page 91: ...d architectural aspects of your SGI Origin 350 server system System configurations and components are described and illustrated This chapter includes the following sections Physical Features on page 66 Functional Architecture on page 68 System Configurations on page 75 System Components on page 80 ...

Page 92: ...ry and 62 PCI PCI X slots For most configurations the Origin 350 server system is housed in one 17U rack or one 39U rack as shown in Figure 2 1 however for small system configurations the Origin 350 server system can be placed on a table top Systems that are housed in 17U racks have a maximum weight of approximately 488 lb 221 kg The maximum weight of systems that are housed in 39U racks is approx...

Page 93: ...Physical Features 007 4566 001 67 Figure 2 1 Example of SGI Origin 350 Server Systems 17U rack 39U rack ...

Page 94: ...to 64 GB and enables every processor in a system direct access to every I O slot in the system Together the Bedrock ASICs and the NUMAlink interconnect enable efficient access to processors local and remote memory and I O devices without the bottlenecks associated with switches backplanes and other commodity interconnect technologies System scalability The NUMAflex architecture incorporates a low ...

Page 95: ...quently the slot third slot down which is on the same bus as the slot in which the IO9 PCI card is installed can only support a PCI card that runs at a speed of 66 MHz or slower Therefore the two uppermost slots can support PCI PCI X cards while the third one down can only support a PCI card One IO9 PCI card that comes factory installed in the lowermost PCI PCI X slot The IO9 card has a real time ...

Page 96: ...le see Compute Module on page 83 Figure 2 2 Base Compute Module Connected to an Expansion Compute Module 3 2 GB s full duplex 1 6 GB s each direction NUMAlink 3 channel Xtown2 channel 2 4 GB s full duplex 1 2 GB s each direction Memory Directory Bedrock 1 6 GB s 1 6 GB s 3 2 GB s CPU L2 L2 CPU CPU CPU L2 L2 PIC PCI bus 2 slot 2 PCI bus 2 slot 1 PCI bus 1 slot 2 PCI bus 1 slot 1 IO9 Ethernet port S...

Page 97: ...vice that can connect up to eight compute modules See Figure 2 3 Figure 2 3 Compute Modules Connected via a NUMAlink Module 3 2 GB s full duplex 1 6 GB s each direction NUMAlink 3 channels Port 5 Port 6 Router ASIC Port 3 Port 2 Port 1 Port 4 Port 8 Port 7 G H D F E C A B 4 processor expansion compute module 4 processor expansion compute module 4 processor expansion compute module 4 processor expa...

Page 98: ...reases the amount of memory by 1 GB to 8 GB To increase the number of PCI slots the base compute module can connect to a PCI expansion module The PCI expansion module is a 4U DC powered device that can have either 6 or 12 PCI slots 3 2 GB s full duplex 1 6 GB s each direction NUMAlink 3 channel Xtown2 channel 2 4 GB s full duplex 1 2 GB s each direction Memory Directory Bedrock 1 6 GB s 1 6 GB s 3...

Page 99: ...module via the NUMAlink connector If the system has a NUMAlink module the MPX and PCI expansion modules connect to the compute modules via the NUMAlink module see Figure 2 5 For more information about the MPX module see MPX Module on page 86 For more information about the PCI expansion module see PCI Expansion Devices on page 87 ...

Page 100: ...1 6 GB s each direction NUMAlink 3 channels Port 5 Port 6 Router ASIC Port 3 Port 2 Port 1 Port 4 Port 8 Port 7 G H D F E C A B MPX module MPX module PCI expansion module PCI expansion module 4 processor Expansion compute module 4 processor Expansion compute module 4 processor Expansion compute module 4 processor Base compute module NUMAlink module ...

Page 101: ...le Table 2 1 lists the minimum and maximum ranges of the configurable items for the base and NUMAlink configurations Table 2 1 Origin 350 Configuration Ranges Base Configuration Minimum Base Configuration Maximum NUMAlink Configuration Minimum NUMAlink Configuration Maximum Compute modules 1 2 2 8 Processors 2 8 4 32 Peak performance of R16000 processors 600 MHz 700 MHz 2 4 GFLOPS 2 8 GFLOPS 9 6 G...

Page 102: ...er you can add TP900 storage modules or storage racks to your system The components of the base configuration can be placed on a table top or housed in a 17U rack or a 39U rack Each rack can contain more than one system as shown in Figure 2 6 Storage device None Customer configurable None Customer configurable Compute rack None 1 1 1 L2 controller None 1 1 1 a Each compute module has four internal...

Page 103: ...pute module Base compute module Expansion compute module Base compute module Expansion compute module Base compute module Expansion compute module PCI expansion module 17U rack 39U rack TP900 storage module TP900 storage module Note The 17U rack contains two systems one system contains two compute modules and one storage device and the other system contains one compute module one PCI expansion mod...

Page 104: ...rts the following PCI expansion devices the MPX module and the PCI expansion module The number of each type of module is dependent on the following configuration rules A maximum of four MPX modules can reside in a NUMAlink configuration The number of PCI expansion modules cannot exceed the number of compute modules The total number of compute modules MPX modules and PCI expansion modules cannot ex...

Page 105: ... compute module NUMAlink module Base compute module Expansion compute module Expansion compute module Expansion compute module Expansion compute module Expansion compute module Expansion compute module Expansion compute module 17U rack 39U rack Note The 17U rack contains one system that contains four compute modules The 39U rack contains two systems one system contains eight compute modules and th...

Page 106: ... 81 Compute Module on page 83 NUMAlink Module on page 85 MPX Module on page 86 PCI Expansion Devices on page 87 Storage Expansion on page 89 L2 Controller on page 97 USB Hub on page 99 Power Components on page 99 Rack on page 103 Major Components of a Base Configuration The base configuration can contain the following major components Base compute module One of the following modules all are option...

Page 107: ...m or SGI TP9500 storage system optional Major Components of a NUMAlink Configuration The NUMAlink configuration can contain the following major components see Figure 2 8 17U or 39U rack with power distribution unit Base compute module NUMAlink module A combination of the following modules Note The total number of compute modules MPX modules and PCI expansion devices cannot exceed eight For example...

Page 108: ... a PCI expansion module One or more TP900 storage modules optional The maximum number of TP900s is dependent on the number of SCSI connections in the system each TP900 requires one SCSI connection 2Gb SGI TP9100 storage system SGI TP9400 storage system or SGI TP9500 storage system optional Figure 2 8 Component Example of NUMAlink Configuration Compute modules NUMAlink module Compute modules ...

Page 109: ...ves optional component of the expansion compute module DVD ROM optional The SCSI disk drives and the DVD ROM require an IO9 PCI card Note A compute module is not limited to two disk drives or four PCI PCI X slots The compute module can connect to external devices that expand the I O and storage capabilities For information about these devices see PCI Expansion Devices on page 87 Each compute modul...

Page 110: ...em Overview Figure 2 9 shows the front and rear views of an Origin 350 compute module See Chapter 3 Compute Module for more information about this module Figure 2 9 Front and Rear Views of Compute Module Rear view Front view ...

Page 111: ...ports can connect to four compute modules or four MPX modules The other four ports which carry USB signals can connect to compute modules MPX modules or PCI expansion modules The NUMAlink module also contains an L1 controller that provides the following services Controls and sequences power Controls and monitors the environment Initiates a reset Stores identification and configuration information ...

Page 112: ...ins one base compute module In a NUMAlink configuration you can add up to four MPX modules The MPX module also contains an L1 controller that provides the following services Controls and sequences power Controls and monitors the environment Initiates a reset Stores identification and configuration information See Chapter 4 Memory and PCI Expansion MPX Module for more information about the MPX modu...

Page 113: ...add one MPX module to your system In a NUMAlink configuration you can add up to four MPX modules See Chapter 4 Memory and PCI Expansion MPX Module for more information about the MPX module The PCI expansion module shown in Figure 2 12 contains six PCI buses buses 1 through 6 that can seat as many as twelve PCI cards Each bus has two PCI slots see Figure 2 13 on page 89 that are labeled 1 and 2 The...

Page 114: ...ules You can add three PCI expansion modules to a system that contains three to five compute modules You can add four PCI expansion modules to a system that contains four compute modules For more information about the PCI expansion module see PCI Expansion Module User s Guide 007 4499 00x Figure 2 12 PCI Expansion Module ...

Page 115: ...em interface JBOD just a bunch of disks solution SGI offers the TP900 storage module or SCSI disks can be added to expansion compute modules Note Adding SCSI disks to an expansion compute module requires an IO9 PCI card For a Fibre Channel solution that supports both JBOD and RAID configurations SGI offers the 2Gb SGI TP9100 storage system For Fibre Channel RAID solutions SGI offers the SGI TP9400...

Page 116: ...ane connects the 8 drives on one SCSI bus As an option the storage module can also be configured on two SCSI buses 2 strings of 4 drives This storage module has the following features It mounts in a standard 19 inch rack it is available in factory installed configurations It uses SCSI Parallel Interface 3 SPI 3 capable Low Profile 1 inch high 3 5 inch disk drives Its drive carriers accept SGI qual...

Page 117: ...tower or a rackmounted configuration You can start with a basic JBOD configuration and later add RAID controllers or you can start with a RAID configuration The 2Gb SGI TP9100 storage system connects to the compute module via a Fibre Channel PCI card For more information about the SGI TP9100 storage system see SGI Total Performance 9100 2 Gb TP9100 Storage System User s Guide 007 4522 00x FAULT OU...

Page 118: ...gi sgi sgi TP9100 sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi Deskside tower configuration TP9100 sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi TP9100 sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi sgi Rackmounted configuration ...

Page 119: ...isruption to normal processing activities This continuous availability enables all active components to be configured redundantly and installed hot as customer replaceable or expansion units The TP9400 and TP9500 storage systems connect to compute modules via Fibre Channel PCI cards For more information about the TP9400 and TP9500 storage systems see SGI Total Performance 9400 and SGI Total Perfor...

Page 120: ...ty SDLT220 11 MB s transfer rate 110 GB storage capacity SDLT320 16 MB s transfer rate 160 GB storage capacity T9840 10 MB s transfer rate 20 GB storage capacity T9840B 20 MB s transfer rate 20 GB storage capacity T9940A 10 MB s transfer rate 60 GB storage capacity T9940B 30 MB s transfer rate 200 GB storage capacity Table 2 2 describes these tape drives For the most current list of supported tape...

Page 121: ...TO 3100222201 L180 L700 SCSI 100 GB 15 MB s 54 75 115 Backup 3100222501 L180 L700 SCSI 100 GB 15 MB s 54 75 115 Backup 3100222502 L20 L40 L80 SCSI 100 GB 15 MB s 54 75 115 Backup 3100222501 L20 L40 L80 SCSI 100 GB 15 MB s 54 75 115 Backup 3100222301 L180 L700 FC 100 GB 15 MB s 54 75 115 Backup SDLT220 3100157956 L20 L40 L80 SCSI 110 GB 11 MB s 40 125 Backup 3100157931 L180 L700 SCSI 110 GB 11 MB s...

Page 122: ...20 GB 20 MB s 72 18 HSM 3100218004 9710 SCSI 20 GB 20 MB s 72 18 HSM 3100218009 9710 FC 20 GB 20 MB s 72 18 HSM T9940A 3100216001 9740 SCSI 60 GB 10 MB s 36 63 HSM Backup 3100216003 9740 FC 60 GB 10 MB s 36 63 HSM Backup 3100216004 L700 SCSI 60 GB 10 MB s 36 63 HSM Backup 3100216005 L700 FC 60 GB 10 MB s 36 63 HSM Backup T9940B 3100231001 9310 FC2 200 GB 30 MB s 108 63 HSM Backup 3100231002 L700 F...

Page 123: ...ns specified by the L2 controller commands send responses to the L2 controller that indicate the status of the commands and send error messages to the L2 controller All components within a rack that have an L1 controller must connect to the L2 controller see Figure 2 18 and Figure 2 19 For example the NUMAlink compute MPX and PCI expansion modules can connect to the L2 controller as follows The NU...

Page 124: ...Configuration RS 232 NUMAlink RS 422 signals used Compute module SGIconsole EL 16 Ethernet Compute module Console port NUMAlink module L2 controller USB NUMAlink USB signals used Compute module Compute module Compute module Compute module USB hub Compute module Compute module Compute module Compute module SGIconsole Ethernet ...

Page 125: ... Figure 2 21 The second PDU is added to the system when more than 15 AC power receptacles are needed within the rack The PDU inputs AC voltage from an external power receptacle and it can output AC voltage to the compute modules MPX module NUMAlink module TP900 storage modules USB hub power bay module and power strip Power strip The power strip exists in the system when the system requires 11 to 1...

Page 126: ...e 48 VDC powers on the PCI expansion module The 12 VDC standby voltage powers on the L1 controller logic within the PCI expansion module The power bay module shown in Figure 2 22 can house as many as six power supplies however this system requires only two or three power supplies The third power supply is required when a rack has more than one PCI expansion module When the power bay contains two p...

Page 127: ... Figure 2 22 Power Bay Module Figure 2 23 shows the power connections for a sample Origin 350 server system Front view Power supplies DPS 1 DPS 2 DPS 3 DPS 4 DPS 6 DPS 5 Rear view AC input connectors 48 VDC and 12 VDC output connectors ...

Page 128: ... I D RAN GE CHA NNE L 1 CHA NNE L 2 I D RAN GE CHA NNE L 1 CHA NNE L 2 Power distribution unit PDU Wall power source Expansion compute module TP900 storage module PCI expansion module Base compute module TP900 storage module Power bay FAU LT OUT PUT GOO D FAU LT OUT PUT GOO D I D RAN GE CHA NNE L 1 CHA NNE L 2 I D RAN GE CHA NNE L 1 CHA NNE L 2 ...

Page 129: ... shown in Figure 2 24 are identified as U8 in the short rack and U20 in the tall rack Figure 2 24 Unit Numbering within Rack 38 37 39 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 NUMAlink module NUMAlink module Expansion compute module Expansion compute module Expansion compute module Base compute modul...

Page 130: ...known as fixed rails that hold the modules within the rack For example the compute modules use slide mounting rails see Figure 2 25 Figure 2 25 Slide Mounting Rails The NUMAlink module PCI expansion module and TP900 storage module are supported by two parallel L shaped mounting rails within the rack called shelf rails see Figure 2 26 2 3 4 5 6 1 Slide mounting rail ...

Page 131: ...e cable entry exit areas at the bottom of the racks and cable management hardware in the rear of the racks Both rack types are mounted on four casters two of which are swivel casters The casters enable the rack to be rolled out of a shipping crate and to its placement at your site The base of the racks have seismic tie down attachment points The base of the tall rack also has leveling pads 19 in L...

Page 132: ...106 007 4566 001 2 System Overview Figure 2 27 Front Views of Short and Tall Racks 17U rack 39U rack ...

Page 133: ...ng system resides Every system must have a base compute module The base compute module provides processors memory and PCI PCI X slots to connect I O devices It also comes standard with a factory installed SCSI disk drive and an IO9 card and a serial daughtercard that provide various I O ports to your system System expansion compute module This module in contrast to the base compute module comes wi...

Page 134: ... 8 processors with local memory of up to 16 GB The 4U PCI expansion module adds PCI slots but no processors no memory and no IO9 card There are two versions of the PCI expansion module one module has 12 PCI slots that support 3 3 V or universal PCI cards and the other module has 6 PCI slots that support 5 V or universal PCI cards and 6 slots that support 3 3 V or universal PCI cards For more infor...

Page 135: ...ays system processes and error messages Optional internal read only slim line DVD ROM drive and two hard disk drives One or two power supplies The second power supply which is optional is redundant to assure that your compute module will always have power NUMAlink 3 port which connects your system to a system expansion compute module an MPX module or a 4U PCI expansion module Crosstown2 XIO port i...

Page 136: ...Bus L1 port which connects the compute module to an L2 controller Factory installed serial daughtercard in the base compute module which includes the following Three DB 9 serial ports which connect RS 232 RS 422 serial devices such as modems or printers to the server system Two PS 2 connectors one to connect a PS 2 keyboard and one to connect a PS 2 mouse IO9 card which provides the following conn...

Page 137: ...rver to the L2 controller NUMAlink port 1 1 XIO port 1 1 Power supplies 1 2 one power supply is redundant Ethernet port One 10BaseT 100BaseT port One 10BaseT 100BaseT 1000BaseT port SCSI channel internal 1 Ultra3 SCSI 160 MB s 1 Ultra3 SCSI 160 MB s SCSI channel external 1 Ultra3 SCSI VHDCI 1 Ultra3 SCSI VHDCI RT interrupt input and output ports 1 input and 1 output 1 input and 1 output a This sys...

Page 138: ...components which are shown in Figure 3 2 on page 113 and discussed in the following subsections IP53 Node Board on page 114 IO9 Card on page 119 Interface Board with a Daughtercard on page 120 PCI Riser Card on page 120 DVD ROM on page 121 Disk Drives on page 121 Power Supplies on page 122 ...

Page 139: ... slot 2 Bus 2 slot 1 Bus 1 slot 2 Bus 1 slot 1 PIC ASIC L1 controller IO9 PCI card NVRAM Ethernet IOC 4 SCSI 160 RTI in RTI out SCSI 10 100 1000BaseT Ethernet PS 2 ports Serial ports DVD ROM Disk drive Disk drive DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM Processor A Processor C Processor B Processor D L2 cache L2 cache L2 cache L2 cache System control IP53 node board NUMAlink 3 XIO Bedrock ASIC XIO ...

Page 140: ...s internal to the processor The L2 cache is labeled SRAM in Figure 3 3 Eight dual inline memory module DIMM slots for installation of DIMMs to provide 1 to 8 GB of main memory to local memory bank pairs on your server See Local Memory DIMMs on page 116 for more information about DIMMs Bedrock ASIC or hub ASIC which enables communication between the processors memory and I O devices Serial ID EEPRO...

Page 141: ...lined execution units It predicts conditional branches and executes instructions along the predicted path Each processor also uses a load store architecture in which the processor does not operate on data located in memory instead it loads the memory data into its registers and then operates on the data When the processor is finished manipulating the data the processor stores the data in memory 1 ...

Page 142: ...8 GB of local memory which includes main memory and directory memory for cache coherence Local memory is provided by DIMMs which contain double data rate synchronous dynamic random access memory DDR SDRAM chips installed in two or more DIMM slots located on the compute module These eight DIMM slots are laid out into one group of even numbered slots 0 2 4 and 6 and a second group of odd numbered sl...

Page 143: ...which local memory is provided when DIMMs are installed Table 3 2 DIMMs and Bank Pairs DIMM in Slot Number Provides Local Memory for Bank Pair Numbers 0a a The first two DIMMs must be installed in DIMM slot 0 and DIMM slot 1 0 and 1 1 0 and 1 2 2 and 3 3 2 and 3 4 4 and 5 5 4 and 5 6 6 and 7 7 6 and 7 ...

Page 144: ...ity 512 MB 128 MB 2 DIMMs 1 bank pair 1 GB 8 DIMMs 4 bank pairs 4 GB 1 GB 256 MB 2 DIMMs 1 bank pair 2 GB 8 DIMMs 4 bank pairs 8 GB 1 5 V VRM 2 5 V VRM Bedrock CPU 1 1 V to 1 8 V VRM 400 800 600 CPU CPU CPU DIMM slot 0 Banks 0 and 1 DIMM slot 2 Banks 2 and 3 DIMM slot 4 Banks 4 and 5 DIMM slot 6 Banks 6 and 7 DIMM slot 1 Banks 0 and 1 DIMM slot 3 Banks 2 and 3 DIMM slot 5 Banks 4 and 5 DIMM slot 7...

Page 145: ... network interface NI is the interface between the crossbar unit and the NUMAlink 3 interconnect An I O interface II allows I O devices to read and write memory direct memory access DMA operations and allows the processors within the system to control the I O devices PIO operations A local block LB services processor I O PIO requests that are local to the Bedrock ASIC IO9 Card The IO9 PCI card whi...

Page 146: ...troller logic Power supply interface IO9 expansion connectors Each of these connects to the serial daughtercard that contains DB 9 connectors serial ports and DIN 6 connectors PS 2 ports NUMAlink connector XIO connector Switch regulators Connectors to the IP53 node board and the PCI riser card PCI Riser Card The PCI riser card provides the following PIC ASIC Connectors that connect the PCI riser c...

Page 147: ...hat have a peak data transfer speed of up to 160 MB s between the disks and system memory The two disks connect to a SCSI backplane The SCSI backplane connects to the internal SCSI 160 logic on the IO9 PCI card Note An expansion compute module can also be ordered with SCSI disk drives This configuration requires an IO9 PCI card Two disk drive sizes are available as follows 18 GB 15 000 RPM disk dr...

Page 148: ...ey are located at the front right side of the module The primary power supply is the left supply and the redundant power supply is the right supply External Components This section describes the external components of the compute module which are located in the front and rear panels Front Panel Items This section describes the front panel controls and indicators of the compute module as shown in F...

Page 149: ...lluminates green when the internal components are on Reset button Press this button to reset the internal processors and ASICs The reset will cause a memory loss To perform a reset without losing memory see the NMI button information that follows NMI button Press the NMI non maskable interrupt button to reset the internal processors and ASICs without losing memory Register data and memory are stor...

Page 150: ...rt connects a serial device such as a printer or modem to the compute module L1 port USB type B This Universal Serial Bus USB type B connector connects the compute module s L1 controller to an L2 controller XIO connector This Crosstown2 connector connects the base compute module to an InfiniteReality graphics pipeline This connection is made with a NUMAlink 3 cable at 800 MB s in each direction RT...

Page 151: ...ed is established PCI PCI X slots bus 1 slot 1 bus 1 slot 2 bus 2 slot 1 bus 2 slot 2 These slots are labeled from bottom to top PCI 1 PCI 2 PCI 3 and PCI 4 Two of these slots are on one bus and two slots are on another These 64 bit slots can contain 33 MHz and 66 MHz PCI cards and 66 MHz and 100 MHz PCI X cards For an updated list of supported cards see SGI Supportfolio at http support sgi com Th...

Page 152: ...ns such as the number of DIMMs that can be installed in the compute module to increase its local memory This section also lists external compute module configuration options that can enhance the performance of the Origin 350 server system For example the compute module can connect to a 2U TP900 storage system to expand storage or it can connect to a PCI expansion module to increase I O capabilitie...

Page 153: ...two versions of the PCI expansion module one module has 12 PCI slots that support 3 3 V or universal PCI cards and the other module has 6 PCI slots that support 5 V or universal PCI cards and 6 slots that support 3 3 V or universal PCI cards For more information about this module see PCI Expansion Module User s Guide 5 0 V Support and or 3 3 V Support 007 4499 00x The 2U memory and PCI expansion M...

Page 154: ...ts The fourth lowermost PCI PCI X slot comes with a factory installed IO9 PCI card Because the IO9 card is a 66 MHz PCI card the slot immediately above where the IO9 card is installed which is on the same bus can only accommodate PCI cards that will run at a speed of 66 MHz or slower An MPX module adds 8 GB of local memory and four PCI PCI X card slots Figure 3 7 System with One Base Compute Modul...

Page 155: ...s 8 GB of local memory and four PCI PCI X card slots A 2U base compute module adds 4 processors 8 GB of local memory and two PCI PCI X and one PCI card slots The fourth lowermost slot comes with a factory installed IO9 PCI card Because the IO9 card is a 66 MHz PCI card the slot immediately above where the IO9 card is installed which is on the same bus can only accommodate PCI cards that run at a s...

Page 156: ...his serial daughtercard is not an option for the expansion compute module Table 3 4 Bandwidth Characteristics of the Compute Module Characteristic Peak Bandwidth Sustainable Bandwidth NUMAlink channel 3 2 GB s full duplex 1 6 GB s each direction 1420 MB s each direction Xtown2 channel 2 4 GB s full duplex 1 2 GB s each direction 1066 MB s half duplex 1744 MB s full duplex 872 MB s each direction M...

Page 157: ...pecifications Characteristic Specification Height 3 44 in 8 74 cm Width 17 06 in 43 33 cm Depth 27 in 68 58 cm with bezel Weight 37 80 lb 17 18 kg minimum configuration 44 50 lb 20 23 kg maximum configurationa a Weight will vary depending on whether your system has one or two power supplies on the amount of DIMMs installed and on whether you have one or two disk drives in your system Noise 6 Bels ...

Page 158: ......

Page 159: ...ion MPX module which can add local memory DIMMs and four PCI PCI X card slots to your system Specifically this chapter includes the following information System Features on page 133 External Components on page 139 System Configurations on page 142 Technical Specifications on page 146 System Features Figure 4 1 shows a front panel and side view of the MPX module ...

Page 160: ...he second power supply is redundant to assure that your server will always have power The L1 port type B USB Universal Serial Bus connector connects the module to an L2 controller The NUMAlink port connects to a compute module The Crosstown2 XIO port enables the server to connect to an InfiniteReality graphics pipeline The console port is an RS 232 DB 9 serial connector used to connect a system co...

Page 161: ...D EEPROM contains component information Three VRMs convert incoming voltages to voltages required by components Local Memory DIMMs Each MPX module has from 1 to 8 GB of local memory which includes main memory and directory memory for cache coherence Local memory is provided by DIMMs which contain double data rate synchronous dynamic random access memory DDR SDRAM chips installed in two or more DIM...

Page 162: ...y from bank pair 0 and 1 Note The two DIMMs that compose a bank pair must be the same size however the bank pairs can differ in memory size Table 4 1 lists the DIMM slots and the corresponding bank pairs to which local memory is provided Table 4 1 DIMM Slots and Corresponding Bank Pairs DIMM in Slot Number Provides Local Memory for Bank Pair Numbers 0a a The first two DIMMs must be installed in DI...

Page 163: ...ifications DIMM Capacity Chip Capacity Total Memory Capacity 512 MB 128 MB 2 DIMMs 1 bank pair 1 GB 8 DIMMs 4 bank pairs 4 GB 1 GB 256 MB 2 DIMMs 1 bank pair 2 GB 8 DIMMs 4 bank pairs 8 GB Slot 7 Banks 6 and 7 Slot 5 Banks 4 and 5 Slot 3 Banks 2 and 3 Slot 1 Banks 0 and 1 Slot 0 Banks 0 and 1 Slot 2 Banks 2 and 3 Slot 4 Banks 4 and 5 Slot 6 Banks 6 and 7 ...

Page 164: ... the interface between the crossbar unit and the NUMAlink 3 interconnect An I O interface II allows I O devices to read and write memory direct memory access DMA operations Interface Board The interface board contains the following components L1 controller logic Power supply interface NUMAlink connector XIO connector Switching regulators Connectors to the IP53 node board and the PCI riser card PCI...

Page 165: ... are located at the front right side of the module The primary power supply is the left supply and the redundant power supply is the right supply External Components This section describes the external components of the MPX module which are located in the front and rear panels Front Panel Items This section describes the front panel controls and indicators of the MPX module as shown in Figure 4 3 ...

Page 166: ...set button Press this button to reset the internal processors and ASICs The reset will cause a memory loss To perform a reset without losing memory see the NMI button information that follows NMI button Press the NMI non maskable interrupt button to reset the internal processors and ASICs without losing memory Register data and memory are stored in a var adm crash file Service required LED This LE...

Page 167: ...an InfiniteReality graphics pipeline This connection is made with a NUMAlink 3 cable at 800 MB s in each direction XIO connector LEDs The XIO connector has two LEDs These LEDs are located to the right of the XIO connector One LED lights yellow to indicate that both the MPX module and the InfiniteReality graphics pipeline to which the MPX module is connected are powered on The other LED lights gree...

Page 168: ...ent speeds on the same bus the highest speed card will run at the speed of the slower card For example if a card is running at 100 MHz in one slot of a bus and a card is running at 33 MHz in the second slot of the same bus both cards will run at 33 MHz System Configurations This section lists the internal MPX module configuration options such as the number of DIMMs that can be installed in the MPX...

Page 169: ...s It may or may not include an IO9 card but it does not have a serial daughtercard The 4U PCI expansion module adds PCI slots but no processors no memory and no IO9 card There are two versions of the PCI expansion module one module has 12 PCI slots that support 3 3 V or universal PCI cards and the other module has 6 PCI slots that support 5 V or universal PCI card and 6 slots that support 3 3 V or...

Page 170: ...tem A 2U base compute module has 4 processors 8 GB of local memory and two PCI PCI X and one PCI card slots Because the fourth lowermost slot comes with a factory installed IO9 PCI 66 MHz card the slot right above it which is on the same bus as the slot in which the IO9 PCI card is installed can only accommodate a PCI card that runs at a speed of 66 MHz or slower Figure 4 5 System with One MPX Mod...

Page 171: ... 8 GB of local memory and four PCI PCI X card slots A 2U base compute module adds 4 processors 8 GB of local memory and two PCI PCI X and one PCI card slots Because the fourth lowermost slot comes with a factory installed IO9 PCI 66 MHz card the slot right above it which is on the same bus as the slot in which the IO9 PCI card is installed can only accommodate a PCI card that runs at a speed of 66...

Page 172: ... each direction Xtown2 channel 2 4 GB s full duplex 1 2 GB s each direction 1066 MB s half duplex 1744 MB s full duplex 872 MB s each direction Main memory 3200 MB s 2140 MB s SYSAD 1600 MB s 1400 MB s Table 4 4 MPX Module Specifications Characteristic Specification Height 3 44 in 8 74 cm Width 17 06 in 43 33 cm Depth 27 in 68 58 cm with bezel Weight 37 80 lb 17 18 kg minimum configuration 44 50 l...

Page 173: ...es MPX modules and PCI expansion modules The NUMAlink module consists of eight ports Four ports can connect to compute modules and or MPX modules The other four ports which carry USB signals can connect to compute modules MPX modules and or PCI expansion modules Note The USB signals enable the compute modules MPX modules and PCI expansion modules to communicate with the L2 controller The compute m...

Page 174: ...at 1 6 GB s each direction USB port for system controller support L1 controller and LCD display Two hot pluggable cooling fans Figure 5 1 Block Diagram of NUMAlink Module Port 5 w USB Port 6 Router ASIC L1 controller Port 3 w USB Port 2 w USB Port 1 Port 4 w USB Port 8 Port 7 G H D F E C A B Ports 2 3 4 and 5 can connect to compute MPX or PCI expansion modules Ports 1 6 7 and 8 can connect to comp...

Page 175: ...for more information about the L1 controller On Off switch with LED Press this button to turn on the NUMAlink module internal components You can also turn on the NUMAlink module internal components at a system console Three LEDs On Off switch LED This LED illuminates green when the NUMAlink module internal components are on and turns off when they are off Service required LED This LED illuminates ...

Page 176: ...150 007 4566 001 5 NUMAlink Module Figure 5 2 Front View of NUMAlink Module Fans On Off switch with LED Display Failure LED Failure Service Service required LED ...

Page 177: ... MPX modules and or PCI expansion modules Link connector LEDs Each link connector has two LEDs as follows The yellow LED illuminates to indicate that both the NUMAlink module and the module to which it is connected are powered on The green LED illuminates when a link has been established between the NUMAlink module and the module to which it is connected L1 port connector This connector connects t...

Page 178: ... NUMAlink Module 1 2 4 3 5 6 7 8 LINKS R TO R LINKS R TO R C TO R G F E D L1 PORT H A B C Ports 1 6 7 and 8 can connect to compute or MPX modules Ports 2 3 4 and 5 can connect to compute MPX or PCI expansion modules L1 port LINK connector LEDs Power connector ...

Page 179: ...echnical Specifications Characteristic Specification Height 3 3 in 83 82 mm Width 17 38 in 441 45 mm Depth 27 5 in 698 50 mm Weight 20 lb 9 1 kg Input power 110 220 VAC 60 W Table 5 2 NUMAlink Module Port Specifications Port Quantity Peak Transfer Rate Link 8 1 6 GB s each direction L1 1 12 Mbits s Table 5 3 Bandwidth Characteristics of the NUMAlink Module Characteristic Peak Bandwidth Sustainable...

Page 180: ......

Page 181: ...81 Memory on page 186 L1 Controller Display on page 196 Safety Instructions Before you perform any type of maintenance to your system read the following safety instructions Follow all warnings and instructions marked on the product and noted in this and other documentation included with the product Unplug this product from the wall outlet before you clean it Do not use liquid cleaners or aerosol c...

Page 182: ...rt out parts that could result in a fire or electric shock Never spill liquid of any kind on the product Do not attempt to service this product yourself except as noted in this guide Opening or removing covers of internal components may expose you to dangerous voltage points or other risks Refer all servicing to qualified service personnel Unplug this product from the wall outlet and refer servici...

Page 183: ... an Origin 350 server system base compute module can be used to install and remove PCI and PCI X cards from the expansion compute module and a memory and PCI expansion MPX module Figure 6 1 shows the location of the PCI and PCI X card slots in the base compute module For an updated list of supported PCI and PCI X cards see SGI Supportfolio at http support sgi com This section describes the followi...

Page 184: ... in a slot slot immediately above where the IO9 card is installed that is on the same bus as the IO9 card the slot will operate only in PCI mode at a speed no faster than 66 MHz Note the following caution when installing or removing a card Caution Electronic equipment can be irreparably damaged by electrostatic discharge ESD Always follow these preventive measures when you handle a system componen...

Page 185: ...you are removing a card from one of the two lower slots bus 1 slot 1 or bus 1 slot 2 you must remove the module from the rack For instructions see Removing a Module on Slide Rails from a Rack on page 39 5 Make sure that you read Safety Instructions on page 155 and Rules for Card Installation and Removal on page 158 before beginning your card installation 6 To access the card remove the ten Phillip...

Page 186: ...ive Phillips screws as shown in Figure 6 3 If you are not installing a card into one of the bottom most card slots proceed to step 9 Caution Your system may or may not have a factory installed IO9 card which always comes installed in the lowermost slot To prevent damage to your system only a trained SGI service support engineer can install or remove an IO9 card Figure 6 3 Removing the Chassis Rail...

Page 187: ...ing a card in one of the two lowermost card slots you must also remove the lower PCI PCI X support bracket that covers the two lowermost slots as shown in Figure 6 4 by removing the four Phillips screws Figure 6 4 Removing the Lower PCI PCI X Support Bracket ...

Page 188: ...ling and Removing Customer replaceable Units 9 If a blanking plate covers the slot that is needed for the installation remove the retaining screw as shown in Figure 6 5 and the blanking plate Figure 6 5 Removing Blanking Plate ...

Page 189: ... by pushing the card into the connector until it is properly seated and install the retaining screw as shown in Figure 6 6 If you have installed the card into one of the upper two slots proceed to step 13 Figure 6 6 Installing the Card and Installing the Retaining Screw ...

Page 190: ...11 If you have installed a card in one of the two bottom most card slots replace the lower PCI PCI X support bracket that covers the two bottom most slots and screw in the four Phillips screws as shown in Figure 6 7 Figure 6 7 Replacing the Lower PCI PCI X Support Bracket ...

Page 191: ...PCI and PCI X Cards 007 4566 001 165 12 Replace the chassis rail by screwing in the five Phillips screws as shown in Figure 6 8 Figure 6 8 Replacing the Chassis Rail ...

Page 192: ...ck until they lock into place b This step requires two people With one person holding each side of the module align the chassis rails of the module with the slide rails of the rack c Slide the chassis rails into the slide rails until the chassis rails are stopped by the safety latches 15 Press the safety latches on both sides of the module and slide the module into the rack 16 Install the two scre...

Page 193: ...e minutes before you proceed with these instructions 3 Remove the two screws that secure the module to the front rails of the rack 4 Pull the module from the rack until it is stopped by the safety latches Note If you are removing a PCI or PCI X card from one of the two lower slots bus 1 slot 1 or bus 1 slot 2 you must remove the module from the rack For instructions see Removing a Module on Slide ...

Page 194: ...566 001 6 Installing and Removing Customer replaceable Units 6 To access the card remove the ten Phillips screws as shown in Figure 6 10 and lift the hinged cover Figure 6 10 Opening the Cover to Remove the Card ...

Page 195: ... not removing a PCI PCI X card from one of the two lowermost card slots proceed to step 9 Caution Only a trained SGI service support engineer can install and remove an IO9 card Otherwise your system could be damaged Therefore if an IO9 card is installed in your system it is always installed in the lowermost slot you can remove a card only from the upper three slots Figure 6 11 Removing the Chassis...

Page 196: ...f you are removing a card from one of the two lowermost slots you must also remove the lower PCI PCI X support bracket that covers the two lowermost slots by unscrewing the four Phillips screws as shown in Figure 6 12 Figure 6 12 Removing the Lower PCI PCI X Support Bracket ...

Page 197: ...4566 001 171 9 Unscrew the retaining screw from the card that you will remove and extract the card as shown in Figure 6 13 Place the card on an ESD safe surface Figure 6 13 Removing the Retaining Screw and Extracting the Card ...

Page 198: ... not replacing the card that you have removed proceed to the next step 11 Place a blanking plate to cover the slot where you removed the card and screw in the retaining screw as shown in Figure 6 14 After installing the blanking plate if you have removed a card from one of the two lowermost slots proceed to the next step Otherwise proceed to step 14 Figure 6 14 Placing a Blanking Plate ...

Page 199: ...oved a card from one of the two bottom most card slots replace the lower PCI PCI X support bracket that covers the two bottom most slots and screw in the four Phillips screws as shown in Figure 6 15 Figure 6 15 Replacing the Lower PCI PCI X Support Bracket ...

Page 200: ...174 007 4566 001 6 Installing and Removing Customer replaceable Units 13 Replace the chassis rail by screwing the five Phillips screws as shown in Figure 6 16 Figure 6 16 Replacing the Chassis Rail ...

Page 201: ...k into place b This step requires two people With one person holding each side of the module align the chassis rails of the module with the slide rails of the rack c Slide the chassis rails into the slide rails until the chassis rails are stopped by the safety latches 16 Press the safety latches on both sides of the module and slide the module into the rack 17 Install the two screws that secure th...

Page 202: ...rigin 350 server system can contain one or two sled mounted Ultra3 SCSI disk drives see Figure 6 18 Note A system expansion compute module or an MPX module may or may not contain disk drives These modules would require an IO9 PCI card in order to have the SCSI disk drives Figure 6 18 Disk Drive Location Disk drives ...

Page 203: ...andle fully swung open gently push the drive into the bay until the locking handle engages with left side of the bay opening as shown in Figure 6 19A Note If you will have only one disk drive in your system it should be located in the bottom most slot 2 Swing the locking handle towards the chassis until the locking handle engages the latch as shown in Figure 6 19B and Figure 6 19C 3 Close the beze...

Page 204: ...178 007 4566 001 6 Installing and Removing Customer replaceable Units Figure 6 19 Installing a Disk Drive B A D C ...

Page 205: ...our forefinger Figure 6 20B Then swing open the locking handle away from the chassis until the handle disengages the drive connector from the backplane connector see Figure 6 20C Note If you will have only one disk drive it should be located in the bottom most slot 5 Carefully slide the drive out of the bay see Figure 6 20D and gently place it on a flat ESD safe surface Do not use the handle to pu...

Page 206: ...180 007 4566 001 6 Installing and Removing Customer replaceable Units Figure 6 20 Removing a Disk Drive C A B D ...

Page 207: ...one or two sled mounted power supplies refer to Figure 6 21 The second is a redundant power supply to assure that your system always has power This section provides the following information Reading the Power Supply LEDs on page 182 Replacing a Power Supply on page 182 Figure 6 21 Power Supplies Location Power supplies ...

Page 208: ... front panel With a Phillips screw driver unscrew the two screws on the screen cover as shown in Figure 6 22A Table 6 1 LED Status and Power Supply Condition LED Status Power Supply Condition Indicated Off If your system has one power supply it indicates that the power supply is not receiving AC power If your system has two power supplies the LED on both power supplies would be Off and it would in...

Page 209: ...power supply handle pulled up fully opened gently push the power supply into the bay as shown in Figure 6 23A Caution When installing the power supply make sure that the power supply does not clip or pinch the power supply fan s ribbon cable b Push in and down on the green colored handle and snap the power supply into place as shown in Figure 6 23B c After you have installed the power supply swing...

Page 210: ...184 007 4566 001 6 Installing and Removing Customer replaceable Units Figure 6 22 Removing a Power Supply A B C D Ribbon cable ...

Page 211: ...Power Supplies 007 4566 001 185 Figure 6 23 Installing the power supply Bezel door Screen cover Ribbon cable D C A B ...

Page 212: ... 1 3 5 and 7 as shown in Figure 6 24 on page 188 DIMMs are installed one per DIMM slot and two at a time so that the two DIMMs installed provide local memory for the same pair of banks For example if you install a DIMM in slot 0 you must install a DIMM in slot 1 This adds memory to bank pairs 0 and 1 Table 6 2 lists the DIMM slots and the corresponding bank pairs to which local memory is provided ...

Page 213: ...al memory for the same bank pair For example you can install DIMMs in slots 2 and 3 to provide local memory for banks 2 and 3 Or you can install DIMMs in slots 4 and 5 to provide memory to banks 4 and 5 or you can install DIMMs in slots 6 and 7 to provide memory for banks 6 and 7 The DIMMs used in the Origin 350 server system base compute module the system expansion compute module and the MPX modu...

Page 214: ...onent from its antistatic bag only when you are ready to install it If you handle a component before installation do not place it on surfaces that produce ESD carpeting for example or near devices that create static electricity Attach a static wrist strap to a grounded connection on your system when you install or remove a component Slot 7 Banks 6 and 7 Slot 5 Banks 4 and 5 Slot 3 Banks 2 and 3 Sl...

Page 215: ...nd Off on page 53 2 Disconnect all of the cables at the rear of the module Warning Components may be hot To avoid injury allow the components to cool for approximately five minutes before you proceed with these instructions 3 Remove the two screws that secure the module to the front rails of the rack 4 Pull the module from the rack until it is stopped by the safety latches ...

Page 216: ...001 6 Installing and Removing Customer replaceable Units 5 To access the DIMMs remove the ten Phillips screws shown in Figure 6 25 and lift and open the hinged cover Figure 6 25 Opening Module Cover to Install DIMMs ...

Page 217: ...otches in the bottom edge of the DIMM with the keyed socket d Insert the bottom edge of the DIMM into the socket and then press down on the DIMM until it seats correctly Use extreme care when you install a DIMM If you apply too much pressure you can damage the socket e Gently push the plastic ejector latches down to secure the DIMM as shown in Figure 6 27 When the DIMM is fully seated in the conne...

Page 218: ...all the two screws that secure the module to the front rails of the rack 12 Install all of the cables at the rear of the module 13 Power on the server system as described in Powering the Server System On and Off on page 53 Figure 6 27 Inserting a DIMM Ejector latch Ejector latch ...

Page 219: ...le Warning Components may be hot To avoid injury allow the components to cool for approximately five minutes before you proceed with these instructions 3 Remove the two screws that secure the module to the front rails of the rack 4 Pull the module from the rack until it is stopped by the safety latches 5 To access the DIMMs remove the ten Phillips screws shown in Figure 6 28 and open the hinged co...

Page 220: ...186 a Lift the two ejector latches simultaneously to disengage the DIMM from its connector b Carefully grasp the DIMM and pull it up and out of the guide rails Note Hold the DIMM only by its edges Be careful not to touch its components or gold edge connectors c Place the DIMM on an ESD safe surface 8 If you are installing a new DIMM proceed to Installing a DIMM on page 189 If you are not installin...

Page 221: ...e into the rack 12 Install the two screws that secure the module to the front rails of the rack 13 Install all of the cables at the rear of the module 14 Power on the server system as described in Powering the Server System On and Off on page 53 Figure 6 30 Removing a DIMM Ejector latch Ejector latch ...

Page 222: ...e instructions to replace an L1 controller display panel for a system expansion compute module and an MPX module Figure 6 31 L1 Controller Display on Base Compute Module To replace an L1 controller display follow these steps 1 Power off the server system as described in Powering the Server System On and Off on page 53 2 Disconnect all of the cables at the rear of the module Warning Components may ...

Page 223: ...lips screws holding the bezel to the chassis as shown in Figure 6 33A 7 Holding the L1 display cover with one hand unscrew the single Phillips screw holding the L1 display cover to the chassis as shown in Figure 6 33B Gently unhook and pull away the L1 display cover from the chassis 8 Unscrew the two Phillips screws holding the L1 controller display panel to the L1 display protective cover as show...

Page 224: ...198 007 4566 001 6 Installing and Removing Customer replaceable Units Figure 6 33 Removing the L1 Controller Display Panel A C D B A Hook slots ...

Page 225: ...the holes on the L1 display protective cover and screw in the two Phillips screws as shown in Figure 6 34B 12 Hook in the L1 display protective cover onto the slots on the front chassis and holding the L1 display cover up against the front chassis screw in the Phillips screw as shown in Figure 6 34C 13 Replace the front bezel onto the front chassis of the system by screwing in the two Phillips scr...

Page 226: ...oller Display Panel 14 Attach the hinged cover and secure it to the module with the ten Phillips screws 15 Press the safety latches on both sides of the module and slide the module into the rack 16 Install the two screws that secure the module to the front rails of the rack A A B C D Red stripe Hook slots ...

Page 227: ...L1 Controller Display 007 4566 001 201 17 Install all of the cables at the rear of the module 18 Power on the server system as described in Powering the Server System On and Off on page 53 ...

Page 228: ......

Page 229: ...Chapter 7 7 Troubleshooting This chapter provides the following sections to help you troubleshoot your system Troubleshooting Chart on page 204 L1 Controller Error Messages on page 206 SGI Electronic Support on page 208 ...

Page 230: ...itch at the rear of the module is on position I View the L1 display see Table 7 2 if an error message is present If the L1 controller is not running contact your SSE Check the connection between the module and its power source The system will not boot the operating system Contact your SSE The service required LED illuminates on a module View the L1 display of the failing module see Table 7 2 for a...

Page 231: ...r supply module The power supply module also has an amber LED that indicates a fault The cooling status LED of the TP900 is amber Contact your SSE to replace the cooling module The cooling module also has an amber LED that indicates a fault The amber LED of a disk drive is on Replace the disk drive Table 7 1 Troubleshooting Chart continued Problem Description Recommended Action ...

Page 232: ...s ATTN x xV high fault limit reached x xxV 30 second power off sequence for the module ATTN x xV low fault limit reached x xxV 30 second power off sequence for the module ATTN x xV high warning limit reached x xxV A higher than nominal voltage condition is detected ATTN x xV low warning limit reached x xxV A lower than nominal voltage condition is detected ATTN x xV level stabilized x xV A monitor...

Page 233: ...ded 27 ºC ATTN TEMP critical temperature reached xxC xxF The ambient temperature at the module s air inlet has exceeded 31 ºC ATTN TEMP fault temperature reached xxC xxF The ambient temperature at the module s air inlet has exceeded 35 ºC Temperature stable message ATTN TEMP stabilized xxC xxF The ambient temperature at the module s air inlet has returned to an acceptable level Power off messages ...

Page 234: ...grates several services so they work together to monitor your system notify you if a problem exists and search for solutions to the problem Figure 7 1 shows the sequence of events that occurs if you use all of the SGI Electronic Support capabilities Figure 7 1 Full Support Sequence 1 6 5 4 3 2 Customer s system e mail Page or e mail alert Supportfolio Online View the case solutions SGI global cust...

Page 235: ... tested solutions for possible fixes to the problem Solutions that are located in SGI Knowledgebase are attached to the service case 5 You and the SGI support engineers can view and manage the case by using Supportfolio Online as well as search for additional solutions or schedule maintenance 6 Implement the solution Most of these actions occur automatically and you may receive solutions to proble...

Page 236: ... questions that can be searched by sophisticated knowledge management tools You can log on to SGI Knowledgebase at any time to describe a problem or ask a question Knowledgebase searches thousands of possible causes problem descriptions fixes and how to instructions for the solutions that best match your description or question Supportfolio Online is a customer support resource that includes the l...

Page 237: ...212 Compute Module Specifications on page 213 MPX Module Specifications on page 215 PCI Expansion Module Specifications on page 216 NUMAlink Module Specifications on page 217 Rack Specifications on page 218 SGI TP900 Storage Module Specifications on page 219 Power Bay Module Specifications on page 220 USB Hub Specifications on page 221 Non proprietary I O Port Specifications on page 221 ...

Page 238: ... 1 Environmental Specifications Characteristic Specification Temperature operating 5 ºC 41 ºF to 35 ºC 95 ºF up to 1500 m 5 000 ft 5 ºC 41 ºF to 30 ºC 86 ºF 1500 m to 3000 m 5 000 ft to 10 000 ft Temperature non operating 40 ºC 40 ºF to 60 ºC 140 ºF Humidity 10 to 95 RH noncondensing Altitude Sea level to 40 000 ft nonoperating Sea level to 10 000 ft 3000 m operating ...

Page 239: ...and three serial ports this serial daughtercard is not an option for the expansion compute module Table A 2 Bandwidth Characteristics of the Compute Module Characteristic Peak Bandwidth Sustainable Bandwidth NUMAlink channel 3 2 GB s full duplex 1 6 GB s each direction 1420 MB s each direction Xtown2 channel 2 4 GB s full duplex 1 2 GB s each direction 1066 MB s half duplex 1744 MB s full duplex 8...

Page 240: ...able when the module has an IO9 PCI card Table A 4 Compute Module Specifications Characteristic Specification Height 3 44 in 8 74 cm Width 17 06 in 43 33 cm Depth 27 in 68 58 cm with bezel Weight 37 80 lb 17 18 kg minimum configuration 44 50 lb 20 23 kg maximum configurationa a Weight will vary depending on whether the system has one or two power supplies on the amount of DIMMs installed and on wh...

Page 241: ... 4 GB s full duplex 1 2 GB s each direction 1066 MB s half duplex 1744 MB s full duplex 872 MB s each direction Main memory 3200 MB s 2140 MB s SYSAD 1600 MB s 1400 MB s Table A 6 MPX Module Specifications Characteristic Specifications Height 3 44 in 8 80 cm Width 17 06 in 43 36 cm Depth 27 in 68 58 cm with bezel Weight 37 80 lb 17 18 kg minimum configuration 44 50 lb 20 23 kg maximum configuratio...

Page 242: ... the specifications of the PCI expansion module Table A 7 Bandwidth Characteristics of the PCI Expansion Module Characteristic Peak Bandwidth NUMAlink channel 1 2 GB s each direction Table A 8 PCI Expansion Module Specifications Characteristic Specification Height 7 in 177 8 mm Width 17 5 in 444 5 mm Depth 27 5 in 698 5 mm Weight 60 lb 27 22 kg Input power 48 VDC 250 W ...

Page 243: ...A 9 Bandwidth Characteristics of the NUMAlink Module Characteristic Peak Bandwidth Sustainable Bandwidth NUMAlink channel 3 2 GB s full duplex 1 6 GB s each direction 1420 MB s each direction Table A 10 NUMAlink Module Specifications Characteristic Specification Height 3 3 in 83 82 mm Width 17 38 in 441 45 mm Depth 27 5 in 698 5 mm Weight 20 lb 9 1 kg Input power 110 220 VAC 60 W Table A 11 NUMAli...

Page 244: ...fications of the tall rack Table A 12 Short Rack Specifications with Skins Characteristic Specification Height 36 06 in 916 mm Width 25 38 in 645 mm Depth 40 63 in 1032 mm Weight maximum 488 lb 221 kg Shipping weight maximum 563 lb 255 kg Table A 13 Tall Rack Specifications Characteristic Specification Height 75 82 in 1925 83 mm Width 23 62 in 599 95 mm Depth 41 25 in 1048 mm Weight maximum 1 100 ...

Page 245: ... 14 lists the specifications of the SGI TP900 storage module Table A 14 TP900 Storage Module Specifications Characteristic Specification Height 3 37 in 85 7 mm Width 17 6 in 447 mm Depth 21 46 in 545 mm Input power 100 254 VAC 175 W Weight Maximum configuration Empty enclosure 48 5 lb 22 kg 14 3 lb 6 5 kg ...

Page 246: ...A 16 lists the specifications of the power supplies Table A 15 Power Bay Module Specifications Characteristic Specification Height 5 118 in 130 mm Width 17 5 in 443 mm Depth 23 898 in 607 mm Weight with two power supplies 42 lb 19 05 kg Table A 16 Power Supply Specifications Characteristic Specification Height 4 86 in 123 5 mm Width 2 74 in 69 5 mm Depth 13 67 in 347 3 mm Weight 7 5 lb 3 38 kg ...

Page 247: ...ons This section provides pin assignment information for the non proprietary connectors on the following components Compute module base and expansion MPX module L2 controller NUMAlink module TP900 storage module USB hub Table A 17 USB Hub Specifications Characteristic Specification Height 0 688 in 17 475 mm Width 2 5 in 63 5 mm Depth 3 25 in 82 55 mm ...

Page 248: ...tsb b The keyboard and mouse PS 2 ports are available on the daughtercard This daughtercard is only available with the base compute module PS 2 See Figure A 13 on page 235 and Table A 26 on page 235 Ethernet portc c These connectors are available only when the compute module has an IO9 PCI card RJ 45 See Figure A 8 on page 229 and Table A 21 on page 229 External SCSI portd d These connectors are a...

Page 249: ...ry I O Port Specifications 007 4566 001 223 Figure A 1 Rear Panel of Compute Module External SCSI connector RTI input RTO output Ethernet port Serial ports 2 3 and 4 Serial port 1 L1 port CONSOLE port Keyboard Mouse ...

Page 250: ...ble indicates where you can find the pin assignments for these connectors Figure A 2 Non Proprietary Connectors on Rear Panel of MPX Module Table A 19 MPX Module Connectors Port Connector Pin Assignments Console port DB 9 See Figure A 7 on page 228 L1 port USB type B See Figure A 12 on page 234 and Table A 25 on page 234 XIO NUMALINK PCI 1 PCI 2 PCI 3 PCI 4 1 L1 PORT CONSOLE CONSOLE port L1 port ...

Page 251: ...rs Figure A 3 Non Proprietary Connectors on Rear Panel of L2 Controller Table A 20 L2 Controller Connectors Port Connector Pin Assignments Console serial port DB 9 See Figure A 7 on page 228 Modem serial port DB 9 See Figure A 7 on page 228 Ethernet port RJ 45 See Figure A 8 on page 229 and Table A 21 on page 229 L1 ports four ports USB type A See Figure A 11 on page 233 and Table A 24 on page 233...

Page 252: ...ctor on Rear Panel of NUMAlink Module SGI TP900 Storage Module Figure A 5 shows the two SCSI port connectors on the rear panel of the TP900 storage module Figure A 9 on page 230 shows how the pin numbers are distributed on the SCSI connector and Table A 22 on page 230 lists the pin assignments Figure A 5 Non proprietary Connectors on Rear Panel of TP900 Storage Module 1 2 4 3 5 6 7 8 LINKS R TO R ...

Page 253: ...s four USB type A connectors two connectors on each side of the hub Figure A 11 on page 233 shows how the pin numbers are distributed on the USB type A connector and Table A 24 on page 233 lists the pin assignments Figure A 6 USB Hub Type A Connectors USB type A connectors USB type A connectors ...

Page 254: ...s also used as the console port of the MPX module and the console and modem ports of the L2 controller Figure A 7 DB 9 Connector Pin Assignments Pin 3 Transmit data TD Pin 2 Receive data RD Pin 4 Data terminal ready DTR not used Pin 1 Data carrier detect DCD not used Pin 6 Data set ready DSR not used Pin 7 Request to send RTS Pin 8 Clear to send CTS Pin 9 Ringing indicator RI not used Pin 5 Ground...

Page 255: ...nector Pin Assignments Table A 21 Ethernet Connector Pin Assignments 10 100BaseT Ethernet Pinouts Pin Assignment 1000BaseT Ethernet Pinouts Pin Assignment 1 Transmit 1 Transmit Receive 0 2 Transmit 2 Transmit Receive 0 3 Receive 3 Transmit Receive 1 4 Not used 4 Transmit Receive 2 5 Not used 5 Transmit Receive 2 6 Receive 6 Transmit Receive 1 7 Not used 7 Transmit Receive 3 8 Not used 8 Transmit R...

Page 256: ...ts the pin assignments for this SCSI connector Figure A 9 Pin Number Locations for External SCSI Port Table A 22 SCSI VHDCI Pin Assignments Pin Number Signal Name Pin Number Signal Name 1 DB 12 35 DB 12 2 DB 13 36 DB 13 3 DB 14 37 DB 14 4 DB 15 38 DB 15 5 DB P1 39 DB P1 6 DB 0 40 DB 0 7 DB 1 41 DB 1 8 DB 2 42 DB 2 9 DB 3 43 DB 3 10 DB 4 44 DB 4 11 DB 5 45 DB 5 12 DB 6 46 DB 6 13 DB 7 47 DB 7 14 DB...

Page 257: ... 53 Reserved 20 Ground 54 Ground 21 ATN 55 ATN 22 Ground 56 Ground 23 BSY 57 BSY 24 ACK 58 ACK 25 RST 59 RST 26 MSG 60 MSG 27 SEL 61 SEL 28 CD 62 CD 29 REQ 63 REQ 30 IO 64 IO 31 DB 8 65 DB 8 32 DB 9 66 DB 9 33 DB 10 67 DB 10 34 DB 11 68 DB 11 Table A 22 SCSI VHDCI Pin Assignments continued Pin Number Signal Name Pin Number Signal Name ...

Page 258: ... RT interrupt input and RT interrupt output ports of the IO9 PCI card Table A 23 lists the conductor assignments for the stereo jack connector Figure A 10 Stereo Jack Connector Conductors Table A 23 Conductor Assignments for Stereo Jack Connector Conductor Function Tip 5 V Ring Interrupt active low Sleeve Chassis ground and cable shield Ring Sleeve Tip ...

Page 259: ... 1 through 4 of the L2 controller and the four USB ports on the USB hub that connect to the compute and or MPX modules Table A 24 lists the pin assignments Figure A 11 Pin Number Locations for USB Type A Connector Table A 24 Pin Assignments for USB Type A Connector Signal Color Pin Number VCC Red 1 Data White 2 Data Green 3 Ground Black 4 1 2 3 4 ...

Page 260: ... the USB L1 port of the compute module and the MPX module and the L1 port on the NUMAlink module Table A 25 lists the pin assignments Figure A 12 Pin Number Locations for USB Type B Connector Table A 25 Pin Assignments for USB Type B Connector Signal Color Pin Number VCC Red 1 Data White 2 Data Green 3 Ground Black 4 4 3 2 1 ...

Page 261: ...e connectors located on the base compute module Table A 26 lists the pin assignments Figure A 13 Pin Number Locations for the PS 2 Keyboard and Mouse Connectors Table A 26 Pin Assignments for the PS 2 Connectors Pin Assignment 1 Keyboard Mouse Data 2 Reserved 3 Ground 4 Keyboard Mouse Data 5 V 5 Keyboard Mouse clock 6 Reserved 1 2 5 6 3 4 ...

Page 262: ......

Page 263: ...f conformity to the European requirements Caution Each SGI server system has several governmental and third party approvals licenses and permits Do not modify this product in any way that is not expressly approved by SGI If you do you may lose these approvals and your governmental agency authority to operate this device Server Model Number The CMN model number for each server is printed on the sys...

Page 264: ... radio frequency energy and if not installed and used in accordance with the instruction manual may cause harmful interference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case you will be required to correct the interference at your own expense If this equipment does cause harmful interference to radio or television rec...

Page 265: ...ausing Equipment Regulations Cet appareil numérique német pas de perturbations radioélectriques dépassant les normes applicables aux appareils numériques de Classe A préscrites dans le Règlement sur les interferences radioélectriques établi par le Ministère des Communications du Canada VCCI Notice Japan Only Chinese Class A Regulatory Notice Korean Class A Regulatory Notice ...

Page 266: ...nt cable from SGI Electrostatic Discharge SGI designs and tests its products to be resistant to the effects of electrostatic discharge ESD ESD is a source of electromagnetic interference and can cause problems ranging from data errors and lockups to permanent component damage It is important that you keep all the covers and doors including the plastics in place while you are operating the server s...

Page 267: ...Warning Advertencia Radiación láser invisible al ser abierto Evite exponerse a los rayos Warning Advarsel Laserstråling vedåbning se ikke ind i strålen Warning Varo Lavattaessa Olet Alttina Lasersåteilylle Warning Varning Laserstrålning når denna del år öppnad ålå tuijota såteeseenstirra ej in i strålen Warning Varning Laserstrålning nar denna del år öppnadstirra ej in i strålen Warning Advarsel L...

Page 268: ...ende type anbefalt av apparatfabrikanten Brukte batterier kasseres i henhold til fabrikantens instruksjoner Warning Varning Explosionsfara vid felaktigt batteribyte Anvãnd samma batterityp eller en ekvivalent typ som rekommenderas av apparattillverkaren Kassera anvãnt batteri enligt fabrikantens instruktion Warning Varoitus Päristo voi räjähtää jos se on virheellisesti asennettu Vaihda paristo ain...

Page 269: ...le 85 USB hub 99 battery statements 242 C Chinese Class A regulatory notice 239 circuit breaker switches 54 compute module general features 130 213 compute node bandwidth 213 specifications 131 connector LINK 125 141 XIO 124 141 connector pin assignment DB9 228 L2 controller 225 model 350 compute module 222 NUMAlink module 226 RJ 45 229 SCSI VHDCI 230 stereo jack 232 TP900 storage module 226 USB h...

Page 270: ...ge regulatory notice 240 Embedded Support Partner ESP 210 error messages 206 ESP 210 Ethernet connector 126 expansion I O devices 87 storage TP900 90 TP9100 91 TP9400 93 external SCSI connector 126 F FCC notice USA only 238 feet installation 23 front panel LEDs 61 H hub USB 99 I Industry Canada Notice Canada only 239 install disk drive 177 memory 189 192 short rack 13 15 tall rack 16 18 installati...

Page 271: ...ecifications 146 214 215 N NUMAlink module 85 bandwidth 153 217 block diagram 148 connector pin assignments 226 rear view 152 P PCI expansion devices 87 bandwidth 216 PCI expansion module 216 bandwidth 216 specifications 216 PCI PCI X card installation 158 166 removal 167 175 PCI PCI X card slots 125 142 ports rear panel 124 141 power bay module specifications 220 power receptacle 7 9 power supply...

Page 272: ...connector external 126 SCSI VHDCI connector pin assignments 230 self adhesive feet installation 23 server model number 237 SGI Knowledgebase See Knowledgebase SGIconsole 51 shelf rails 42 shielded cables regulatory notice 240 short rack install 13 15 site requirements 6 space requirements 26 specifications 216 compute node 131 environmental 212 MPX module 146 214 215 power bay module 220 power sup...

Page 273: ...206 problems and recommended actions 204 U USB hub 99 connector pin assignments 227 specifications 221 USB type A connector pin assignments 233 USB type B connector pin assignments 234 V VCCI notice Japan only 239 voltage select switches for peripherals 54 X XIO connector 124 141 ...

Page 274: ......

Reviews:

No comments

Brands by name

Popular brands

Load more brands