background image

4

Chapter 1: Introducing the SGI 2400 and 2800 Server Systems

Figure 1-3

SGI 2400 Multirack Configuration (Four Racks Shown)

Hardware Overview

As shown in Figure 1-4, a single rackmount system can consist of up to two fully
integrated and independent subsystems—Module A and Module B. Each of the modules
in Figure 1-4 has a dedicated System Controller, which monitors module status. Each
module can also have a separate set of hard disks, CPUs, I/O connections, and memory,
as well as a separate operating system, and a separate set of applications.

Summary of Contents for 2400

Page 1: ...SGI 2400 and 2800 Server Owner s Guide Document Number 007 4192 001 ...

Page 2: ...Unpublished rights reserved under the Copyright Laws of the United States Contractor manufacturer is SGI 1600 Amphitheatre Pkwy Mountain View CA 94043 1351 Shielded Cables This product requires the use of external shielded cables in order to maintain compliance with Part 15 of the FCC rules FCC Warning This equipment has been tested and found compliant with the limits for a Class A digital device ...

Page 3: ...Radio Interference Regulations of the Canadian Department of Communications Attention Cet appareil numerique n emet pas de perturbations radioélectriques dépassant les normes applicables aux appareils numériques de Classe A préscrites dans le Règlement sur les interferences radioélectriques établi par le Ministère des Communications du Canada Manufacturer s Regulatory Declarations This workstation...

Page 4: ...I logo Origin Vault S2MP IRIS InSight and XIO are trademarks of Silicon Graphics Inc CrayLink is a trademark of Cray Research Inc VME is a trademark of Motorola UNIX is a registered trademark in the United States and other countries licensed exclusively through X Open Company Ltd TUV geprufte Sicherheit R NRTL C ...

Page 5: ...t Online Documentation and Help xvii Online Man Pages xvii Release Notes xviii World Wide Web Accessible Documentation xviii Conventions xix 1 Introducing the SGI 2400 and 2800 Server Systems 1 System Features 1 Hardware Overview 4 About the SGI 2400 and 2800 9 CrayLink Interconnect 11 XIO Slots 12 Distributed Shared Address Space Memory and I O 12 IRIX 13 2 Chassis Tour 15 Overview 15 Board Confi...

Page 6: ...m Configurations 44 Rackmount Configurations 47 Multirack Configurations 53 5 System Configuration and Operation 59 Connecting Your Terminal 60 SCSI Configuration Requirements 62 Loading the Single Connector Assembly SCA Drives Into the System 63 Loading the CD ROM 66 Connecting Your System to an Ethernet Network 68 Initially Powering On the System 69 Booting Your System 73 Installing the Operatin...

Page 7: ...ront Panel Display 100 MMSC Assembly 104 MSC Front Panel 109 Understanding the MSC LEDs and Switches 112 MSC Features and Functions 113 MSC Status Messages 115 8 System Maintenance and Troubleshooting 117 Maintaining Your Hardware and Software 117 Hardware Dos and Don ts 117 Software Dos and Don ts 118 System Problem Catagories 118 XIO Board Slots Not Functioning 118 Physical Inspection Checklist ...

Page 8: ......

Page 9: ...tem 10 Figure 2 1 SGI 2400 and 2800 Rackmount System Front View 16 Figure 2 2 SGI 2400 and 2800 Rackmount Rear View 17 Figure 2 3 Board Configuration and Layout for System Module 21 Figure 2 4 MSC and Display 23 Figure 2 5 MMSC Display for Entire Rack 24 Figure 2 6 BaseIO Board 25 Figure 2 7 Node Board Positioning in the Chassis 28 Figure 2 8 Front View of Node Board Showing Bulkhead 29 Figure 2 9...

Page 10: ...On the System Rear View of Chassis 72 Figure 5 9 Entry Level System Controller Key Positions 74 Figure 6 1 Customer Replaceable Units CRUs for the SGI 2400 or 2800 Server 80 Figure 6 2 Turning Off the Module Controller 83 Figure 6 3 Powering Off a Rackmount Module 84 Figure 6 4 Powering Off the Multimodule Controller 85 Figure 6 5 Turning Off the PDU 87 Figure 6 6 Turning Off a Multirack Configura...

Page 11: ...et Cabling 2 racks 106 Figure 7 7 MMSC to 10BaseT Hub 1BaseT Ethernet Cabling 2 racks 107 Figure 7 8 Processor Assembly Location in Rack 108 Figure 7 9 MSC Status Panel Serial Connector and Switches 109 Figure 7 10 System Controller Rear Serial Connector 111 ...

Page 12: ......

Page 13: ...ments 36 Table 3 2 68 Pin Single Ended High Density SCSI Pinouts 40 Table 4 1 Single Module Chassis Configurations 47 Table 4 2 Dual Module Chassis Configuration 48 Table 4 3 Multiple Rack Configurations 53 Table 7 1 System Controller Messages 115 Table A 1 Physical and Environmental Specifications 123 Table A 2 Electrical and Cooling Specifications 124 ...

Page 14: ......

Page 15: ...guide to set up the system install hardware options or find a solution when you suspect there is a hardware problem Basic information on installing software is also included For more advanced information on installing software refer to IRIX Admin Software Installation and Licensing The system and the procedures in this guide are designed so that you may maintain and repair part of the system witho...

Page 16: ... InSight online documentation and help Figure i Information Sources for the SGI 2400 and 2800 Rackmount System The following sections contain information on options that can help you get your system up and running and help you become productive as soon as possible Hard Copy CDs IRIS InSight Desktop Help Online Documentation D o c T i t l e l i n e 1 D o c T i t l e l i n e 2 V o l u m e N u m b e ...

Page 17: ...nd administration manuals that ship online with the system Double click on a book to open it For a description and listing of the manuals that are available to purchase in hard copy double click on the Documentation Catalog Online Man Pages Your system comes with a set of IRIX man pages formatted in the standard UNIX man page style These are found online on the internal system disk or CD ROM and a...

Page 18: ... notes for a variety of SGI products and software subsystems using one of two utilities relnotes Text based viewer for online release notes grelnotes Graphics viewer for online release notes To see a list of available release notes type the following at a shell prompt relnotes For more information see the relnotes 1 and grelnotes 1 man pages World Wide Web Accessible Documentation SGI makes its ma...

Page 19: ... in italics References to other chapters and sections within this guide are in quotation marks Names of IRIX man pages or commands that you type at the shell prompt are in italics as are IRIX filenames Steps to perform tasks are in numbered sentences When a numbered step needs more explanation the explanation follows the step ...

Page 20: ......

Page 21: ...tem Features The SGI 2400 or 2800 servers are ideal for evolving applications requiring expansion capability as requirements grow Some of the server s features include significantly lower entry system costs with pay as you grow expandability support of a large number of processors up to 256 high bandwidth I O connectivity higher total memory capacity up to 512 GB of main memory optional connectivi...

Page 22: ...2 Chapter 1 Introducing the SGI 2400 and 2800 Server Systems Figure 1 1 SGI 2400 Rackmount Server System ...

Page 23: ...System Features 3 Figure 1 2 SGI 2400 Multirack System Configuration Example ...

Page 24: ...gle rackmount system can consist of up to two fully integrated and independent subsystems Module A and Module B Each of the modules in Figure 1 4 has a dedicated System Controller which monitors module status Each module can also have a separate set of hard disks CPUs I O connections and memory as well as a separate operating system and a separate set of applications ...

Page 25: ...rations Figure 1 5 provides an overall block diagram of an SGI 2400 server rack system The major hardware components include the CPU and memory Node board Router board BaseIO board XIO slots For a description of these components see Chapter 2 Chassis Tour The rear module diagram shown in the top portion of Figure 1 5 appears in the back of the chassis between the Node boards and fan tray This diag...

Page 26: ...ducing the SGI 2400 and 2800 Server Systems Figure 1 4 SGI 2400 Rackmount Chassis Side Panel Removed Fault 1 7 VDC 2 4 VDC 3 3 VDC Link Statu s 1 2 3 4 5 6 1 Module B CrayLink interconnect CrayLink interconnect Module A ...

Page 27: ...ternal connections to router boards in other chassis External connections to router boards in other chassis External connections to router boards in other chassis External connections to router boards in other chassis Module A Module B Node slots XIO 11 XIO 9 XIO 7 XIO 5 XIO 3 XIO 1 Node 1 Node 2 Node 3 Node 4 XIO 12 XIO 10 XIO 8 XIO 6 XIO 4 XIO 2 Router 2 Router 1 XIO slots Block Diagram Rear Mod...

Page 28: ...cing the SGI 2400 and 2800 Server Systems Figure 1 6 A Look Inside the Module Chassis Node 4 Node 3 Node 2 Node 1 64 bit processors Midplane I O board Rear of module Routers Module System Controller CD ROM Hub Xbow ASICs ...

Page 29: ... to I O devices and another that links system nodes through the CrayLink Interconnect Cache coherence is the ability to keep data consistent throughout a system In the symmetrical multiprocessor SMP server system data can be copied and shared among all the processors and their caches Moving data into a cache may cause the cached copy to become inconsistent with the same data stored elsewhere The c...

Page 30: ...an SGI 2400 or 2800 System CrayLink Interconnect Node Router Router Router Node board 64 bit CPU 64 bit CPU Cache Cache Hub Directory Main Memory Router Router to CrayLink Interconnect XIO Router Router Router Node board Node board Node board Node board Node board Node board Node board ...

Page 31: ...e increased in size by adding standard modules to the CrayLink Interconnect The SGI 2400 and 2800 architecture achieves this scalable processing power primarily by using the following technology CrayLink Interconnect XIO slots Distributed shared memory new IRIX operating system CrayLink Interconnect The SGI 2400 and 2800 modules are connected by the CrayLink Interconnect also known as the intercon...

Page 32: ... but uses a protocol optimized for I O traffic The XIO features are high bandwidth 1600 MB sec peak concurrent transfers real time performance future expandability Distributed Shared Address Space Memory and I O The SGI 2400 and 2800 employ a distributed shared memory system architecture where main memory is split among the Node boards Rather than appearing as one fast memory main memory is distri...

Page 33: ...a shared address space every I O device is universally accessible throughout the system IRIX The new 64 bit IRIX operating system is based on UNIX System V Release 4 distributed software technology IRIX supports modular computing providing availability and throughput on small one to four processor systems It also supports scalability performance resilience and throughput on large systems with tens...

Page 34: ......

Page 35: ...s an overview of the rackmount system chassis and a description of the controls connectors and indicators Overview Figure 2 1 and Figure 2 2 show the major parts of the SGI 2400 and 2800 rackmount system These parts are briefly described in Table 2 1 ...

Page 36: ... baffle 9 3 SCSI drive box door 8 6 11 13 1 System controller drive module door Optional disk modules 7 Multimodule System Controller MMSC display Module System Controller MSC Module B CrayLink Interconnect Router board 15 Cable comb 16 Door 17 Connector cover 12 Cable bail Facade System disk 10 14 Cable comb cover Module A Multimodule System Controller logic module ...

Page 37: ...ear View Note In Figure 2 2 the side panel is removed for clarity PDU off PDU on ON OFF 18 Node boards 19 BaseIO 20 XIO slots 21 Power distribution unit PDU 22 PDU power switch 23 Main power switch Multimodule system controller MMSC 24 25 XIO cable guide ...

Page 38: ...bly SCA Drives Into the System on page 63 for additional information 4 System controller drive module door This door should be kept closed to prevent dust and other possible contaminants from affecting the drive performance 5 CD ROM drive The CD ROM is standard with each system and is used to load the operating system and software applications 6 Module System Controller The module System Controlle...

Page 39: ...ec connectivity between Node boards There are three types of Router boards a Null Router a Star Router and a Rack Router board These router boards are described in Router Boards on page 30 14 Cable comb cover This removable cover hides the CrayLink Interconnect cable inside the rack chassis 15 Cable comb The comb holds the CrayLink Interconnect in place when the cable is tucked into the grooves 16...

Page 40: ...board is the main processing board in the SGI 2400 or 2800 system It contains one or two 64 bit CPUs the hub which provides an interface to the I O subsystem and the CrayLink Interconnect a portion of main memory as well as directory memory Each node board can support from 64 MB to 4 GB of memory A single rack system can have between one to eight Node boards A multiple rack system can have up to 6...

Page 41: ...d Figure 2 3 Board Configuration and Layout for System Module Major Components This section describes major hardware components for the SGI 2400 and 2800 rack which includes the following System Controller BaseIO board CPU Node board Router board Power distribution unit PDU CrayLink Interconnect cable PCI carrier assembly IO11 IO9 IO7 IO5 IO3 IO1 Node 1 Node 2 Node 3 Node 4 IO12 IO10 IO8 IO6 IO4 I...

Page 42: ...trollers are tied to the multimodule controller through an eight pin serial connection from the module to the multimodule controller board in the rack The MMSC and display are two separate units as shown in Figure 2 1 and Figure 2 2 There should only be one multimodule display per configuration to act as the single point administration for the rack configuration In addition in a multirack configur...

Page 43: ... and Display Diagnostic Port Ambient over temperature LED 8 digit LED display Module NMI switch Module reset switch AC OK LED DC OK LED Fan hi speed indicator LED Security key switch 8 pin mini DIN diagnostic port On Standby Diagnostic ...

Page 44: ...ire Rack Execute Cursor placement Focus Action View Configure Irix OS View A c t i v i t y Processors user system intr io graphics 0 1 2 3 4 5 6 7 100 0 25 50 75 Power Cycle NMI Reset Power Up Power Down 1 0 Current target module all Display panel Menu Cancel ...

Page 45: ...igure 2 6 shows the BaseIO board and Table 2 2 describes the connector functions Figure 2 6 BaseIO Board Ethernet Ethernet connector LEDs LEDs Interrupt in Interrupt out Serial console port Additional serial port 68 pin SCSI connector 1 2 3 4 LEDs 1 SCSI 2 100Mb s 3 DUP 4 Link TX RX tty_1 tty_2 Console ...

Page 46: ...s sixteen slots of main memory eight slots of optional directory memory one Hub ASIC 64 bit Processors The superscalar 64 bit CPU is the main processor for the SGI 2400 and 2800 servers There can be one or two 64 bit CPUs on each Node board You may hear a module or rack referred to as an 8 P or 16 P system The P stands for processor An 8P system has eight processors Main Memory The SGI 2400 and 28...

Page 47: ...onsistency when multiple processors need to access the same piece of memory Hub The Hub ASIC on the Node board is the primary communication link between the 64 bit processor the I O subsystem the main memory and the CrayLink Interconnect The Hub also interfaces with directory memory which is responsible for maintaining cache coherence Status LEDs Figure 2 8 shows the bulkhead on the front of the N...

Page 48: ...28 Chapter 2 Chassis Tour Figure 2 7 Node Board Positioning in the Chassis Node 1 Node 4 Node 3 Node 2 ...

Page 49: ...Major Components 29 Figure 2 8 Front View of Node Board Showing Bulkhead LEDs Bulk head Compression mounting bolt Compression mounting bolt ...

Page 50: ... with the hubs on Node boards and allows the 64 bit processors on one Node board to directly access the main memory located on other Node boards There are four types of Router boards Null Router Star Router Rack Router Cray Router If a module has only one Node board no Router is required A Router board is required only when there are two or more Node boards Note The Null and Star Router boards are...

Page 51: ...er provides a low cost method to connect two Node boards The Null Router board cannot be used for CrayLink Interconnect linking and it does not have any external router connectors Three external Router ports for interconnection fabric One external port that connects only to companion rack Router board port Null Router Board Star Router Board Rack Router Board ...

Page 52: ...onnect internally The fourth fifth and sixth ports can connect external routers ports on different modules Cray Router The Cray Router chassis not shown is used for CrayLink connectivity for configurations with up to 128 processors The Cray Router comes in two modules that house additional router boards to provide interconnection fabric support for systems with more than 64 processors Power Distri...

Page 53: ...ving cables while both server modules are up and running This can hang or crash the entire SGI 2400 or 2800 configuration Caution Additional router cable connections should be performed only by Silicon Graphics certified personnel Xpress Links The Xpress links provide greater system bandwidth as they supply additional 1600 MB sec routing paths The Xpress links connect to Router board ports that ar...

Page 54: ...es are used to connect to external peripherals and provide the same I O performance as the CrayLink Interconnects and Xpress link cables PCI Carrier Assembly The peripheral connector interface carrier assembly can house up to three third party PCI boards see Figure 2 11 Two of the PCI boards can be full size boards The third PCI slot accepts only half size boards The PCI carrier assembly provides ...

Page 55: ...cian should configure and connect it Your SGI 2400 or 2800 rackmount system is fully functional as a standalone server using Ethernet modem optional ATM HIPPI or other interconnect technologies Proper configuration and interconnection of any optional XIO interconnect cables or hardware can be accomplished by the SSE at initial system installation or when an upgrade is ordered ...

Page 56: ...henever it sees any packet on the wire including packets not destined for your system The four LEDS above the RJ 45 Ethernet connector have the following functions The yellow LED on the far left LED 1 lights to indicate SCSI activity on the BaseIO single ended SCSCI connector The green LED LED 2 lights to indicate 100 MB per second packet activity The yellow LED on the right LED 3 indicates when t...

Page 57: ...e Connection 37 Figure 3 1 Standard Ethernet on SGI 2400 and 2800 Rackmount 100 Base T connector Pin 1 Transmit Pin 2 Transmit Pin 3 Receive Pin 4 Reserved Pin 5 Reserved Pin 6 Receive Pin 7 Reserved Pin 8 Reserved 1 2 3 4 ...

Page 58: ...ndard recommends the use of cables no longer than 50 feet 15 2 meters This standard should also be applied to the RS 422 connections Longer runs increases the possibility of line noise which can affect data transmission and cause errors For cable runs longer than 50 feet 15 2 meters use an appropriate extender device Note Do not run cables through areas that are electrically noisy such as places s...

Page 59: ...d Pinouts Console serial port Serial port Pin 1 Data Carrier Detect DCD Pin 6 Data Set Ready DSR Pin 7 Request to Send RTS Pin 8 Clear to Send CTS Pin 9 Ringing Indicator RI Pin 2 Receive Data RD Pin 3 Transmit Data TD Pin 4 Data Terminal Ready DTR Pin 5 Ground ...

Page 60: ...es that the signal is low Note that 8 bit devices that connect to the P cable leave the following signals open DB 8 DB 9 DB 10 DB 11 DB 12 DB 13 DB 14 DB 15 DB P1 All other signals are connected as shown in Table 3 2 Table 3 2 68 Pin Single Ended High Density SCSI Pinouts Signal Name Pin Number Pin Number Signal Name Ground 1 35 DB 12 Ground 2 36 DB 13 Ground 3 37 DB 14 Ground 4 38 DB 15 Ground 5 ...

Page 61: ...5 ATN Ground 22 56 Ground Ground 23 57 BSY Ground 24 58 ACK Ground 25 59 RST Ground 26 60 MSG Ground 27 61 SEL Ground 28 62 C D Ground 29 63 REQ Ground 30 64 I O Ground 31 65 DB 8 Ground 32 66 DB 9 Ground 33 67 DB 10 Ground 34 68 DB 11 Table 3 2 continued 68 Pin Single Ended High Density SCSI Pinouts Signal Name Pin Number Pin Number Signal Name ...

Page 62: ...42 Chapter 3 Interface and Cabling Information Figure 3 3 68 Pin SCSI Connector SCSI connector 68 pin Pin 1 Pin 35 Pin 68 Pin 34 ...

Page 63: ...ed on the Node board a Router board s a BaseIO board which provides the system I O ports such as serial Ethernet and SCSI interfaces single connector assembly SCA drive bay s for single ended ultra SCSI drive installation a drive box Vault The SGI 2400 or 2800 chassis is housed in a rack system that comes with a multimodule System Controller MMSC and display and also provides cable management hard...

Page 64: ...ion As Figure 4 1 shows a base module also known as the SGI 2200 server supports 1 to 8 processors To go beyond eight processors a rackmount system is needed Figure 4 2 shows a configurations with more than 16 processors or 8 Node boards requiring at least two rack systems Larger configurations with 32 processors or 16 Node boards require four racks The largest configurations SGI 2800 systems with...

Page 65: ...s up to 6 processors IR1 Jumper IR1 Jumper IR1 Jumper 4 Node Boards up to 8 processors N Node Board NR Null Router Board SR Star Router Board R Router Board 8 Node Boards Rackmount System up to 16 processors Null Router Board Star Router Board Configuration N N N N N N N N N N N N N N N NR R N N N R R R Router Board Router Board Router Board Router Board Router Board Star Router Board Router Board...

Page 66: ...Schematic Number of Node Boards 8 Node Boards up to 16 processors Rack System Configuration R R R R R R R R R R R R R R R R R R R R R R R R R R R 32 Node Boards up to 64 processors Multi Rack System 16 Node Boards up to 32 processors Multi Rack System R With Xpress Links With Xpress Links ...

Page 67: ...Module Chassis Configurations Hardware Component Number Range CPU Node boards 1 to 4 64 bit CPUs 2 to 8 Main memory per Node board 64 MB to 4 GB using 256 MB memory DIMMs Main memory per chassis 64 MB to 16 GB using four Node boards Number of internal SCA drives 1 to 5 Number of usable XIO slots 6 or 12 for a single module chassis Number of Vaults 1 to 4 one Vault comes standard with the rack I O ...

Page 68: ... 2 Dual Module Chassis Configuration Hardware Component Number Range CPU Node boards 2 to 8 64 bit CPUs 2 to 16 Main memory per Node board 64 MB to 4 GB using 256 MB memory DIMMs Main memory per chassis 128 MB to 32 GB using eight Node boards Number of internal SCA drives 2 to 10 Number of usable XIO slots Up to 24 for a dual module chassis Number of Origin Vaults 1 only I O interfaces One to two ...

Page 69: ...Rackmount Configurations 49 Figure 4 3 Single Server Module in a Rack with Four Vault Drive Boxes Drive enclosure door Drive enclosures CPU module ...

Page 70: ... It is possible to have a 16P configuration without CrayLink Interconnect cabling however the modules cannot share resources or communicate using the fast 1600 MB sec transmission link This type of configuration normally uses a different router board either a Null Router or Star Router For more information on the different types of router boards see Chapter 2 Chassis Tour Figure 4 5 shows a 16P co...

Page 71: ...Rackmount Configurations 51 Figure 4 4 16P SGI 2400 Server Node boards Router boards Midplane R1 R2 R3 R4 ...

Page 72: ...System Configurations Figure 4 5 16P SGI 2400 Rackmount Server with Xpress Links Note Xpress links can double interconnect bandwidth in single rack systems Node boards Router boards Xpress links Midplane R1 R2 R3 R4 ...

Page 73: ...eer SSE Table 4 3 lists the number of various hardware components that can be supported through a multirack configuration Figure 4 6 and Figure 4 7 show two examples of 32P or processor configurations These systems require two racks along with the necessary CrayLink Interconnect cabling Each of the racks has two modules and each module has four Node boards and two Router boards This configuration ...

Page 74: ...the transmission throughput between modules and racks The Xpress links provide additional data routing which reduces potential transmission latency In Figure 4 7 all the available router ports are used To go beyond a 32 processor configuration the Xpress links must be removed and more CrayLink Interconnect cables must be installed Figure 4 8 represents a 64P configuration which is simply a double ...

Page 75: ...Multirack Configurations 55 Figure 4 7 32P with Express Links Node boards Router boards R1 R2 R3 R4 R1 R2 R3 R4 Xpress Links ...

Page 76: ...all of the available Router ports are now in use The 64P configuration is the largest one that can be supported using the Rack Router board To go beyond 64P requires the use of a meta router chassis With a meta router configurations of up to 128P are possible see Figure 4 9 Figure 4 8 64P Configuration Node boards Router boards Midplane ...

Page 77: ...Multirack Configurations 57 Figure 4 9 SGI 2800 128P Configuration 32p 32p 1 2 3 4 5 6 7 8 Cray Router 32p 32p 1 5 2 3 4 6 7 8 1 5 2 3 4 6 7 8 1 5 2 3 4 6 7 8 1 5 2 3 4 6 7 8 ...

Page 78: ......

Page 79: ...m can weigh up to 750 pounds when fully configured Use at least two people to move the system chassis and take care that the system does not tip or become unbalanced Also use at least two people to move the monitors Be sure to practice proper lifting techniques Customer maintenance is limited to the outside of the chassis which contains the peripherals No user serviceable parts are found within th...

Page 80: ...uct requires the use of external shielded cables in order to maintain compliance with Part 15 of the FCC rules Serial cables from different vendors are not compatible Verify the pinout of your cable before making the connection Use the following procedure to connect the ASCII terminal to your system 1 Go to the back of the system chassis and verify that the system power switch located in the lower...

Page 81: ...Connecting Your Terminal 61 Figure 5 1 Connecting a Terminal Terminal Console port ...

Page 82: ...cabling The maximum allowable length for single ended standard SCSI cabling is 19 6 feet 6 meters This length reflects the combined lengths of both the internal and the external cables The maximum allowable length for differential SCSI is 80 feet 25 meters As with the single ended SCSI this length is the sum of both the internal and the external cables A wide SCSI bus supports a maximum of sixteen...

Page 83: ...e box enclosure can support other types of drives depending on how the box is configured To insert a disk module follow these steps 1 If necessary snap the handle to the open position so that it is centered as shown in Figure 5 2 2 If you are adding a drive remove the drive filler plate that covers the drive slot you want to use 3 Align the new disk module with the drive guide as shown in Figure 5...

Page 84: ...64 Chapter 5 System Configuration and Operation Figure 5 2 Installing an SCA Drive Blank SCA drive Handle in closed position ...

Page 85: ...server s midplane Figure 5 3 shows the assigned addresses The internal SCSI bus is also terminated directly on the midplane Figure 5 3 SCSI Hardwire Addresses for the SGI 2400 and 2800 Server Module SCA drive 5 SCSI ID 5 SCA drive 4 SCSI ID 4 SCA drive 3 SCSI ID 3 SCA drive 2 SCSI ID 2 SCA drive 1 SCSI ID 1 CD ROM SCSI ID 6 ...

Page 86: ...cally into the chassis Follow these instructions to load the CD ROM into the drive 1 Press the eject button to release the CD ROM carrier see Figure 5 4 2 Hold the CD ROM diskette by the edges and place it into the holder clips as shown in Figure 5 4 3 Insert the CD ROM carrier into the drive ...

Page 87: ...Loading the CD ROM 67 Figure 5 4 Installing a CD ROM Into an SGI 2400 or 2800 Chassis Retainers Retainers ...

Page 88: ...nector on each rack Some racks may have two Ethernet connector ports one on each system module Follow these instructions to connect an Ethernet drop to your system 1 Locate the Ethernet line then route it to the rear of the chassis 2 Plug the cable into the applicable connector see Figure 5 5 Figure 5 5 Connecting an Ethernet to the System ...

Page 89: ...cord s of the system module s into either of the top two 20 amp receptacles of the PDU see Figure 5 6 Caution The system modules must be plugged into the PDU that is supplied with the rack Do not use a power source outside of the chassis The CrayLink Interconnect cabling scheme requires that the system modules share a common AC ground This helps prevent damage to internal hardware components 4 Con...

Page 90: ...70 Chapter 5 System Configuration and Operation Figure 5 6 Connecting the System Power Cable 220 Volt power source PDU power cable plug ...

Page 91: ...Initially Powering On the System 71 Figure 5 7 Turning On the PDU PDU off PDU on PDU power switch ...

Page 92: ...72 Chapter 5 System Configuration and Operation Figure 5 8 Powering On the System Rear View of Chassis ON OFF Module power switch ...

Page 93: ...tem Controller s MSC display Turn the key switch to the On position see Figure 5 9 Note The MSC begins the power on sequence The green power on LED located above the function buttons lights to indicate that power has been applied to the system midplane The amber fault LED then lights to indicate that power has been supplied to the MSC The fault LED goes out when the MSC has successfully initialize...

Page 94: ...ry Level System Controller Key Positions Diagnostic Port Ambient over temperature LED 8 digit LED display Module NMI switch Module reset switch AC OK LED DC OK LED Fan hi speed indicator LED Security key switch 8 pin mini DIN diagnostic port On Standby Diagnostic ...

Page 95: ...em or to list your system s hardware press Esc within five seconds Note If you do not press Esc within five seconds the system boot and display the login prompt If this happens login shut down the system using the System Shutdown command from the System Maintenance menu and then restart it when prompted When the System Maintenance menu appears type 5 to select Enter Command Monitor 5 When the prom...

Page 96: ...ith the system on a compact disc Place the CD in a secure place in case you need to reinstall the operating system Powering Off the System The system should be powered off only for routine maintenance or repair You can power your rack system off in a number of ways Bring the system down from a shell Become superuser by typing bin su and pressing Enter Enter your superuser password if prompted When...

Page 97: ...the System Controller to the Diagnostics position Use the scroll buttons to bring up the Reset menu Press the Menu button to activate the menu then press the Execute button to reset the system If the system is completely unresponsive use only the Reset function not the main power switch to reboot your system If your system responds to input use the shutdown option in the System Maintenance menu or...

Page 98: ......

Page 99: ...ser without undue exposure to high electrical power potentials CRUs are limited to the following major components see Figure 6 1 drive modules module System Controller MSC Warning Do not attempt to remove or replace hardware components such as boards that are not listed above This system uses internal electrical power that is hazardous if the equipment is improperly disassembled Failure to heed th...

Page 100: ...Removing and Replacing Customer Replaceable Units Figure 6 1 Customer Replaceable Units CRUs for the SGI 2400 or 2800 Server System controller CD ROM Facade Cable bail System disk Optional drives Blank drive panels ...

Page 101: ...hey are excessively bent stretched or stepped on This equipment is extremely sensitive and susceptible to damage by electrostatic discharge ESD which is caused by the buildup of electrical static potential on clothing and other materials Use proper ESD preventive measures and observe these precautions Wear a properly grounded wrist strap when connecting and disconnecting peripherals Be sure that y...

Page 102: ...rack configuration using the multimodule System Controller MMSC If you power off an individual module the other module s in the configuration can still operate fully Powering Off an Individual Module System Use these procedures to power off a module in a rack 1 Ensure and verify that the desired file systems are backed up and make sure that all users are off the target system 2 Become superuser th...

Page 103: ...mode does not turn power completely off to the module Voltage is still present in the system 4 Power off the module The switch is located in the rear of the chassis near the AC power cord receptacle see Figure 6 3 Disconnect the system from the power source Security key switch Standby Off ...

Page 104: ...84 Chapter 6 Removing and Replacing Customer Replaceable Units Figure 6 3 Powering Off a Rackmount Module ON OFF Module power switch ...

Page 105: ...play see Chapter 7 Using the System Controller for additional information Figure 6 4 Powering Off the Multimodule Controller 3 Turn off power to the power distribution unit PDU see Figure 6 5 Execute Cursor placement Focus Action View Configure Irix OS View A c t i v i t y Processors user system intr io graphics 0 1 2 3 4 5 6 7 100 0 25 50 75 Power Cycle NMI Reset Power Up Power Down 1 0 Current t...

Page 106: ...rack configuration 1 Power down the individual system modules see Powering Off an Individual Module System on page 82 2 Power off the individual racks It is recommended that you start from the rightmost rack and then continue with the rack to the left This helps ensure a cleaner and more efficient shutdown process 3 Turn off the rack with the MMSC last see Figure 6 6 4 Turn off the PDU on the last...

Page 107: ...General Procedures 87 Figure 6 5 Turning Off the PDU PDU off PDU on PDU power switch ...

Page 108: ...88 Chapter 6 Removing and Replacing Customer Replaceable Units Figure 6 6 Turning Off a Multirack Configuration Turn off the rack with the multi module display LAST ...

Page 109: ...e drive door as shown in Figure 6 7 When closing the door push it all the way in to engage the plastic tab on the bottom of the door Note The door should normally be in the closed position to help keep out dust and other possible contaminants from the drives and MSC Figure 6 7 Opening the Drive Front Door on a Rackmount System ...

Page 110: ...he Cable Cover Door The cable cover door see Figure 6 8 provides aesthetic shielding for the CrayLink Interconnect cabling on the rackmount chassis and between side by side rackmount systems Figure 6 8 Opening the Cable Cover Door Cable cover door for Craylink Interconnect ...

Page 111: ...RU use Figure 6 1 to identify the appropriate unit and its position in the chassis Then proceed to the appropriate section and perform the steps Removing a Drive Module Disk drive modules are aligned vertically at the front of the chassis Note that the leftmost disk drive the system drive is oriented differently from the others as shown in Figure 6 9 ...

Page 112: ...d unplugged 2 To remove a disk drive module snap the handle to the right or left depending on the drive orientation to the open position The handle is centered as shown in Figure 6 9 3 Pull the disk straight out see Figure 6 10 Handle in closed position System Disk Optional Disk Handle in open position Handle in open position Handle in closed position ...

Page 113: ...Specific Procedures 93 Figure 6 10 Removing the Drive Handle in open position Handle in closed position ...

Page 114: ...igure 6 10 In the case of the system disk module which is upside down relative to the other drives snap the handle left 7 Use the packaging for the new disk module to repackage the old disk module Removing the Facade The facade must be taken off before you can remove the System Controller and CD ROM assembly Use these procedures to remove the facade 1 Lift off the cable bales that hold the CrayLin...

Page 115: ...Removing the Facade from a System Module Fau lt 1 7 VDC 2 4 VDC 3 3 VDC Link Stat us 1 2 3 4 5 6 Connec tor Actuatio n 7 64 Hex Fau lt 1 7 VDC 2 4 VDC 3 3 VDC Link Stat us 1 2 3 4 5 6 Connec tor Actuatio n 7 64 Hex 9 64 Allen head screw ...

Page 116: ... entire new assembly Caution Do not attempt to remove the MMSC and display This procedure should only be performed by Silicon Graphics certified personnel 1 Power off the system see Powering Off a Rackmount System on page 82 2 Remove the facade see Removing the Facade on page 94 3 Remove and reserve the screws that hold the assembly in place as shown in Figure 6 12 4 Insert the new assembly using ...

Page 117: ...Specific Procedures 97 Figure 6 12 Removing the System Controller and CD ROM ...

Page 118: ...restrictions that must be followed when XIO boards are installed or removed Failure to follow these configuration rules may result in system or peripheral malfunction Always Keep the BaseIO IO6S or IO6G board installed in XIO slot 1 Fill the top XIO slots first XIO slots 3 and 5 should be filled first Have the PCI module installed in XIO slot 2 Never Move the BaseIO IO6S or IO6G board to a slot ot...

Page 119: ...ount system is an intelligent communcations device that can monitor one or more system modules within a rack The MSC in a deskside system or a rackmounted system module is less sophisticated than the MMSC Each MSC in a rack reports to and can be controlled by the MMSC MMSC The MMSC subsystem is composed of two main components the MMSC itself the front display and input panel 10BaseT Ethernet hub o...

Page 120: ...anel display The processor assemblies in multirack configurations communicate directly via a 10BaseT Ethernet connection This scheme provides access to every MMSC and MSC in a fabric interconnected multirack system Note that the MMSC Ethernet is a closed Ethernet system used by the MMSCs only Execute Cursor placement Focus Action Irix OS View Graph Configure Irix OS View A c t i v i t y Processors...

Page 121: ...MMSC 101 Figure 7 2 MMSC and Front Panel Multimodule controller Multimodule controller display To other Multimodule controllers ...

Page 122: ...munication between multiple fabric linked rack systems is accomplished with a 10BaseT Ethernet connection This allows you to communicate with and control system modules via their MSC in other racks from a single location Caution The front panel display provides a convenient method to power on shutdown reset and to issue a nonmaskable interrupt NMI to the entire rack configuration Use extreme care ...

Page 123: ...he direction keys then press the Enter key Make sure that the Al option is highlighted 2 Go to the Action menu on the display using the direction keys see Figure 7 4 3 Select the Power Up option and press the Enter key Figure 7 4 Action Menu Selection for MMSC Display Focus Action View Configure Power Down Power Cycle NMI Reset Power Up 1 0 Current target module all ...

Page 124: ...us menu on the display using the direction keys then press the Enter key Make sure that the All option is highlighted 2 Go to the Action menu on the display using the direction keys see Figure 7 4 3 Select the Power Down option and press the Enter key MMSC Assembly The MMSC mounts internally in the rack without removing any boards in the system Figure 7 5 Figure 7 6 and Figure 7 7 show MMSC cablin...

Page 125: ... 5 MMSC Cabling Console Multimodule system controller MMSC IO11 IO12 IO9 IO10 IO7 IO8 IO5 IO6 IO3 IO4 BASE I O TTY1 UPPER BAY LOWER BAY Alternate console TEST LOWER BAY UPPER BAY CONSOLE ALTERNATE CONSOLE BASE I O TTY1 ...

Page 126: ... 7 Using the System Controller Figure 7 6 MMSC to MMSC 10BaseT Ethernet Cabling 2 racks Multimodule System Controller Special null jumper or patch 10baseT cable 018 0625 001 Top view Multimodule System Controller ...

Page 127: ... Figure 7 7 MMSC to 10BaseT Hub 1BaseT Ethernet Cabling 2 racks Standard 10BaseT cable 018 0700 001 10BaseT Hub Multimodule System Controller Multimodule System Controller Multimodule System Controller Top view ...

Page 128: ...le in and out RS 232 connectors and a modem connector Note that when the MMSC is connected to the RS 232 interface on a system mounted in the rack you may not use the eight pin DIN connector on the front of a system module s MSC Figure 7 8 Processor Assembly Location in Rack Multimodule System Controller ...

Page 129: ...Figure 7 9 MSC Status Panel Serial Connector and Switches Diagnostic Port Ambient over temperature LED 8 digit LED display Module NMI switch Module reset switch AC OK LED DC OK LED Fan hi speed indicator LED Security key switch 8 pin mini DIN diagnostic port On Standby Diagnostic ...

Page 130: ...the back of the deskside system is a DB 9 alternate console diagnostic port serial connector that is a direct mirror of the 8 pin diagnostic connector on the front panel Figure 7 10 shows the location and pinouts of the 9 pin rear mounted MSC diagnostic connector Note You may not connect serial devices to both the front MSC diagnostic port and rear MSC diagnostic serial connector at the same time ...

Page 131: ...ctor System Controller Serial Port DB 9 System Controller serial port Pin 1 Ground Pin 2 Data Terminal Ready DTR Pin 3 Transmit Data TXD Pin 4 Request Data RXD Pin 5 Data Carrier Detect DCD Pin 6 Not Used Pin 7 Request to Send RTS Pin 8 Clear to Send CTS Pin 9 Not Used ...

Page 132: ...ux through the midplane as are other boards that require it The DC Power OK green LED lights three and one half seconds after the keyswitch is turned to the On position This indicates the system power supply is enabled and operating properly The Fan Speed High amber warning LED lights when the fans are running at high speed which may be an indication that ambient temperature is higher than optimal...

Page 133: ...gh speed fan operation when a fan fails Signals an impending shutdown when a single critical fan fails or two or more non critical fans fail LED display of high fan speed and possible fan tray failure fan high speed LED LED display of power supply operation AC OK LED indicates AC voltage applied to system DC OK indicates all power supply DC voltages 12 V 5 V 3 45 V and remote DC voltages 3 3 V 2 4...

Page 134: ...argining Margining allows the 3 45 V or 5 V outputs of the power supply to be moved 5 higher or lower independently This does not effect remote regulated termination voltages 1 6 V 2 4 V router 3 3 V Supports alternate console diagnostic port command line regulated termination voltage margining for the termination voltages 1 6 V 2 4 V and 3 3 V all termination voltages will be margined 5 higher or...

Page 135: ...ature has exceeded safety limits and the system has shut down PS FAIL The internal power supply has failed and the system has shut down OVR TEMP The system s temperature has exceeded acceptable limits and the system has shut down KEY OFF The MSCs switch has been turned to standby RESET The MSC s switch has been turned to the diagnostic position and the reset has been button pushed NMI The MSC s sw...

Page 136: ... system fan has failed If it is fan 1 2 or 3 the system shuts down A service call should be placed as soon as possible POK FAIL A power OK failure occurred on an unidentified board Table 7 1 continued System Controller Messages Message Meaning of Message ...

Page 137: ...ystem in a small poorly ventilated area such as a closet crowd other large objects around it or drape anything such as a jacket or blanket over it Do not place terminals on top of the system chassis Do not connect cables or add other hardware components while the system is turned on Do not power off the system frequently leave it running overnight and on weekends if possible Do not leave the key s...

Page 138: ...tem fully but you can reach the System Maintenance menu or PROM monitor Faulty You cannot reach the System Maintenance menu or PROM monitor If the behavior of your system is operational or marginal first check for error messages on the MSC display then perform a physical inspection using the checklist in the following section If all the connections seem solid restart the system If the problem pers...

Page 139: ...d The keyboard cable is securely connected to the keyboard at one end and to the terminal at the other end The system power cable is securely installed in the receptacle in the system chassis and in the proper AC outlet The network cable is connected to the appropriate port and that the key or lock used to secure the network connection is engaged Serial port cables are securely installed in their ...

Page 140: ...he first three require a service call by a qualified support technician Fixing the MSC Shutdown If you determine that a critical fan or fans have failed you should immediately place a service call The system is not usable until the faulty fan s are replaced If the problem involves the combined failure of a single noncritical fan and a high ambient temperature you should place a service call You ma...

Page 141: ...stem is presented first If it fails go on to the next method and so on Here is an overview of the different crash recovery methods rebooting the system Rebooting usually fixes problems associated with a simple system crash restoring system software If you do not find a simple hardware connection problem and you cannot reboot the system a system file might be damaged or missing In this case you nee...

Page 142: ......

Page 143: ...idth height 81 206 cm 47 120 cm 49 125 cm Weight minimum empty rack maximum full rack shipping maximum 300 lbs 136 kg 750 lbs 340 kg 900 lbs 408 kg Floor Loading minimum maximum 38 lb ft2 185 kg m2 95 lb ft2 466 kg m2 Air Temperature operating 5000 ft operating 5000 ft non operating 41 to 95 F 5 to 35 C 41 to 86 F 5 to 30 C 4 to 140 F 20 to 60 C Thermal Gradient maximum 18 F 10 C per hour Altitude...

Page 144: ...trical and Cooling Specifications Parameter Specification Voltage 187 264 Volts 1 phase Watts from the wall maximum 5750 watts Power Factor minimum 0 98 Inrush Current maximum 400 Frequency 47 63 Hertz Heat Output maximum 19 550 Btu hr 1 63 ton AC load ...

Page 145: ...cumentation xvii available via the World Wide Web xviii release notes xviii E electrostatic 81 environmental monitoring 110 environmental temperature 112 ESD 81 F fan failure detection 112 field replaceable unit identifying 91 field replaceable units 79 G General procedures 82 grelnotes command xviii H hardware maintenance of 117 118 Help xvii I InSight documentation xvii L LED readout on MSC 115 ...

Page 146: ...e disconnecting 83 R rear mounted System Controller connector 110 release notes viewing xviii relnotes command xviii removable keyswitch 114 RS 232 standard 38 S safety information 81 shielding 90 soft power off 113 soft power off commands 114 System Controller front panel 109 messages 115 serial connectors 110 system reset switch 113 system wide reset 112 W Weight 123 World Wide Web documentation...

Reviews: