Silicon Graphics SGI Altix 450 User Manual Download

Page: 7 / 198

Contents

007-4857-002

vii

Operation Procedures

. . . . . . . . . . . . . . . . . . . . . . 47

Precautions . . . . . . . . . . . . . . . . . . . . . . . . . 47

ESD Precaution . . . . . . . . . . . . . . . . . . . . . . . 47

Safety Precautions . . . . . . . . . . . . . . . . . . . . . . 48

System Controller Network . . . . . . . . . . . . . . . . . . . . . 49

Console Connections . . . . . . . . . . . . . . . . . . . . . . 50

Connecting to the System Controller . . . . . . . . . . . . . . . . . . 50

Communicating with the System Controller . . . . . . . . . . . . . . . . 51

Powering the System On and Off . . . . . . . . . . . . . . . . . . . 51

Preparing to Power On . . . . . . . . . . . . . . . . . . . . . 52

Powering On and Off at the Console . . . . . . . . . . . . . . . . . 54

Powering On and Off from the L1 . . . . . . . . . . . . . . . . . 54

Powering-On and Off From the L2 . . . . . . . . . . . . . . . . 56

Using Embedded Support Partner (ESP) . . . . . . . . . . . . . . . . . 56

Monitoring Your Server . . . . . . . . . . . . . . . . . . . . . . 57

2D Graphics Video Interface . . . . . . . . . . . . . . . . . . . . 58

Installing Optional Components. . . . . . . . . . . . . . . . . . . . 59

I/O Blade Overview . . . . . . . . . . . . . . . . . . . . . 60

Adding or Removing Disk Drives . . . . . . . . . . . . . . . . . . 61

Reconfigure the System Disk Drive(s) for RAID 1 . . . . . . . . . . . . . 61

System Overview

. . . . . . . . . . . . . . . . . . . . . . . 67

System Models . . . . . . . . . . . . . . . . . . . . . . . . 68

System Architecture . . . . . . . . . . . . . . . . . . . . . . . 70

System Features . . . . . . . . . . . . . . . . . . . . . . . . 72

Modularity and Scalability . . . . . . . . . . . . . . . . . . . . 72

Distributed Shared Memory (DSM) . . . . . . . . . . . . . . . . . 72

Distributed Shared I/O . . . . . . . . . . . . . . . . . . . . . 73

ccNUMA Architecture . . . . . . . . . . . . . . . . . . . . . 73

Cache Coherency . . . . . . . . . . . . . . . . . . . . . 73

Non-uniform Memory Access (NUMA) . . . . . . . . . . . . . . . 74

Reliability, Availability, and Serviceability (RAS) . . . . . . . . . . . . . 74

Summary of Contents for SGI Altix 450

Page 1: ...SGI Altix 450 System User s Guide Document Number 007 4857 002 ...

Page 2: ...e intellectual property laws treaties and conventions This document is provided with limited rights as defined in 52 227 14 The electronic software version of this document was developed at private expense if acquired under an agreement with the USA government or any contractor thereto it is acquired as commercial computer software subject to the provisions of its applicable license agreement as s...

Page 3: ...007 4857 002 iii Record of Revision Version Description 001 August 2006 First release 002 March 2007 Engineering updates to cover RAID 1 DVD R W 2D graphics and IA2 ...

Page 4: ......

Page 5: ... xvii Audience xvii Important Information xvii Chapter Descriptions xviii Related Publications xix Conventions xxi Product Support xxi Reader Comments xxii 1 System Installation 1 System Installation Overview 2 Safety Precautions 3 Hazard Statements 4 ESD Precautions 4 Safety Measures 5 ...

Page 6: ...24 Determining Space Requirements 24 Determining Where to Attach Rails in a Rack 25 Rackmounting IRUs with Shelf Rails 26 Removing a Rackmounted IRU Module 28 NUMAlink Cabling the System IRUs 29 Cabling the System IRUs to a Power Source 31 Connecting an IRU Module to a Power Source No Rack 31 Connecting System Modules to a Rack Power Source 34 Connecting the System Console 36 Operating Your System...

Page 7: ...1 54 Powering On and Off From the L2 56 Using Embedded Support Partner ESP 56 Monitoring Your Server 57 2D Graphics Video Interface 58 Installing Optional Components 59 I O Blade Overview 60 Adding or Removing Disk Drives 61 Reconfigure the System Disk Drive s for RAID 1 61 3 System Overview 67 System Models 68 System Architecture 70 System Features 72 Modularity and Scalability 72 Distributed Sha...

Page 8: ...ewing System Configuration from an IRU s Perspective 86 Command Targeting 86 Console Mode from L1 87 L1 Console Selection 88 Viewing Information Warnings and Error Messages 89 L2 Operation 89 Configuring an L2 s IP Address 89 Viewing System Configuration 91 Setting Command Targeting 92 Viewing Information Warnings and Error Messages 94 Powering On Powering Off and Resetting the System From the L2 ...

Page 9: ...g and Replacing a Compute Memory Blade 118 Memory DIMM Group Placement and Guidelines 121 Remove and Replace the DVD Drive 123 Overview of PCI Express Operation 127 Adding or Replacing PCI PCI X Cards 128 Installing PCI Cards in the Three Slot Blade 129 Add or Remove a PCI Card in Base IA Blades 136 Installing or Replacing a Disk Drive in the IA Blade 138 Removing a System Disk Drive 139 Installin...

Page 10: ...atory Specifications 165 Safety Information 165 Regulatory Specifications 167 CMN Number 167 CE Notice and Manufacturer s Declaration of Conformity 167 Electromagnetic Emissions 168 FCC Notice USA Only 168 Industry Canada Notice Canada Only 169 VCCI Notice Japan Only 169 Chinese Class A Regulatory Notice 169 Korean Class A Regulatory Notice 169 Shielded Cables 170 Electrostatic Discharge 170 Laser...

Page 11: ...3 Figure 1 11 Mounting Hole Pattern of Rack Rails 25 Figure 1 12 Installing the Shelf Rails in the Rack 26 Figure 1 13 Securing the Module to the Front of the Rack 27 Figure 1 14 NUMAlink Cabling an IRU to an Additional IRU 30 Figure 1 15 Power Supply Connectors on the IRU Module 32 Figure 1 16 Connecting an Unracked IRU System to a Power Source 33 Figure 1 17 Connecting Multiple Modules to a PDU ...

Page 12: ...er Supply 114 Figure 6 5 IRU Fan Assembly Blowers 115 Figure 6 6 Removing a Fan From the IRU 116 Figure 6 7 Replacing an IRU Fan 117 Figure 6 8 Removing a Compute Memory Blade From the IRU 119 Figure 6 9 Replacing a Compute Memory Blade in the IRU 120 Figure 6 10 DIMM Group Locations Diagram 122 Figure 6 11 DIMM Memory Slot Location Example 123 Figure 6 12 DVD Removal from IA Blade 125 Figure 6 13...

Page 13: ... Disk Drive 139 Figure 6 28 Replacing a Disk Drive 141 Figure 7 1 Compute Blade Status LED Locations 149 Figure 7 2 Full Support Sequence 150 Figure A 1 Ethernet Port 159 Figure A 2 Serial Port Connector 160 Figure A 3 Pin Number Locations for External SAS SATA Port 162 Figure A 4 Pin Number Locations for USB Type A Connector 163 Figure B 1 VCCI Notice Japan Only 169 Figure B 2 Chinese Class A Reg...

Page 14: ......

Page 15: ...hart 144 Table 7 2 L1 Controller Messages 145 Table 7 3 Power Supply LED States 147 Table A 1 Altix 450 System Configuration Ranges 153 Table A 2 Altix 450 Tall Rack System Physical Specifications 154 Table A 3 Altix 450 Short Rack System Physical Specifications 155 Table A 4 Environmental Specifications 42U Rack 156 Table A 5 Environmental Specifications 20U Rack 156 Table A 6 Power Specification...

Page 16: ......

Page 17: ...anty your SGI or other approved system support engineer SSE should perform any replacement of parts or service of your SGI Altix 450 system not covered in the following list of items that you can perform yourself Unpacking setting up and connecting the system rack s and individual rack units IRU s Using your system console and your L1 controller to enter commands and perform system functions such ...

Page 18: ...ter 4 System Control describes the function of the L1 and L2 controllers and provides instructions for operating the controllers Chapter 5 Rack Information describes the rack sizes and features Chapter 6 Maintenance and Upgrade Procedures provides instructions for installing or removing the customer replaceable components of your system Chapter 7 Troubleshooting and Diagnostics provides recommende...

Page 19: ...ages locate and print the titled entries from the online reference manuals You can obtain SGI documentation release notes or man pages in the following ways See the SGI Technical Publications Library at http docs sgi com Various formats are available This library contains the most recent and most comprehensive set of online books release notes man pages and other information The release notes whic...

Page 20: ... command is found For additional information about displaying man pages using the man command see man 1 In addition the apropos command locates man pages based on keywords For example to display a list of man pages that describe disks type the following on a command line apropos disk For information about setting up and using apropos see apropos 1 ...

Page 21: ...les routines path names signals messages and programming language structures variable The italic typeface denotes variable entries and words or concepts being defined Italic typeface is also used for book titles user input This bold fixed space font denotes literal items that the user enters in interactive sessions Output is shown in nonbold fixed space font Brackets enclose optional portions of a...

Page 22: ... of the manual In printed manuals the document number is located at the bottom of each page You can contact SGI in any of the following ways Send e mail to the following address techpubs sgi com Contact your customer service representative and ask that an incident be filed in the SGI incident tracking system Send mail to the following address Technical Publications SGI 1140 East Arques Avenue M S ...

Page 23: ...fety Precautions on page 3 Installing a Rack on page 6 Unpacking and Inspecting Modules on page 22 Installing the IRUs in a Rack on page 24 NUMAlink Cabling the System IRUs on page 29 Cabling the System IRUs to a Power Source on page 31 If you have arranged to have your system installed and set up by SGI professional services personnel you can skip this chapter and go on to Chapter 2 Operation Pro...

Page 24: ...that compose your system are also already cabled together follow the instructions in these sections Safety Precautions on page 3 Installing a Rack on page 6 Cabling the System IRUs to a Power Source on page 31 Connecting the System Console on page 36 If you have ordered un racked IRU modules with the intention of rackmounting and cabling your own server system follow the instructions in these sect...

Page 25: ... ordered system modules with the intention of rackmounting and cabling your own system follow the instructions in these sections Safety Precautions on page 3 Unpacking and Inspecting Modules on page 22 Installing the IRUs in a Rack on page 24 NUMAlink Cabling the System IRUs on page 29 Cabling the System IRUs to a Power Source on page 31 Connecting the System Console on page 36 Safety Precautions ...

Page 26: ...potentially hazardous situation that if not avoided could result in death or serious injury A warning message is accompanied by icon as shown in the following example Warning Danger indicates an imminently hazardous situation that if not avoided will result in death or serious injury A danger message is accompanied by the same icon as a warning ESD Precautions Observe electrostatic discharge ESD p...

Page 27: ...lift and position Do not move the system while it is connected to power Warning Keep fingers and conductive tools away from high voltage areas Failure to follow these precautions will result in serious injury or death The high voltage areas of the system are indicated with high voltage warning labels Ensure that a qualified electrician has properly installed the power receptacles Set all PDU circu...

Page 28: ... in a rack skip this section and proceed to Unpacking and Inspecting Modules on page 22 to begin your installation Preinstallation Activities Perform the following preinstallation activities Perform site verifications see Site Plan Verification on page 6 Gather appropriate tools to complete the installation see Tools Required on page 7 Ensure that the correct power receptacle is installed and prop...

Page 29: ...m wrench 7260744 Adjust the leveling pads 13 mm socket 3 8 in drive 7260726 Remove bracket bolts from tall rack shipping crate 19 mm socket 3 8 in drive 9470618 Remove bolts from short rack shipping crate Extension 6 in 3 8 in drive 7260655 Used with ratchet and sockets Ratchet reversible 3 8 in drive 7260755 Used with extension and sockets Level 9 in 9470556 Level the rack ...

Page 30: ...at a single phase power receptacle is properly wired 1 Set the voltmeter to a high AC voltage range 2 Check the voltage between socket X and socket Y see Figure 1 1 The meter should read between 200 and 240 VAC 3 Check the voltage between socket X and the ground socket The meter should read approximately 120 VAC 4 Check the voltage between socket Y and the ground socket The meter should read appro...

Page 31: ...Installing a Rack 007 4857 002 9 Figure 1 1 30 amp Single phase Power Receptacle for North American Sites Ground socket Socket X Receptacle Socket Y Power cord connector Pole Y Pole X Ground pole ...

Page 32: ...er than the other two pins 4 Check the voltage between socket 2 neutral and the ground socket The meter should read approximately 0 VAC 5 Check the voltage between the ground socket and an earth ground location The meter should read 0 VAC 6 Change the voltmeter to a low resistance setting 7 Measure between the ground socket and an appropriate earth ground location and ensure that resistance is les...

Page 33: ...lling a Rack 007 4857 002 11 Figure 1 2 32 amp Single phase Power Plug for International Sites Power cord connector Socket 1 line Ground socket Socket 2 neutral Receptacle Pin 2 neutral Ground pin Pin 1 line ...

Page 34: ...load and transport the rack system to its designated location as follows Unloading the Equipment from the Truck on page 12 Inspecting the Shipping Crate on page 14 Transporting the Shipping Crate on page 15 Unloading the Equipment from the Truck If your loading dock is the same height as the transportation vehicle use a pallet jack to unload the system from the transportation vehicle The pallet ja...

Page 35: ...o or three people are available to help unload the equipment Move all crates slowly and carefully Figure 1 3 shows the lift openings and dimensions of a tall rack shipping crate This figure also shows where to position the pallet jack Figure 1 3 Dimensions of Tall Rack Shipping Crate Pallet jack position Side view 52 0 1320 8 mm 81 5 2070 1 mm 42 1066 8 mm End view ...

Page 36: ...Ensure that the crates and cartons arrive unopened 2 Inspect the shipping crate for signs of external damage such as dents holes crushed corners and water marks 3 Ensure that the tilt watch has not been tripped 4 If the crate is damaged file a damage claim with the carrier immediately In addition notify your local Customer Support Center CSC for any missing incorrect or damaged items For CSC conta...

Page 37: ... jack If the crate does not fit through all access doors you may need to partially disassemble the crate Caution If the system shipping or storage environment is significantly colder than the environment in which it will be installed 40 ºF 22 ºC or greater disparity leave the rack in its shipping crate for at least 24 hours at room temperature before you start the installation This acclimation pre...

Page 38: ...e rack is acclimated to the environment in which you are installing it and move the crate to the installation location 2 Remove all external banding and lift the crate s ramp away from the unit 3 Remove the cardboard carton top and packing insulation materials 4 Prepare to move the rack off the crate using the following steps a Remove the two bolts that hold the pallet s rear retention bracket in ...

Page 39: ...Installing a Rack 007 4857 002 17 Figure 1 5 Removing a Short Rack from the Shipping Crate Foam cushion Cardboard cover 1 3 4a 4b 4c 5 2 Ramp Rear mounting bracket Front mounting bracket 6 ...

Page 40: ...1 Use a sharp cutting tool to remove the bands that secure the cardboard crate then remove the outer packing materials 2 Remove the cover bag and bungee cushion from the rack 3 Locate and remove the 8 bolts that secure the wooden frame pieces to the base 4 The rack s front and rear doors must be removed before you can remove the rack s shipping runners 5 Remove and discard the foam plugs from eith...

Page 41: ...talling a Rack 007 4857 002 19 Figure 1 6 Removing a Tall Rack from the Shipping Crate COMPACT 1 2 4 Bungee cushion COMPACT COMPACT COMPACT COMPACT 3 5 COMPACT 6 Foam plug COMPACT COMPACT COMPACT COMPACT 7 ...

Page 42: ...20 007 4857 002 1 System Installation Figure 1 7 Reattaching the Tall Rack Doors COMPACT COMPACT COMPACT COMPACT ...

Page 43: ... is level Figure 1 8 Leveling Bolts 4 If you are installing additional racks repeat until all of the racks are level 5 Ensure that the circuit breakers on the power distribution units are in the OFF O position Then connect the power cords to grounded power outlets Plugging in the power cords grounds the racks 6 It is recommended you secure all racks with optional seismic tie downs if you are insta...

Page 44: ...ove the IRU s from the packaging container and ensure that all accessories are included Inspect the IRU s and accessories for damage If the contents appear damaged file a damage claim with the carrier immediately In addition notify your local SGI Customer Support Center CSC for any missing incorrect or damaged items For CSC contact information see http www sgi com support supportcenters html Note ...

Page 45: ...lide it in until it fully joins together 2 Align the right side joining plate screw holes with the eight holes in the two adjacent modules See Figure 1 10 for an example 3 Insert and tighten the eight retention screws that hold the connection plate in place 4 Repeat the process for mounting the joining plate on the left side of the IRU Figure 1 10 IRU Connection Plate for Desktop Systems COMPACT i...

Page 46: ... in a Rack on page 25 Rackmounting IRUs with Shelf Rails on page 26 Determining Space Requirements Table 1 2 specifies the space requirements when rackmounting an IRU in a 19 inch rack Table 1 2 IRU Space Requirements Height 5U 8 68 inches 22 cm Width 17 5 inches 44 45 cm Depth 32 5 inches 82 5 cm with blower attached Weight 130 lb 59 kg max configa a Weight will vary slightly depending on the num...

Page 47: ... 5U space is hole 1 The top mounting hole in the 5U space is hole 15 See Figure 1 11 Note An IRU in the rack is identified by the lowest U number that it occupies For example in Figure 1 11 the IRU s bottom is in U1 the first unit within the rack Figure 1 11 Mounting Hole Pattern of Rack Rails To determine how many mounting holes you must count use the following formula 3 x the lowest U number tha...

Page 48: ...p 1 position the left shelf rail at a 90 degree angle to the front and rear rack rails see Figure 1 12 3 Insert the top front bracket tab into one of the narrow slots in the front rack rail 4 Insert the top rear bracket tab into the narrow slot in the rear rack rail Note Verify that the tabs are the same height to ensure that the shelf is level in the rack 5 Lower the bottom of the shelf rail unti...

Page 49: ...he module ears are snug against the front rack rails See Figure 1 13 8 Fasten the module to the front rails of the rack with the screws provided See Figure 1 13 9 Working from the rear of the rack align the rear connectors of the fan module with the rear of the IRU base module and carefully slide it in until it fully connects together 10 Fasten the fan module to the rear rails of the rack with the...

Page 50: ...ponents may be hot To avoid injury allow the components to cool for approximately five minutes before you proceed with these instructions 4 Remove the screws that secure the module to the front rails of the rack 5 Remove the screws that secure the IRU at the rear of the rack Caution Always use at least two people when installing or removing a rackmounted Altix 450 IRU 6 Use a minimum of two people...

Page 51: ... Figure 1 14 shows an example Note Before you connect two Altix 450 IRUs to each other you must assign unique system ID numbers to the compute modules as follows 1 Designate one of the IRU modules as the master server and the other IRU chassis as the slave 2 Connect a console to the master IRU see Connecting the System Console on page 36 and then power on the IRU see Powering the System On and Off...

Page 52: ...er off both compute modules see Powering the System On and Off on page 38 2 Connect the NUMAlink cables to the NUMAlink connectors on both IRU modules 3 Connect a system console to the master IRU the one with the system disk as described in Connecting the System Console on page 36 4 Power on both IRUs as described in Powering the System On and Off on page 38 COMPACT COMPACT inside TM inside TM ...

Page 53: ... and L2 Controller Software User s Guide 007 3938 00x for more information on L1 commands Cabling the System IRUs to a Power Source This section describes how to make the following connections to a power source Connecting an IRU Module to a Power Source No Rack on page 31 Connecting System Modules to a Rack Power Source on page 34 Connecting an IRU Module to a Power Source No Rack If you are opera...

Page 54: ...7 4857 002 1 System Installation Figure 1 15 Power Supply Connectors on the IRU Module Figure 1 16 shows the connecting of a dual IRU system located on either a tabletop or desktop to a power source insideTM ...

Page 55: ...Cabling the System IRUs to a Power Source 007 4857 002 33 Figure 1 16 Connecting an Unracked IRU System to a Power Source Power distribution unit PDU Power source COMPACT inside TM COMPACT inside TM ...

Page 56: ...th power cords from each IRU into the PDU s installed in your short or tall rack Figure 1 17 shows an example of cabling the system modules that reside in a rack to a PDU Figure 1 17 Connecting Multiple Modules to a PDU An optional three phase PDU used in 42U system racks only has 18 outlet connections of which up to 16 may be needed to power eight IRUs Each three phase rack system houses a single...

Page 57: ...he System IRUs to a Power Source 007 4857 002 35 Figure 1 18 shows an example of the optional three phase PDU available in tall racks only Figure 1 18 Optional Three Phase PDU Example Power distribution unit PDU ...

Page 58: ...ect a null modem serial cable between the PC and the Console port of the IRU see Figure 1 19 To establish a connection between your system and the system console PC follow these steps 1 Ensure that the L1 controller of the base compute module is powered on When the base compute module is connected to a power source the L1 controller should be powered on Note When powered on the L1 controller displ...

Page 59: ...Connecting the System Console 007 4857 002 37 Figure 1 19 Location of the L1 Console Port Console port Reset button Ethernet port inside TM L1 controller panel ...

Page 60: ...sole on page 41 Powering Off at the System Console on page 42 Powering Off Manually on page 43 Preparing to Power On To prepare to power on your system follow these steps 1 Confirm that all the cable connections between the IRUs and other system items are connected securely If necessary see NUMAlink Cabling the System IRUs on page 29 for information 2 Confirm that all the power cables are plugged ...

Page 61: ...ibed in Connecting the System Console on page 36 2 If the monitors and other peripherals are equipped with voltage select switches verify that they are set for the appropriate AC voltage and plug them in Note that they are normally plugged into sources outside the rack system 3 Turn on the on off circuit breaker switchs of the PDU as shown in Figure 1 20 Figure 1 20 PDU Circuit Breakers Example Po...

Page 62: ...IRU by entering the following command If you want to power on the entire system proceed to Step 8 L2 r rack s slot pwr u For example to power on a IRU in rack 1 slot 18 enter the following command L2 r 1 s 18 pwr u The slot number is the unit number of the IRU within the rack If you want to power on two selected IRUs of a rack at the same time you must enter the rack number followed by the slot nu...

Page 63: ...n the circuit breaker switchs of the PDU to the on position see Figure 1 20 on page 39 3 Press the power buttons see Figure 1 21 on each of the IRUs that you want to power on Note that any optional storage modules should be powered up first Figure 1 21 Location of the Power Button To boot the system from the L1 interface you must have a console connected to the system via the console port Use the ...

Page 64: ...to power off the IRU in rack 1 slot 16 enter the following command L2 r 1 s 16 pwr d The slot number is the unit number of the IRU within the rack If you want to power off more than one IRU in the rack at the same time enter the rack number followed by the slot numbers of the IRUs that you want to power off For example to power off the IRUs in slots 16 and 21 enter the following command L2 r 1 s 1...

Page 65: ...n the operating system by entering the following command init 0 2 Press the power buttons or power switches on each of the IRUs that you want to power off You may power off the IRUs in any order To power off the optional storage units press the power button s on its rear panel to the OFF O position To power off the IRUs press the power button with the LED on the front panel of each unit see Figure...

Page 66: ...he module is down Power button Normally you power on the system from the system console Alternatively you can press this button to power on the module Reset button Actuate this button to reset the internal processors and ASICs The reset will cause a memory loss To perform a reset without losing memory see the NMI button information that follows NMI button Actuate the NMI non maskable interrupt but...

Page 67: ...mands when you see a prompt of the following form 001c01 L1 See the SGI L1 and L2 Controller Software User s Guide 007 3938 00x for a detailed list of L1 commands To enter console mode press Ctrl D at the L1 prompt as follows 001c01 L1 Ctrl D entering console mode 001c01 console CTRL T to escape to L1 system output appears here To return to L1 mode press Ctrl T as follows Ctrl T escaping to L1 sys...

Page 68: ...46 007 4857 002 1 System Installation escaping to L1 system controller 001c01 L1 l1 L1 command processor engaged CTRL D for console mode 001c01 L1 ...

Page 69: ...n page 57 Installing Optional Components on page 59 Precautions Before operating your system familiarize yourself with the safety information in the following sections ESD Precaution on page 47 Safety Precautions on page 48 ESD Precaution Caution Observe all ESD precautions Failure to do so can result in damage to the equipment Wear an SGI approved wrist strap when you handle an ESD sensitive devi...

Page 70: ...e warning labels Caution Power off the system only after the system software has been shut down in an orderly manner If you power off the system before you halt the operating system data may be corrupted Warning If a lithium battery is installed in your system as a soldered part only qualified SGI service personnel should replace this lithium battery For a battery of another type replace it only w...

Page 71: ...t The console mode Level 2 L2 system controller is an application that provides control over multiple L1s and communication to other L2s The L2 is resident and active when the enclosure is connected by an Ethernet connection to a Local Area Network LAN The system controller network provides the following functionality Powering the entire system on and off Powering individual IRUs on and off Monito...

Page 72: ...empt to acquire an IP address via DHCP and will then spawn the L2 application See the section on setting up an IP address for further details Once the system controller is connected to the LAN it can be accessed via a simple telnet session The serial connection is used to communicate directly with the L1 system controller This connection is typically used for service purposes or for system control...

Page 73: ...1 or L2 mode enter control t followed by either l1 or l2 depending on the original mode System control commands are always entered in lower case unless otherwise specified Powering the System On and Off This section explains how to power on and power off individual rack units or your entire Altix 450 system as follows Preparing to Power On on page 52 Powering On and Off at the Console on page 54 F...

Page 74: ... PDUs to the On position will apply power to the IRU and will start the system controller s in the IRUs Note that the system controller in each IRU stays powered on as long as there is power coming into the unit Figure 2 1 IRU Power Supply Cable Location Example 3 If you plan to power on a server that includes optional mass storage enclosures make sure that the power switch on the rear of each PSU...

Page 75: ...Powering the System On and Off 007 4857 002 53 Figure 2 2 Single Phase Rack PDU Circuit Breaker Switches Power distribution unit PDU Power source On off switches ...

Page 76: ...ssued at the L1 prompt typically only affect the local IRU The following sections describe how to power on and power off your system in L1 mode The L1 controller display located on the front of each IRU should display L1 running once the power on procedure starts storage modules do not have L1s The prompt on your console screen shows the rack and slot number of the IRU to which you have connected ...

Page 77: ...other IRUs are NUMAlink attached to the IRU information about those IRUs Note Verify that the power LED on the L1 display turns on and lights green and that your controllers display that the system is powered on for each segment of the procedure which indicates that the power on procedure is proceeding properly If you have a problem while powering on and an error message appears on the L1 controll...

Page 78: ...I system support engineers SSEs to proactively support systems and resolve issues before they develop into actual failures ESP enables users to monitor one or more systems at a site from a local or remote connection ESP can perform the following functions Monitor the system configuration events performance and availability Notify SSEs when specific events occur Generate reports ESP also supports t...

Page 79: ...e you to view the status and error messages generated by the L1 L2 controllers in your Altix 450 rack You can also use these consoles to input L1 L2 commands to manage and monitor your system A DVI VGA video card allows you to interact directly with the system though not directly with the system s L1 L2 interface See 2D Graphics Video Interface on page 58 for more information SLES 10 or later is r...

Page 80: ...no audio function is supported The 2D video card has the following features 64 MB DDR graphics memory DMS 59 display connector for two display support no synchronization between monitors Simultaneous display to DVI and VGA monitors using an adapter Analog resolution up to 2048 x 1536 per display DVI resolution up to 1600 x 1200 per display Note A single USB keyboard mouse is supported by the IA2 b...

Page 81: ...n add or replace the following hardware items on your Altix 450 series server Peripheral component interface PCI cards into your system I O blades Disk drives in your IA IA2 blade base I O The sections that follow discuss these activities in more detail SAS 4X USB0 USB1 USB2 USB3 HDD0 HDD1 DVDROM ETH0 ETH1 PCI X 1 PCI X 0 F1 F2 F3 F4 A1 A2 A3 A4 P0 PF N0 N1 2D graphics card ...

Page 82: ...m disk and DVD drives that are also resident in the IA blade The IA2 blade differs from the original IA base I O in that it supports RAID 1 disk mirroring and DVD R W capabilities The optional three slot PCI PCI X double wide blade holds three sled mounted PCI PCI X cards for easy insertion and extraction from the system It is only used in A450 systems that have more than one IRU The optional sing...

Page 83: ...e customer and configured at the SGI factory If a requirement exits to reconfigure the system disk s use the following information to make the changes needed The lsiutil configuration software is the only supported methodology for modifying the disks at the time this document was published Use of other software interfaces has not been verified and cannot be supported Important The example process ...

Page 84: ... phy 98 Reset SAS link 99 Reset port e Enable expert mode in menus p Enable paged mode in menus w Enable logging Main menu select an option 1 99 or e p w or 0 to quit 8 Important After this command is entered the load device cannot be accessed again to open files until lsiutil has been exited and restarted SAS1068 s links are 3 0 G 3 0 G down down down down down down B___T___L Type Vendor Product ...

Page 85: ... Show non default settings 61 Restore default settings 97 Reset SAS phy 98 Reset SAS link 99 Reset port e Enable expert mode in menus p Enable paged mode in menus w Enable logging Main menu select an option 1 99 or e p w or 0 to quit 21 1 Show volumes 2 Show physical disks 3 Get volume state 23 Replace physical disk 30 Create volume 31 Delete volume 32 Change volume settings 50 Create hot spare 99...

Page 86: ...ume was created RAID actions menu select an option 1 99 or e p w or 0 to quit 1 1 volume is active 2 physical disks are active Volume 0 is Bus 0 Target 0 Type IM Integrated Mirroring Volume State degraded enabled resync in progress Volume Settings write caching disabled auto configure Volume Size 139898 MB Stripe Size 0 KB 2 Members Primary is PhysDisk 0 Bus 0 Target 56 Secondary is PhysDisk 1 Bus...

Page 87: ... Running LoadFile CLIENT MAC ADDR 08 00 69 14 E3 0C CLIENT IP 137 38 82 91 MASK 255 255 255 0 DHCP IP 137 38 228 4 GATEWAY IP 137 38 82 252 137 38 82 254 TSize Running LoadFile Starting netboot ELILO Quietly populating dev sda2 and dev sda1 with ia64 propack51 sles10 Jan19 reboot Note The initial resynchronization of the mirrored disk depending on the size of the disk may take up to 45 minutes or ...

Page 88: ...t 1 For information on the two RAID 1 disks use the lsscsi command as shown in the following example lsscsi 1 0 0 0 disk SGI ST3146854SS X422 dev sg2 1 0 1 0 disk SGI ST3146854SS X422 dev sg3 1 1 0 0 disk LSILOGIC Logical Volume 3000 dev sdc dev sg4 This is an example of what you ll see on SLES10 or RHEL5 Linux operating systems Disk 1 0 0 0 and 1 0 1 0 are the individual drives in the RAID 1 but ...

Page 89: ...rs in the system Because the DSM system is modular it combines the advantages of low entry level cost with global scalability in processors memory and I O You can install and operate the Altix 450 series system in your lab or server room Each 20U SGI rack holds from one to four 5U high enclosures that support up to five compute memory and I O sub modules known as blades These blades are single pri...

Page 90: ...ane Each router has two ports that are brought out to external NUMAlink 4 connectors The 20U or 42U rack for this server houses all IRU enclosures option modules and other components up to a 76 processor core configuration 38 processor sockets in a single rack The Altix 450 server system needs a minimum of one IA IA2 blade base I O The rack system requires a minimum of one 20U high rack with one s...

Page 91: ...7 4857 002 69 Figure 3 2 SGI Altix 450 Server System Tall Rack You can also add additional PCI expansion blades or RAID and non RAID disk storage to your server system Figure 3 3 shows an individual blade IRU and Rack ...

Page 92: ...h special crossbar switches routers This combination of processors memory and crossbar switches constitute the interconnect fabric called NUMAlink There are two internal router switches on each 5U IRU enclosure The basic expansion building block for the NUMAlink interconnect is the processor node each processor node consists of a Super Hub SHub ASIC and one or two 64 bit processors with three leve...

Page 93: ... and NUMAlink 4 cables provides a high bandwidth extremely low latency interconnect between all processor I O and other option blades within the system Figure 3 4 shows a functional block diagram of the Altix 450 series IRU components Figure 3 4 Functional Block Diagram of the Individual Rack Unit IRU Blade Slot 4 Blade Slot 3 Blade Slot 2 Blade Slot 1 Blade Slot 0 B C D F E G H A rtr B D E F H G ...

Page 94: ...ual blades that create the basic functionality compute memory I O and power into IRUs The air cooled IRU enclosure system has redundant hot swap fans and redundant hot swap power supplies at the IRU level Distributed Shared Memory DSM In the Altix 450 system memory is physically distributed both within and among the IRU enclosures compute memory I O blades however it is accessible to and shared by...

Page 95: ...tent the ccNUMA architecture uses directory based coherence protocol In directory based coherence protocol each block of memory 128 bytes has an entry in a table that is referred to as a directory Like the blocks of memory that they represent the directories are distributed among the compute memory blade nodes A block of memory is also referred to as a cache line Each directory entry indicates the...

Page 96: ...s have overcurrent protection at the blade and power supply level Fans are redundant and can be hot swapped Fans run at multiple speeds in the IRUs Speed increases automatically when temperature increases or when a single fan fails System monitoring System controllers monitor the internal power and temperature of the IRUs and can automatically shut down an enclosure to prevent overheating Memory L...

Page 97: ... self test failure occurs Boot times are minimized Further RAS features Optional RAID 1 in base I O IA2 blade check with your SGI sales or service representative for availability Note that RAID 0 striping while supported by the IA2 hardware is not recommended as a RAS option Systems have a local field replaceable unit FRU analyzer All system faults are logged in files Memory can be scrubbed using ...

Page 98: ...xpansion blade This two slot PCI PCI X option blade supplies an individual PCI bus for each option card Double wide PCI X expansion blade Supports three PCI PCI X 133 MHz 64 bit option cards This three slot blade features card carriers that allow you to slide PCI PCI X boards directly into and out of the unit Single wide PCIe expansion blade The single wide PCI blade supports one or two PCI Expres...

Page 99: ...U rack an IRU positioned in U01 through U05 is identified as U01 Rack Numbering Each rack is numbered with a three digit number sequentially beginning with 001 A rack contains IRU enclosures optional mass storage enclosures and potentially other options In a single compute rack system the rack number is always 001 Router board Router board Power supplies System control board Compute memory blades ...

Page 100: ...may vary based on new product introductions or end of life components Some options are listed in this manual others may be introduced after this document goes to production status Check with your SGI sales or support representative for the most current information on available product options not discussed in this manual ...

Page 101: ...rol and sequencing provides environmental control and monitoring initiates system resets stores identification and configuration information and provides console diagnostic and scan interface Each IRU enclosure has a system controller that can communicate with other IRU system controllers when they are NUMAlinked together under a single system image Each system controller constantly shares its inf...

Page 102: ...nfiguration of your server will depend on the size of the system and control options selected Typically an Ethernet connection to the system controller network is used This Ethernet connection is usually made from the IRU housing the system disk s Remote workstation monitor Local Area Network LAN Altix 450 Local Area Network LAN Cat 5 Ethernet ...

Page 103: ...llers for monitoring and controlling all elements of the disk array See the owner s guide for your mass storage option for more information on this topic System Controller Interaction In all Altix 450 servers all the system controllers communicate with each other in the following ways All IRU enclosures within an Altix 450 system communicate with each other through their NUMAlink connections using...

Page 104: ... failures Monitors and controls warning LEDs on the IRU Monitors the On Off power switch Monitors the reset switch and the nonmaskable interrupt NMI switch Reports the population of the PCI cards and the power levels of the PCI slots in installed I O blades Powers on the PCI slots and their associated LEDs L1 Front Panel Display Figure 4 2 shows the L1 controller front panel features Figure 4 2 L1...

Page 105: ...uate Note The reset and NMI switch functions on any IRU in a NUMAlink connected system will affect all the IRUs in the system Ethernet Switch Use of an Ethernet switch is the preferred method of interconnecting large systems with multiple L2s and remote support hardware to multiple systems An optional Ethernet switch provides multiple additional Ethernet connectors Figure 4 3 shows sample connecti...

Page 106: ...2 on the IRU s system controller You can use the telnet command to connect By default the L2 uses DHCP to obtain an IP address To set a static IP see Configuring an L2 s IP Address on page 89 These console connections enable you to view the status and error messages generated by the system controllers on your system You can also use the console to input commands to manage and monitor your system s...

Page 107: ...for identification and configuration information Provides console diagnostic and scan interface The L1 controller in each of the enclosures is a complete and fully functional system controller All the blades are interconnected by NUMAlink and each shares its system control information with all other system controllers Console Mode from L1 Output from the system is visible and all input is directed...

Page 108: ...001c01 L1 This example is a system with one IRU The number that follows the colon 0 1 and 2 from top to bottom in this example refers to which local port the IRU is connected to or accessed through The local LOC IRU is the IRU that is processing the command On all IRUs 0 is the local IRU with other values referring to various ports The specific port description follows the IRU s rack type slot fie...

Page 109: ...mode output from the system boot process or OS is visible and all input is directed to the system To enter console mode press Ctrl D at the L1 prompt 001c01 L1 Ctrl D entering console mode 001c01 console CTRL T to escape to L1 system output appears here To return to L1 mode press Ctrl T Ctrl T escaping to L1 system controller 001c01 L1 While in L1 mode you can enter any L1 command Once the command...

Page 110: ... A Subchannel 2C specifies Blade 2 CPU C Subchannel 3A specifies Blade 3 CPU A Subchannel 3C specifies Blade 3 CPU C Subchannel console0 Blade 0 console subchannel Subchannel console1 Blade 1 console subchannel The output from the select command console input 001c01 console0 shows that the system controller will send input to IRU 001c01 blade 0 and the subchannel to be used is the console subchann...

Page 111: ...lt of tasks running on the L1 such as the environmental monitor Each L1 has a log of local events Use the L1 command log to view events on any of the L1s L2 Operation As mentioned in System Controller Interaction on page 81 the system controller in an Altix 450 system can provide L2 functionality An Ethernet cable can be plugged into the RJ45 connector on the IRU enclosure Connecting the IRU to an...

Page 112: ...ial number is set on the L2 001c01 L1 l2 serial To set the L2 system serial number 001c01 L1 l2 serial set serial number Verifying that msys is enabled this allows multiple L2s in a system to exist peacefully with other L2s from another system on the same subnet 001c01 L1 l2 msys If msys is off turn it on 001c01 L1 l2 msys on Reboot the system controller to make the IP address change take effect 0...

Page 113: ...0 0 001c31 L1 127 0 0 1 0 1 001c21 L1 127 0 0 1 0 2 001c11 L1 127 0 0 1 0 3 001c01 L2 As shown above config produces a list of IRUs and their locations in the system and the system controller address of each IRU This is similar to the output from using the config command on the L1 with the addition of the L2 IP address L1 connection and L1 index The structure of the IRU address is as follows a b c...

Page 114: ... nomenclature The slot number sometimes referred to as a bay number is the unit position number located on the rack slightly above where the bottom of the IRU sits Each rack unit position number is located toward the top of the two lines that mark the unit position that the number represents For example the rack numbering for an IRU located in slot 10 would appear on the left front side of the rac...

Page 115: ...s set L2 The following example shows what IRUs are found in the default destination If you enter a command not understood by the L2 the command is sent to these IRUs Note In the current implementation if you add an IRU to either rack 2 or 3 it would not be automatically included in the default destination You would need to reset the default destination L2 destination 001c01 127 0 0 1 0 2 001c01 12...

Page 116: ...invalid arguments for ver command try help ver The general format includes an IRU identification and the type of message followed by the message A message may be the result of an invalid command as shown in the example or the result of tasks running on the L1 such as the environmental monitor Each L1 has a log of local events Use the L1 command log to view events on any of the L1s Powering On Powe...

Page 117: ...d all data in memory will be lost Console Mode from the L2 In console mode all output from the system is visible and all input is directed to the system To enter console mode from L2 press Ctrl D at the L2 prompt and observe the response L2 Ctrl D entering system console mode 001c01 console0 CTRL_T to escape to L2 system output appears here To return to L2 mode from console mode press Ctrl T Ctrl ...

Page 118: ...the lowest numbered rack and slot which has previously produced console output The IRU in the lowest numbered rack and slot The select command by itself shows the current console mode settings L2 select known system consoles non partitioned 001c01 L2 detected current system console console input 001c01 CPU 0A console output not filtered The following are ten common subchannels associated with cons...

Page 119: ...ct blade 1 CPU A as the subchannel of the IRU to be the system console enter the following L2 select subchannel 1A console input 001c01 console CPU1A console output not filtered During the boot process on a system with multiple CPUs there is a window of time in which the CPUs are all producing output This can result in a somewhat jumbled output from the L2 However you can filter console output so ...

Page 120: ...enter the rack and a slot followed by l1 L2 r 2 s 1 l1 An alternate method is L2 2 1 l1 enterling L1 mode 001c01 CTRL T to escape to L2 001c01 L1 To return to L2 mode press Ctrl T 001c01 L1 Ctrl T escaping to L2 system controller CTRL T to send escape to L1 L2 At this point you can enter any L2 command Once the command is executed the L2 returns to L1 mode re entering L1 mode 001c01 CTRL T to esca...

Page 121: ...ements on page 84 and Figure 4 1 on page 80 for descriptions of the hardware connections The L1 firmware consists of three parts Boot image A image B image At boot time the boot image validates the A and B image and if it is not instructed otherwise it executes the newer of the two images Because the L1 is running one of the two images the image not in use is the image that will be overwritten whe...

Page 122: ...2 4 System Control You can update individual IRUs by replacing all with a rack and slot number usr cpu firmware sysco flashsc 12 10 1 1 1 usr cpu firmware sysco l1 bin 1 16 This updates only the IRU in rack 1 slot 16 ...

Page 123: ...all it in an Altix 450 tall 42U or short 20U rack The mounting rails on the Altix racks are recessed to allow for flush mounting of the IRU in the rack The Altix rack also has provisions for PDUs to be mounted in the front Installing the Altix 450 in a third party rack will require that the unit protrude from the front of the rack It will not be possible to use a front door on the third party rack...

Page 124: ... the front of the IRUs therefore cable management occurs primarily in the front of the rack In the case of storage modules cables are attached to the front connectors on the IRU and routed to the rear of the storage enclosure I O and power cables normally pass through the bottom of the rack Rack structural features Each rack is mounted on four casters the two rear casters swivel There are four lev...

Page 125: ...Altix 42U and 20U Rack Features 007 4857 002 103 Figure 5 1 Tall 42U Altix Rack and Front Lock ...

Page 126: ...Table 5 2 lists the technical specifications of the Altix 450 short rack Table 5 1 Tall Altix Rack Technical Specifications Characteristic Specification Height 79 5 in 201 9 cm Width 25 8 in 65 5 cm Depth 43 45 in 110 4 cm Weight full 1500 lb 682 kg Table 5 2 Short Altix Rack Technical Specifications Characteristic Specification Height 42 8 in 108 7 cm Width 25 8 in 65 5 cm ...

Page 127: ...Technical Specifications 007 4857 002 105 Depth 40 9 in 103 9 cm Weight full 750 lb 340 kg Table 5 2 Short Altix Rack Technical Specifications continued Characteristic Specification ...

Page 128: ......

Page 129: ... Replacing PCI PCI X Cards on page 128 Installing or Replacing a Disk Drive in the IA Blade on page 138 Maintenance Precautions and Procedures This section describes how to open the system for maintenance and upgrade protect the components from static damage and return the system to operation The following topics are covered Preparing the System for Maintenance or Upgrade on page 108 Returning the...

Page 130: ...wer down 4 Locate the power distribution unit s PDUs in the front of the rack and turn off the circuit breaker switches on each PDU Returning the System to Operation When you finish installing or removing components return the system to operation as follows 1 Turn each of the PDU circuit breaker switches to the on position 2 At your system console enter the following command L2 power up 3 Verify t...

Page 131: ...e installed or removed by a qualified SGI field engineer Table 6 1 lists the customer replaceable components and the page on which you can find the instructions for installing or removing the component Table 6 1 Customer replaceable Components and Maintenance Procedures Component Procedure L1 controller panel Remove and Replace the System Control Display Panel on page 110 IRU power supplies Removi...

Page 132: ...s in an IRU you must first remove the system control display panel Use the following steps to remove the system control display 1 Using a T10 torx driver loosen the lower screw that holds the display panel to the IRU chassis see Figure 6 1 on page 111 2 Lift the display assembly up about 1 3 inch 84 mm and pull it outward from the IRU chassis 3 Don t unplug the ribbon cable unless you are replacin...

Page 133: ...ng the L1 Controller Panel Replace the system control panel using the following steps 1 Position the controller panel assembly slightly above the retention screw 2 Carefully slid it back into place see Figure 6 2 inside TM inside TM inside TM A B C Loosen screw ...

Page 134: ...to snag the ribbon cable while replacing the panel 4 Use the T10 torx driver to tighten the retention screw holding the panel to the IRU 5 Restart the IRU or system as applicable Figure 6 2 Replacing the L1 Controller Panel inside TM inside TM B C Tighten screw inside TM A ...

Page 135: ...IRU due to the power loss Note that when replacing either of the supplies it is necessary to remove the system controller panel see Remove and Replace the System Control Display Panel on page 110 before proceeding Use the following steps to remove and replace a power supply in the IRU 1 Disconnect the power cord from the IRU power supply 2 Press down on the retention latch at the top of the power ...

Page 136: ...upply Removing and Replacing IRU Fans Blowers The IRU fans blowers are located at the rear of the unit see Figure 6 5 You will need to access the rack from the back to remove and replace a fan The IRU s system controller issues a warning message when a fan is not running properly This means the RPM level of the fan is not within tolerance When an IRU fan fails the following things happen 1 The L1 ...

Page 137: ...led fan The system will continue running until a scheduled maintenance occurs The fan numbers for the IRU as viewed from the rear are shown in Figure 6 5 Figure 6 5 IRU Fan Assembly Blowers Note that a fan can be replaced while the IRU is operating You will need a number 1 phillips head screw driver to complete the procedure Use the following steps and illustrations to replace an IRU fan 1 Undo th...

Page 138: ...enance and Upgrade Procedures Figure 6 6 Removing a Fan From the IRU 3 Slide a new blower assembly completely into the open slot see Figure 6 7 4 Tighten the blower assembly screw to secure the new fan Screw A C B Loosen screw ...

Page 139: ...Replacing IRU Components 007 4857 002 117 Figure 6 7 Replacing an IRU Fan B A Tighten screw ...

Page 140: ...RU 1 Open the front door of the rack and access the IRU blade slated for replacement 2 Move the blade s retention tab gently to the left to disengage the locking tab Be careful not to use too much force as the tab is breakable 3 Pull the blade s retention tab outward until it is fully extended see Figure 6 8 4 Slide the blade outward by pulling the bottom ring gently out 5 Remove the blade complet...

Page 141: ...Replacing IRU Components 007 4857 002 119 Figure 6 8 Removing a Compute Memory Blade From the IRU COMPACT insid eTM B insid eTM COMPACT insid eTM A C ...

Page 142: ...120 007 4857 002 6 Maintenance and Upgrade Procedures Figure 6 9 Replacing a Compute Memory Blade in the IRU COMPACT insid eTM insid eTM B C COMPACT A insid eTM ...

Page 143: ...e 6 11 shows an example of the physical DIMM locations within the processor blade assembly Follow these guidelines when installing DIMM groups Memory is increased or decreased in four DIMM group increments only Each of the four DIMMs that make up a DIMM group must be the same memory size and speed however different blades can differ in total memory size The first four DIMMs group 0 must be in plac...

Page 144: ...t bus X DIMM 2 DIMM location 2 Left bus X DIMM 1 DIMM location 1 Left bus X DIMM 0 DIMM location 0 Right bus X DIMM 0 DIMM location 0 Right bus X DIMM 1 DIMM location 1 Right bus X DIMM 2 DIMM location 2 Right bus Y DIMM 0 DIMM location 3 Right bus Y DIMM 1 DIMM location 4 Right bus Y DIMM 2 DIMM location 5 SHUB 2 Memory Memory NUMAlink 4 NUMAlink 4 Front side bus FSB SAW OSC Group 1 Group 2 Group...

Page 145: ...rmation in Replacing IRU Components on page 110 3 After removing the IA blade from the IRU chassis place it on a stable flat surface with the left side facing upward see Figure 6 12 4 Use a Phillips type screwdriver to remove the DVD access panel screw see Figure 6 12 5 Lift the DVD access panel clear of the IA blade and set it aside 6 Unscrew and remove the DVD drive assembly retention screw 7 Ge...

Page 146: ... into the IA blade housing 9 Connect the DVD power and data cable connectors to the replacement drive 10 Screw in the DVD drive assembly retention screw 11 Replace the DVD access panel and tighten the retention screw 12 Return the IA blade to its IRU slot 13 Power up the IRU and or system ...

Page 147: ...Replacing IRU Components 007 4857 002 125 Figure 6 12 DVD Removal from IA Blade B C D A Power connector Data connector DVD retention screw CO MP AC T CO MP AC T CO MP AC T ...

Page 148: ...126 007 4857 002 6 Maintenance and Upgrade Procedures Figure 6 13 DVD Drive Replacement in the IA Blade CO MP AC T CO MP AC T B Power connector Data connector A C D CO MP AC T ...

Page 149: ...PCIe controlled devices appear the same as PCI PCI X devices to most software PCI Express technology is different from PCI PCI X in the following ways PCI Express uses a point to point serial interface vs a shared parallel bus interface used in older PCI PCI X technology PCIe hardware connectors are not compatible with PCI PCI X see Figure 6 14 Potential sustained throughput of x16 PCI Express is ...

Page 150: ...in your system s Individual Rack Units IRUs To maximize the operating efficiency of your cards be sure to read all the introductory matter before beginning the installation There are different types of blades used in the IRU that hold PCI PCI X boards Note the following guidelines The IA IA2 blade base I O blade containing the system disk and DVD drive will only accommodate half height PCI PCI X c...

Page 151: ...ing IRU Components on page 110 and extract the three slot blade from the IRU 2 To extract the card carrier from a slot in the blade pull the handle on the selected card carrier straight out as shown in Figure 6 15 3 If you are replacing a card gently remove the existing card from the carrier 4 If you are adding a card extract the carrier metal filler plate by pushing down on it as shown in Figure ...

Page 152: ...130 007 4857 002 6 Maintenance and Upgrade Procedures Figure 6 16 Extracting the Carrier Metal Filler Plate ...

Page 153: ...want to install does not fit in the carrier follow these steps a Loosen the three screws on the guide bar with a Phillips screwdriver if your carrier uses T8 Torx screws you will need a Torx screw driver b Adjust the carrier guide bar also known as the alignment rail up or down as necessary see Figure 6 17 Figure 6 17 Adjusting the Carrier Guide Bar Carrier guide bar ...

Page 154: ...d connectors protrude through the bulkhead where the metal filler plate was located The edge connectors fit between the bottom guides of the carrier The top of the card fits under the clips on the guide bar d Tighten the three screws on the guide bar Skip step 6 and proceed to step 7 Figure 6 18 Mounting Card in Carrier Guides Bulkhead Clips ...

Page 155: ...f the carrier guide bar c Place the half height PCI card in the carrier so that the connector edge of the card rests against the lower guide tab of the carrier see Figure 6 19 Figure 6 19 Mounting Half height PCI Card into Carrier d Move the carrier guide bar adjustment rail so that it holds the card firmly in place see Figure 6 20 Figure 6 20 Moving Carrier Guide Bar to Secure Half height PCI Car...

Page 156: ... screw holes of the bracket align with the empty screw holes of the carrier guide bar as shown in Figure 6 21 f Secure the bracket to the carrier guide bar with two T8 Torx screws g Tighten the screw that you loosened in step 6b Figure 6 21 Installing the Bracket to Secure a Half height PCI Card ...

Page 157: ...8 Push in horizontally on the carrier seating bar as shown in Figure 6 23 to seat the card securely in the slot Figure 6 23 Seating the Card in the Slot 9 Install the blade into the IRU 10 Power on the IRU or restart the system 11 Run the ls pci PCI hardware inventory command to verify the installation This command lists PCI hardware that the operating system discovered during the boot operation ...

Page 158: ... the blade Note that in the case of extracting an IA blade that holds the system disk you must shut down the operating system 3 After removing the IA blade from the IRU chassis place it on a stable flat surface with left side facing upward see Figure 6 24 4 Using a Tx20 Torx driver remove the front screw securing the PCI card access door 5 Using a Tx20 Torx driver remove the top PCI card access do...

Page 159: ...s door screw 10 Reinstall the front PCI card access door screw 11 Reinstall the IA blade in the IRU chassis 12 Return the system to service 13 Boot your operating system software See your software operation guide if you need instructions to boot your operating system 14 Run the ls pci PCI hardware inventory command to verify the installation This command lists PCI hardware that the operating syste...

Page 160: ...section describes how to install or remove the drives Figure 6 26 Location of Disk Drive Bays on IA IA2 Blade Drive 0 Drive 1 Ethernet port 1 USB port 1 1 PCI card slot 0 PCI card slot 1 SAS SATA II ports Ethernet port 0 USB port 2 1 USB port 1 2 USB port 2 2 SAS 4X USB0 USB1 USB2 USB3 HDD0 HDD1 DVDROM ETH0 ETH1 PCI X 1 PCI X 0 SAS LEDs Pwr fault link LEDs F1 F2 F3 F4 A1 A2 A3 A4 P0 PF N0 N1 DVD d...

Page 161: ... by depressing its handle lock with your thumb and pulling the handle away from the chassis until the handle disengages the disk drive connector from the blade s backplane connector 3 Carefully slide the disk drive out of the blade and place it on an ESD safe surface Do not use the handle to pull the disk drive out of the bay After you remove the disk drive go on to the next section Installing a S...

Page 162: ...e a grounding wrist strap while installing the disk drive To install a disk drive see Figure 6 28 and follow these steps 1 Access the two disk drive bays see panel 1 in Figure 6 28 Note If you are installing only one disk drive install it in the left side housing nearest the DVD drive 2 Position the drive assembly so that it engages the bay guide rails and then gently push the drive into the blade...

Page 163: ...Installing or Replacing a Disk Drive in the IA Blade 007 4857 002 141 Figure 6 28 Replacing a Disk Drive COMPACT COMPACT ...

Page 164: ......

Page 165: ...7 7 Troubleshooting and Diagnostics This chapter provides the following sections to help you troubleshoot your system Troubleshooting Chart on page 144 L1 Controller Error Messages on page 145 SGI Electronic Support on page 149 ...

Page 166: ...isplay see Table 7 2 if an error message is present If the L1 controller is not running contact your SSE The system will not boot the operating system Ensure the IA IA2 base I O blade that houses the system disk s is properly seated in the IRU Contact your SSE The Service Required LED illuminates on an IRU View the L1 display of the failing IRU see Table 7 2 for a description of the error message ...

Page 167: ...e IRU ATTN power VRM description low fault limit reached x xxV 30 second power off sequence for the IRU ATTN power VRM description high warning limit reached x xxV A higher than nominal voltage condition is detected ATTN power VRM description low warning limit reached x xxV A lower than nominal voltage condition is detected ATTN power VRM description level stabilized x xxV A monitored voltage leve...

Page 168: ...inlet has exceeded 27 C ATTN temp sensor description critical temperature reached xxC xxF The ambient temperature at the IRU s air inlet has exceeded 31 C ATTN temp sensor description fault temperature reached xxC xxF The ambient temperature at the IRU s air inlet has exceeded 35 C Temperature stable message ATTN temp sensor description stabilized xxC xxF The ambient temperature at the IRU s air i...

Page 169: ...UMAlink connectors located on the front of the unit Each of these connectors has two status LEDs one green and one amber The amber LED illuminates to indicate that both the Altix 450 IRU NUMAlink connector and the module to which it is connected are powered on The green LED illuminates when a link has been established between the Altix 450 NUMAlink connector and the module to which it is connected...

Page 170: ...k indicators show NI0 and NI1 connection status between the blade and the router board within the IRU Constant green is a good connection Four amber heartbeat LEDs indicate compute activity the LEDs light up according to the number activity and type of processors installed in the blade If the IRU is fully powered on and booted and none of the amber LEDs are lit there is most likely a problem with ...

Page 171: ...ect system availability or develop into actual failures SGI Electronic Support integrates several services so they work together to monitor your system notify you if a problem exists and search for solutions to problems Figure 7 2 shows the sequence of events that occurs if you use all of the SGI Electronic Support capabilities Power on Logical processor A Logical processor B Logical processor C L...

Page 172: ...ics Figure 7 2 Full Support Sequence Page or e mail alert 5 Supportfolio Online View the case solutions 2 e mail 6 Implement solution SGI customer and SGI support engineer 1 Customer s system 3 SGI global customer support center 4 SGI Knowledgebase ...

Page 173: ... tested solutions for possible fixes to the problem Solutions that are located in SGI Knowledgebase are attached to the service case 5 You and the SGI support engineers can view and manage the case by using Supportfolio Online as well as search for additional solutions or schedule maintenance 6 Implement the solution Most of these actions occur automatically and you may receive solutions to proble...

Page 174: ...can be searched by sophisticated knowledge management tools You can log on to SGI Knowledgebase at any time to describe a problem or ask a question Knowledgebase searches thousands of possible causes problem descriptions fixes and how to instructions for the solutions that best match your description or question Supportfolio Online is a customer support resource that includes the latest informatio...

Page 175: ...each compute memory board can house either one or two processor sockets each socket holds two processor cores Table A 1 Altix 450 System Configuration Ranges Category Minimum Maximum Processor cores 4a a Single socket compute blades support two cores each Dual socket blades support two or four cores per blade 76 Individual Rack Units IRUs 1 per rack 4 per system imageb b Two complete systems of fo...

Page 176: ...sions for a single tall 42U rack system including doors and side panels Height 79 5 in 201 9 cm Width 25 8 in 65 5 cm Depth 43 45 in 110 4 cm Shipping dimensions Height 81 5 in 207 cm Width 42 in 106 7 cm Depth 52 in 132 1 cm Weight of full rack maximum 1450 lb 658 kg Shipping weight maximum 1600 lb 727 kg Access requirements Front Rear Side 48 in 121 9 cm 48 in 121 9 cm None Individual Rack Unit ...

Page 177: ...n 65 5 cm Depth 40 9 in 103 9 cm Shipping dimensions Height 47 5 in 120 7 cm Width 31 25 in 79 4 cm Depth 49 5 in 125 7 cm Weight of full rack maximum 750 lb 340 kg Shipping weight maximum 862 lb 391 kg Access requirements Front Rear Side 48 in 121 9 cm 48 in 121 9 cm None Individual Rack Unit IRU enclosure specifications Dimensions 8 68 in high x 17 5 in wide x 17 in deep 22 cm high x 44 45 cm wi...

Page 178: ...ondensation 8 to 95 non operating no condensation Heat dissipation Altix 450 42U rack 59 71 kBTU hr maximum based on 17 5 kW Cooling requirement Ambient air cooling Air flow intake front exhaust rear Approximately 1400 CFM normal operation Maximum altitude 10 000 ft 3 049 m operating 40 000 ft 12 195 m non operating Acoustical noise level Less than 65 dBa maximum with doors Table A 5 Environmental...

Page 179: ...ration Maximum altitude 10 000 ft 3 049 m operating 40 000 ft 12 195 m non operating Acoustical noise level Less than 65 dBa maximum with doors Table A 6 Power Specifications Feature Specification Single phase power requirements Voltage Frequency Power 200 240V 180 254 VAC min max 50 60 Hz 17 5 kW max per tall rack 8 75 kW max per short rack Hold up time 16 ms Total harmonic distortion Less than 1...

Page 180: ...Port Specifications This section contains specifications and port pinout information for the base I O ports of your system as follows Ethernet Port on page 159 Serial Ports on page 160 External SAS SATA Port Connector on page 162 USB Type A Connector on page 163 ...

Page 181: ...s for the Ethernet port operating in 10 100 Base T mode and also operating in 1000Base T mode NU Not used Table A 7 Ethernet Pinouts Ethernet 10 100Base T Pinouts Gigabit Ethernet Pinouts Pins Assignment Pins Assignment 1 Transmit 1 Transmit Receive 0 2 Transmit 2 Transmit Receive 0 3 Receive 3 Transmit Receive 1 4 NU 4 Transmit Receive 2 5 NU 5 Transmit Receive 2 6 Receive 6 Transmit Receive 1 7 ...

Page 182: ...of the ports include the following Programmable data parity and stop bits Programmable baud rate and modem control Figure A 2 shows a serial port example Figure A 2 Serial Port Connector Pin 7 Request to Send RTS Pin 3 Transmit Data TXD Pin 2 Receive Data RXD Pin 4 Data Terminal Ready DTR not used Pin 5 Ground Pin 9 Ringing Indicator RI not used Pin 8 Clear to Send CTS Pin 6 Data Set Ready DSR not...

Page 183: ... the 9 pin male DB 9 connector Table A 8 Serial Port Pinout Pin Assignment Description 1 DCD Data carrier detect 2 RXD Receive data 3 TXD Transmit data 4 DTR Data terminal ready 5 GND Signal ground 6 DSR Data set ready 7 RTS Request to send 8 CTS Clear to send 9 RI Ring indicator ...

Page 184: ...chment SATA connector This combined technology connector is used to support optional external storage Table A 9 lists the pin assignments for the 14 pin SAS SATA connector Figure A 3 Pin Number Locations for External SAS SATA Port Table A 9 SAS SATA Pin Assignments Pin Number Signal Name Pin Number Signal Name 1 Gnd 8 Gnd 2 2tx_h 9 3tx_h 3 2tx_1 10 3tx_1 4 Gnd 11 Gnd 5 2rx_1 12 3rx_1 6 2rx_h 13 3r...

Page 185: ...upports general USB applications and optional keyboard and mouse configurations Table A 10 lists the pin assignments for the USB type A connector Figure A 4 Pin Number Locations for USB Type A Connector Table A 10 Pin Assignments for USB Type A Connector Signal Color Pin Number VCC Red 1 Data White 2 Data Green 3 Ground Black 4 1 2 3 4 ...

Page 186: ......

Page 187: ... may fall causing serious damage to the product 5 Slots and openings in the system are provided for ventilation To ensure reliable operation of the product and to protect it from overheating these openings must not be blocked or covered This product should never be placed near or over a radiator or heat register or in a built in installation unless proper ventilation is provided 6 This product sho...

Page 188: ...ctions since improper adjustment of other controls may result in damage and will often require extensive work by a qualified technician to restore the product to normal condition If the product has been dropped or the cabinet has been damaged If the product exhibits a distinct change in performance indicating a need for service 11 If a lithium battery is a soldered part only qualified SGI service ...

Page 189: ...splayed on each device is an indication of conformity to the European requirements Caution This product has several governmental and third party approvals licenses and permits Do not modify this product in any way that is not expressly approved by SGI If you do you may lose these approvals and your governmental agency authority to operate this device CMN Number The model number or CMN number for t...

Page 190: ...e radio frequency energy and if not installed and used in accordance with the instruction manual may cause harmful interference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case you will be required to correct the interference at your own expense If this equipment does cause harmful interference to radio or television re...

Page 191: ...turbations radioélectriques dépassant les normes applicables aux appareils numériques de Classe A préscrites dans le Règlement sur les interferences radioélectriques établi par le Ministère des Communications du Canada VCCI Notice Japan Only Figure B 1 VCCI Notice Japan Only Chinese Class A Regulatory Notice Figure B 2 Chinese Class A Regulatory Notice Korean Class A Regulatory Notice Figure B 3 K...

Page 192: ...he cable supplied with your system If your monitor cable becomes damaged obtain a replacement cable from SGI Electrostatic Discharge SGI designs and tests its products to be immune to the effects of electrostatic discharge ESD ESD is a source of electromagnetic interference and can cause problems ranging from data errors and lockups to permanent component damage It is important that you keep all t...

Page 193: ...position aux rayons Warning Vorsicht Unsichtbare Laserstrahlung Wenn Abdeckung geöffnet nicht dem Strahl aussetzen Warning Advertencia Radiación láser invisible al ser abierto Evite exponerse a los rayos Warning Advarsel Laserstråling vedåbning se ikke ind i strålen Warning Varo Lavattaessa Olet Alttina Lasersåteilylle Warning Varning Laserstrålning når denna del år öppnad ålå tuijota såteeseensti...

Page 194: ...ning Advarsel Eksplosjonsfare ved feilaktig skifte av batteri Benytt samme batteritype eller en tilsvarende type anbefalt av apparatfabrikanten Brukte batterier kasseres i henhold til fabrikantens instruksjoner Warning Varning Explosionsfara vid felaktigt batteribyte Anvãnd samma batterityp eller en ekvivalent typ som rekommenderas av apparattillverkaren Kassera anvãnt batteri enligt fabrikantens ...

Page 195: ...console L1 mode power on 54 powering on bricks 54 console communications 96 subchannels 96 console mode from L1 mode 87 from L2 emulator mode 95 console selection 96 controller L1 81 customer service xxi D disk drive installation 140 documentation available via the World Wide Web xix conventions xxi E embedded support partner ESP 152 system support 56 environmental specifications 156 error message...

Page 196: ... on at console 54 to console mode 87 viewing information warning and error messages 89 viewing system configuration 86 L1 software modes of operation 84 to L1 mode 85 L2 emulation mode to L1 mode 98 viewing system configuration 91 L2 emulator mode powering off 94 powering on 94 resetting system 94 setting command targeting 92 to console mode 95 viewing information warning and error messages 94 las...

Page 197: ...m L2 mode 94 S SAS SATA external connector pin assignments 162 server monitored at L1 controller 57 monitoring locations 57 SGI Knowledgebase See Knowledgebase Short rack shipping crate removal 17 site requirements 6 space requirements 24 subchannels associated with console communications 96 support embedded support partner ESP 56 Supportfolio Online 152 system architecture 70 system components Al...

Page 198: ...ve the short rack 16 upgrading L1 firmware 99 USB type A connector pin assignments 163 V VGA video card 57 viewing system configuration L1 mode 86 voltage select switches for peripherals 39 W warning messages viewing in L2 mode 89 94 weight of the short rack 16 ...

Search results

Summary of Contents for SGI Altix 450

Reviews:

Related manuals for SGI Altix 450

Brands by name

Popular brands

Silicon Graphics SGI Altix 450, User Manual

Search results

Summary of Contents for SGI Altix 450

Reviews:

Related manuals for SGI Altix 450

Brands by name

Popular brands