background image

SGI

®

 UV 2000 System User Guide 

Document Number 007-5832-002

Summary of Contents for UV 2000

Page 1: ...SGI UV 2000 System User Guide Document Number 007 5832 002 ...

Page 2: ...partment of Defense units b 48 CFR 227 7202 of the DoD FAR Supplement or sections succeeding thereto Contractor manufacturer is SGI 46600 Landing Parkway Fremont CA 94538 TRADEMARKS AND ATTRIBUTIONS Silicon Graphics SGI the SGI logo NUMAlink and NUMAflex are trademarks or registered trademarks of Silicon Graphics International Corp or its subsidiaries in the United States and or other countries wo...

Page 3: ...007 5832 002 iii Record of Revision Version Description 001 June 2012 First Release 002 May 2013 MIC GPU Blade and RAID updates ...

Page 4: ......

Page 5: ...tion Procedures 1 Precautions 1 ESD Precaution 1 Safety Precautions 2 Power Connections Overview 2 System Connections Overview 7 Connecting to the UV System Control Network 7 System Controller Access 8 Serial Console Hardware Requirements 9 Establishing a Serial Connection to the CMC on SGI UV 2000 9 Establishing CMC IP Hardware Connections 9 Using DHCP to Establish an IP Address 10 Using a Static...

Page 6: ...ectly From a CMC 17 Power On the System Using the CMC Network 17 Optional Power On Using the SMN to Connect to the CMC 18 Monitoring Power On 19 Power off a UV System 20 Additional CLI Power Command Options 20 Using Embedded Support Partner ESP 22 Optional Components 23 PCIe Cards 23 PCIe Drive Controllers in BaseIO Blade 25 RAID PCIe Disk Controller 25 Non RAID PCIe Disk Controller 26 2 System Co...

Page 7: ... 48 MIC GPU Enabled Compute Blade 49 Bay Unit Numbering 50 Rack Numbering 50 Optional System Components 50 4 Rack Information 51 Overview 51 SGI UV 2000 Series Rack 42U 52 SGI UV 2000 System Rack Technical Specifications 56 5 Optional Octal Router Chassis Information 57 Overview 57 SGI UV 2000 Series NUMAlink Octal Router Chassis 58 SGI UV 2000 External NUMAlink System Technical Specifications 60 ...

Page 8: ...t 72 LED Status Indicators 73 IRU Power Supply LEDs 73 Compute Memory Blade LEDs 74 SGI Electronic Support 75 A Technical Specifications and Pinouts 79 System level Specifications 79 Physical Specifications 80 Environmental Specifications 81 Power Specifications 82 I O Port Specifications 83 BaseIO VGA Port Information 83 Ethernet Port 85 Serial Ports 86 USB Type A Connector 88 B Safety Informatio...

Page 9: ...rer s Declaration of Conformity 91 Electromagnetic Emissions 92 FCC Notice USA Only 92 Industry Canada Notice Canada Only 93 VCCI Notice Japan Only 93 Korean Class A Regulatory Notice 93 Shielded Cables 94 Electrostatic Discharge 94 Laser Compliance Statements 95 Lithium Battery Statement 96 ...

Page 10: ......

Page 11: ...ount Console 33 Figure 2 4 System Management Node SMN Direct Video Connection Ports 34 Figure 3 1 SGI UV 2000 Single Rack System Example 36 Figure 3 2 SGI UV 2000 IRU and Rack 38 Figure 3 3 Functional Block Diagram of the Individual Rack Unit IRU 40 Figure 3 4 Blade Node Block Diagram Example 42 Figure 3 5 SGI UV 2000 IRU System Components Example 47 Figure 3 6 BaseIO Riser Enabled Blade Front Pan...

Page 12: ...V Compute Blade Status LED Locations Example 74 Figure 7 2 Full Support Sequence Example 75 Figure A 1 VGA Port Pinouts 83 Figure A 2 Ethernet Port 85 Figure A 3 Serial Port Connector 86 Figure A 4 Pin Number Locations for USB Type A Connector 88 Figure B 1 VCCI Notice Japan Only 93 Figure B 2 Korean Class A Regulatory Notice 93 ...

Page 13: ...idth Support Levels 65 Table 7 1 Troubleshooting Chart 72 Table 7 2 Power Supply LED States 73 Table A 1 SGI UV 2000 System Configuration Ranges 79 Table A 2 SGI UV 2000 Physical Specifications 80 Table A 3 Environmental Specifications 81 Table A 4 Power Specifications 82 Table A 5 VGA Pin Functions 84 Table A 6 Ethernet Pinouts 85 Table A 7 Serial Port Pinout 87 Table A 8 Pin Assignments for USB ...

Page 14: ......

Page 15: ...omputer systems Important Information Warning To avoid problems that could void your warranty your SGI or other approved system support engineer SSE should perform all the set up addition or replacement of parts cabling and service of your SGI UV 2000 system with the exception of the following items that you can perform yourself Using your system console controller to enter commands and perform sy...

Page 16: ... technology abailable in SGI UV 2000 systems consisting of two or more racks This router technology is available in an enclosure package known as the Octal Router Chassis Chapter 6 Add or Replace Procedures provides instructions for installing or removing the customer replaceable components of your system Chapter 7 Troubleshooting and Diagnostics provides recommended actions if problems occur on y...

Page 17: ... control network System network addressing is covered and a chapter on how to use KVM to enable remote console access from the system management node is included SGI Management Center Quick Start Guide P N 007 5672 00x This document may be helpful to users or administrators of SGI UV systems using the SGI Management Center interface The guide provides introductory information on configuration oper...

Page 18: ...or RAID User s Guide publication number 860 0476 00x This user guide explains how to configure and use the software components of the LSI Integrated RAID software product used with LSI SAS controllers Man pages online Man pages locate and print the titled entries from the online reference manuals You can obtain SGI documentation release notes or man pages in the following ways See the SGI Technica...

Page 19: ...out this document Convention Meaning Command This fixed space font denotes literal items such as commands files routines path names signals messages and programming language structures variable The italic typeface denotes variable entries and words or concepts being defined Italic typeface is also used for book titles user input This bold fixed space font denotes literal items that the user enters...

Page 20: ...ustomer support center Reader Comments If you have comments about the technical accuracy content or organization of this document contact SGI Be sure to include the title and document number of the manual with your comments Online the document number is located in the front matter of the manual In printed manuals the document number is located at the bottom of each page You can contact SGI in any ...

Page 21: ...22 Optional Components on page 23 Precautions Before operating your system familiarize yourself with the safety information in the following sections ESD Precaution on page 1 Safety Precautions on page 2 ESD Precaution Caution Observe all ESD precautions Failure to do so can result in damage to the equipment Wear a grounding wrist strap when you handle any ESD sensitive device to eliminate possibl...

Page 22: ...replace it only with the same type or an equivalent type recommended by the battery manufacturer or an explosion could occur Discard used batteries according to the manufacturer s instructions Power Connections Overview Prior to operation your SGI UV 2000 system should be set up and connected by a professional installer If you are powering on the system for the first time or want to confirm proper...

Page 23: ...wer supply fails Figure 1 1 IRU Power Supply Cable Location Example 3 If you plan to power on a server that includes optional mass storage enclosures make sure that the power switch on the rear of each PSU cooling module one or two per storage enclosure is in the 1 on position 4 Make sure that all PDU circuit breaker switches see the examples in the following three figures are turned on to provide...

Page 24: ...edures Figure 1 2 Single Phase 2 Outlet PDU Example Figure 1 3 on page 5 shows an example of an eight plug single phase PDU that can be used in the SGI UV 2000 rack system This unit is used to support auxiliary equipment in the rack ...

Page 25: ...Power Connections Overview 007 5832 002 5 Figure 1 3 Single Phase 8 Outlet PDU Power distribution unit PDU Power source ...

Page 26: ...he three phase PDUs that can be used in the SGI UV 2000 system These PDUs are used to distribute power to the IRUs when the system is configured with three phase power The enlarged section shows an optional PDU status interface panel Figure 1 4 Three Phase PDU Examples ...

Page 27: ...ple you can monitor error messages that warn of power or temperature values that are out of tolerance See the section 1U Console Option in Chapter 2 for additional information The following subsections describe the options for establishing and using communication connections to work with your SGI UV 2000 system Connecting to the UV System Control Network The ethernet connection is the preferred me...

Page 28: ...unning the SGI Management Center software application This can also be done using an optional VGA connected console see Figure 1 5 A micro USB serial cable connection to the Console port see Figure 1 6 on the CMC see note below See also Serial Console Hardware Requirements on page 9 Note Each IRU has two chassis management controller CMC slots located in the rear of the IRU directly below the cool...

Page 29: ... UV 2000 If you have an SGI UV 2000 system and wish to use a serially connected dumb terminal you can connect the terminal via a micro USB serial cable to the console port connector on the CMC board of the IRU 1 The terminal should be set to the operational modes described in the previous subsection Note that a serial console is generally connected to the CMC on the first bottom IRU in any single ...

Page 30: ... the command ifconfig eth0 This will report the IP address that the CMC is configured to use Running the CMC with DHCP is not recommended as the preferred option for SGI UV 2000 systems The nature of DHCP makes it difficult to determine the IP address of the CMC and it is possible for that IP address to change over time depending on the DHCP configuration usage The exception would be a configurati...

Page 31: ... network gateway IP address HOSTNAME hostname to use Note that the GATEWAY and HOSTNAME lines are optional After modifying the file save and write it using the vi command w and then exit vi using q Then reboot the CMC using the reboot command after it reboots it will be configured with the specified IP address ...

Page 32: ...talled at the rear of each IRU The SGI Management Center System Administrator s Guide P N 007 5642 00x provides more detailed information on using the GUI to administer your SGI UV 2000 system The SGI Management Center is an application that provides control over multiple IRUs and communication to other UV systems Remote administration requires that the SMN be connected by an Ethernet connection t...

Page 33: ... Management Center Interface Commands issued from the SGI Management Center interface are typically sent to all enclosures and blades in the system up to a maximum 128 blades per SSI depending on set parameters SGI Management Center services are started and stopped from scripts that exist in etc init d SGI Management Center is commonly installed in opt sgi sgimc and is controlled by one of these s...

Page 34: ...hat the command be targeted to a specific UV 2000 system if the SMN is managing more than one SSI Log in as root default password is root when logging into the CMC Login as sysco when logging into the SMN Once a connection to the SMN or CMC is established various system control commands can be entered See Powering On and Off from the Command Line Interface on page 14 for specific examples of using...

Page 35: ...in to the SMN as root via a terminal window similar to the following The default password for logging in to the SMN as root is sgisgi ssh X root uv system smn root system smn Once a connection to the SMN is established the SMN prompt is presented and various system control commands can be entered 2 To see a list of available commands enter the following root uv system smn ls sysco bin help 3 Chang...

Page 36: ...e SMN auth authenticate SSN APPWT change bios perform bios actions bmc access BMC shell cmc access CMC shell config show system configuration console access system consoles help list available commands hel access hardware error logs hwcfg access hardware configuration variable leds display system LED values log display system controller logs power access power control status Type cmd help for help...

Page 37: ...ystem when multiple systems are supported from one SMN Booting Directly From a CMC If a system management node SMN is not available it is possible to power on and administer your system directly from the CMC When available the optional SMN should always be the primary interface to the system The console type and how these console types are connected to the SGI UV 2000 systems is determined by what...

Page 38: ...on booting Linux from the shell prompt is included at the end of the subsection Monitoring Power On on page 19 Optional Power On Using the SMN to Connect to the CMC Typically the default password for the CMC set out of the SGI factory is root Use the following steps to establish a network connection from the SMN to the CMC and power on the system using the CMC prompt and the command line interface...

Page 39: ...stem boot process Use the following steps CMC r1i1c uvcon uvcon attempting connection to localhost uvcon connection to SMN CMC localhost established uvcon requesting baseio console access at r001i01b00 uvcon tty mode enabled use CTRL q to exit uvcon console access established uvcon CMC BASEIO connection active START OF CACHED CONSOLE OUTPUT 20100512 143541 BMC r001i01b10 Cold Reset via NL broadcas...

Page 40: ...f r001i01c PRI You can also use the power status command to check the power status of your system CMC r1i1c power status r001i01c PRI on 0 off 32 unknown 0 disabled 0 The following command options can be used with the power off down command usage power vo off down system SSN turns power off v verbose verbose output o override override partition check Additional CLI Power Command Options The follow...

Page 41: ...tem SSN show power status v verbose verbose output 1 on show only blades with on status 0 off show only blades with off status u unknown show only blades with unknown status d disabled show only blades with disabled status usage power ov nmi debug system SSN issue NMI o override override partition check v verbose verbose output usage power v margin high low norm value system SSN power margin contr...

Page 42: ...ailures ESP enables users to monitor one or more systems at a site from a local or remote connection ESP can perform the following functions Monitor the system configuration events performance and availability Notify SSEs when specific events occur Generate reports ESP also supports the following Remote support and on site troubleshooting System group management which enables you to manage an enti...

Page 43: ...The optional dual low profile PCIe blade supports two PCIe x16 Gen3 cards See Figure 1 8 on page 24 for an example The optional external PCIe I O expansion chassis supports up to four PCIe cards The external PCIe chassis is supported by connection to a compute blade using an optional host interface card HIC Each x16 PCIe enabled blade host interface connector can support one I O expansion chassis ...

Page 44: ...24 007 5832 002 1 Operation Procedures Figure 1 7 PCIe Option Blade Example with Full Height and Low Profile Slots Figure 1 8 PCIe Option Blade Example with Two Low Profile Slots ...

Page 45: ... right section in Figure 1 9 always hosts the system boot drives Figure 1 9 BaseIO Blade and PCIe Disk Controller Example RAID PCIe Disk Controller At the time this document was published the optional RAID controller used in the BaseIO blade PCIe slot is an LSI MegaRAID SAS 9280 8e This PCIe 2 0 card uses two external SAS control connectors and supports the following RAID levels 0 1 5 6 and 10 Adv...

Page 46: ...le random access memory NVRAM of 32 KB for storing RAID system configuration information the MegaRAID SAS firmware is stored in flash ROM for easy upgrade Non RAID PCIe Disk Controller At publication time the LSI 9200 8e low profile PCIe drive controller HBA is the default non RAID system disk controller for the SGI UV 2000 This drive controller has the following features Supports SATA and SAS lin...

Page 47: ... system and control options selected Typically an Ethernet LAN connection to the system controller network is used This Ethernet connection is made from a remote PC workstation connected to the system management node SMN The SMN is a separate stand alone server installed in the SGI UV 2000 rack The SMN acts as a gateway and buffer between the UV system control network and any other public or priva...

Page 48: ...and topology information between all controllers in an SSI Figure 2 2 on page 30 shows an example system control network using an optional and separate remote workstation to monitor a single rack SGI UV 2000 system It is also possible to connect an optional PC or in rack console directly to the SMN see Figure 2 4 on page 34 Note Mass storage option enclosures are not specifically monitored by the ...

Page 49: ... provides a synchronous clock signal to all the CMCs in an SSI Viewing the system from the rear the CMC blade is on the right side of the IRU The CMC accepts direction from the SMN and supports powering up and powering down individual or groups of compute blades and environmental monitoring of all units within the IRU The CMC sends operational requests to the Baseboard Management Controller BMC on...

Page 50: ...under a single system image SSI also called a partition Each CMC shares its information with the SMN as well as other CMCs within the SSI Note that the system management node server optional mass storage units and PCIe expansion enclosures do not have a CMC installed Figure 2 2 SGI UV 2000 LAN attached System Control Network Example Remote workstation monitor Local Area Network LAN Local Area Netw...

Page 51: ...r can take some corrective action This could entail a node shutdown reset NMI or power cycling of the individual blade The individual blade BMCs do not have information on the status of other blades within the IRU This function is handled by the CMCs and the system management node Note that blades equipped with an optional BaseIO riser board have a dedicated BMC Ethernet port System Controller Int...

Page 52: ...ller functions are common across all IRUs however some functions are specific to the type of enclosure Monitors individual blade status via blade BMCs Controls and monitors IRU fan speeds Reads system identification ID PROMs Monitors voltage levels and reports failures Monitors and controls warning LEDs Monitors the On Off power process Provides the ability to create multiple system partitions Pro...

Page 53: ...es 1 Slide Release Move this tab sideways to slide the console out It locks the drawer closed when the console is not in use and prevents it from accidentally sliding open 2 Handle Used to push and pull the module in and out of the rack 3 LCD Display Controls The LCD controls include On Off buttons and buttons to control the position and picture settings of the LCD display 1 2 3 4 ...

Page 54: ...ional KVM switch not provided by SGI See Figure 2 4 for the SMN video connection points The 1U console is basically a dumb VGA terminal it cannot be used as a workstation or loaded with any system administration program The 27 pound 12 27 kg console automatically goes into sleep mode when the cover is closed Figure 2 4 System Management Node SMN Direct Video Connection Ports Mouse Keyboard VGA Por...

Page 55: ...contains memory that it shares with the other processors in the system Because the DSM system is modular it combines the advantages of lower entry level cost with global scalability in processors memory and I O You can install and operate the SGI UV 2000 series system in your lab or server room Each 42U SGI rack holds one to four 10 U high enclosures that support up to eight compute memory and I O...

Page 56: ...36 007 5832 002 3 System Overview Figure 3 1 SGI UV 2000 Single Rack System Example SGI UV 2000 ...

Page 57: ...r SGI sales or service representative for the most current information Note Special systems operated without a system management node SMN must have an optional external DVD drive available to connect to the BaseIO blade Figure 3 2 shows an example of how IRU placement is done in a single rack SGI UV 2000 server The system requires a minimum of one 42U tall rack with three single phase power distri...

Page 58: ...38 007 5832 002 3 System Overview Figure 3 2 SGI UV 2000 IRU and Rack Individual Rack Unit IRU System Management Node 1U I O Expansion Slot UV Rack IRU IRU IRU IRU ...

Page 59: ...he basic expansion building block for the NUMAlink interconnect is the processor node each processor node consists of a dual Hub ASIC also known as a HARP and two eight core processors with on chip secondary caches The Intel processors are connected to the dual Hub ASIC via quick path interconnects QPIs Each dual HUB ASIC is also connected to the system s NUMAlink interconnect fabric through one o...

Page 60: ... 1 2 NI1 1 NI1 3 NI3 1 NI3 3 NI1 3 NI1 1 NI3 3 NI3 1 NI1 1 NI1 3 NI3 1 NI3 3 NI1 3 NI1 1 NI3 3 NI3 1 NI2 2 4 7 NI0 2 NI0 2 N I 2 2 N I 0 2 NI2 2 N I 0 2 N I 2 2 5 6 NI3 0 NI3 0 NI3 0 NI3 0 NI3 0 NI3 0 NI3 0 NI3 0 NI1 0 NI1 0 NI1 0 NI1 0 NI1 0 NI1 0 NI1 0 NI1 0 NI1 2 NI1 2 NI1 2 NI1 2 NI3 2 NI3 2 NI3 2 NI3 2 NI3 2 NI1 2 NI3 2 NI1 2 NI3 2 NI3 2 N I1 2 NI1 2 IRU Backplane Connections Left Backplane R...

Page 61: ...losure system has redundant hot swap fans and redundant hot swap power supplies Distributed Shared Memory DSM In the SGI UV 2000 series server memory is physically distributed both within and among the IRU enclosures compute memory I O blades however it is accessible to and shared by all NUMAlinked devices within the single system image SSI This is to say that all NUMAlinked components sharing a s...

Page 62: ...C O N N E C T O R HARP CONNECTOR Chan 0 Chan 1 Chan 2 Chan 3 PCIe Gen 3 X16 Clocks Clocks NL6 4 Channels 4 QFSP iPass QPI PSOC PSOC PSOC QPI QPI SGPIO SGPIO QPI HARP PCA BOTTOM NODE PCA W BMC SGPIO POWER CONN PCIe X4 PCIe X4 Vcore VSA DDR3 VPPL VTT DDR3 CPU DDR3 Power Vcore VSA DDR3 VPPL VTT DDR3 CPU DDR3 Power BMC to CMCEnet BMC to CMCEnet BMC to CMCEnet BMC to CMCEnet DDR3 SPI Only used for Base...

Page 63: ...e SSI ccNUMA Architecture As the name implies the cache coherent non uniform memory access ccNUMA architecture has two parts cache coherency and nonuniform memory access which are discussed in the sections that follow Cache Coherency The SGI UV 2000 server series use caches to reduce memory latency Although data exists in local or remote memory copies of the data can exist in various processor cac...

Page 64: ...ty Availability and Serviceability RAS The SGI UV 2000 server series components have the following features to increase the reliability availability and serviceability RAS of the systems Power and cooling IRU power supplies are redundant and can be hot swapped under most circumstances Note that this might not be possible in a fully loaded system If all the blade positions are filled be sure to con...

Page 65: ... that monitors the system when a condition occurs that may cause a failure ESP notifies the appropriate SGI personnel Systems support remote console and maintenance activities Power on and boot Automatic testing occurs after you power on the system These power on self tests or POSTs are also referred to as power on diagnostics or PODs Processors and memory are automatically de allocated when a sel...

Page 66: ...ID 0 support SGI does not recommend the end user configure it in this way RAID 0 offers no fault tolerance to the system disks and a decrease in overall system reliability The SGI UV 2000 ships with RAID 1 functionality disk mirroring configured if the option is ordered Dual disk enabled compute blade This riser enabled blade supports two hard disk drives that normally act as the system disks for ...

Page 67: ...our SGI sales or support representative Figure 3 5 SGI UV 2000 IRU System Components Example Compute blade 3 Compute blade 2 PS0 PS2 PS1 USB 2 1 0 SAS0 3 SAS4 7 VGA SERIAL LAN1 LAN0 BMC PCIE Compute blade 0 Compute blade 1 Compute blade 7 Compute blade 6 Compute blade 5 Compute blade 4 ...

Page 68: ...nal 1 8 inch solid state drives SSDs The SSDs can be configured as JBOD or RAID1 The RAID1 SSD pair is a software RAID1 and two SSDs must be ordered with the system BaseIO to enable this configuration Figure 3 6 BaseIO Riser Enabled Blade Front Panel Example USB 2 1 0 SAS0 3 SAS4 7 VGA SERIAL LAN1 LAN0 BMC PCIE ...

Page 69: ...xternal QSFP ports Specialized connectors support the connection to both the bottom compute node and the top MIC or GPU board assembly One Bottom compute node board assembly with a single processor socket also supports eight memory DIMM slots 1600 MT s memory DIMMs One baseboard management controller BMC and one x16 Gen3 PCIe full height double wide slot that supports a single MIC or GPU accelerat...

Page 70: ...d with a three digit number sequentially beginning with 001 A rack contains IRU enclosures optional mass storage enclosures and potentially other options In a single compute rack system the rack number is always 001 Optional System Components Availability of optional components for the SGI UV 2000 systems may vary based on new product introductions or end of life components Some options are listed...

Page 71: ...00 Series Rack 42U on page 52 SGI UV 2000 System Rack Technical Specifications on page 56 Overview At the time this document was published only the tall 42U SGI UV 2000 rack shown in Figure 4 2 was available from the SGI factory for use with the SGI UV 2000 systems Other racks may be available to house the system IRUs check with your SGI sales or service representative for information ...

Page 72: ... significant part of the cable management occurs in the front part of the rack The stand alone system management nodes have cables that attach at the rear of the rack Rear cable connections will also be required for optional storage modules installed in the same rack with the IRU s Optional inter rack communication cables can pass through the top of the rack These are necessary whenever the system...

Page 73: ...SGI UV 2000 Series Rack 42U 007 5832 002 53 Each three phase power distribution unit has 9 outlet connections Figure 4 1 SGI UV 2000 Series Rack Example SGI UV 2000 ...

Page 74: ...54 007 5832 002 4 Rack Information Figure 4 2 Front Lock on Tall 42U Rack SGI UV 2000 ...

Page 75: ...SGI UV 2000 Series Rack 42U 007 5832 002 55 Figure 4 3 Optional Water Chilled Cooling Units on Rear of SGI 42U Rack SGI UV 2000 ...

Page 76: ...ping weight approximate 2 381 lbs 1 082 kg air cooled 2 581 1 173 kg water assist cooling Single rack system weight approximate 2 300 lbs 1 045 kg air cooled 2 500 lbs 1 136 kg water assist cooling Voltage range Nominal Tolerance range North America International 200 240 VAC 230 VAC 180 264 VAC Frequency Nominal Tolerance range North America International 60 Hz 50 Hz 47 63 Hz Phase required Single...

Page 77: ...SGI UV 2000 racks Other internal NUMAlink router options are also available for high speed communication between smaller groups of SGI UV 2000 racks For more information on these topics contact your SGI sales or service representative The standard routers used in the SGI UV 2000 systems are the NL6 router blades located internally to each IRU Each of these first level routers contain a single 16 p...

Page 78: ...s 4 or 8 HARP based router blade assemblies Cooling fan assemblies Chassis Management Controller CMC power supply assembly with two power supplies Figure 5 1 SGI UV 2000 Optional NUMAlink ORC Rear View ID BMC ETH0 LINK HEARTBEAT PWR GD 3 3v 12v ID BMC ETH0 LINK HEARTBEAT PWR GD 3 3v 12v ID BMC ETH0 LINK HEARTBEAT PWR GD 3 3v 12v ID BMC ETH0 LINK HEARTBEAT PWR GD 3 3v 12v ID BMC ETH0 LINK HEARTBEAT...

Page 79: ...ries NUMAlink Octal Router Chassis 007 5832 002 59 Figure 5 2 SGI UV 2000 Optional ORC Chassis Example Front View Note The NUMAlink unit s CMC is connected to the CMC in each IRU installed in the rack 7 6 5 4 3 2 1 0 ...

Page 80: ...ations Characteristic Specification Height 7U or 12 25 in 31 1 cm Width 13 83 in 35 13 cm Depth 14 66 in 37 24 cm Top mount NUMAlink router weight approximate 53 lbs 24 1 kg not including attached cables Power supply Three 760 Watt hot plug power supplies Voltage range Nominal North America International 100 240 VAC 230 VAC Frequency Nominal Tolerance range North America International 60 Hz 50 Hz ...

Page 81: ... covered Preparing the System for Maintenance or Upgrade on page 62 Returning the System to Operation on page 62 Warning To avoid problems that could void your warranty your SGI or other approved system support engineer SSE should perform all the setup addition or replacement of parts cabling and service of your SGI UV 2000 system with the exception of the following Using your system console or ne...

Page 82: ...n replacing a RAID 1 system disk Addition of a non RAID disk can be accomplished while the system is powered on but the disk is not automatically recognized by system software Returning the System to Operation When you finish installing or removing components return the system to operation as follows 1 Turn each of the PDU circuit breaker switches to the on position 2 Power up the system If you ar...

Page 83: ...ctors PCIe controlled devices appear the same as PCI PCI X devices to most software PCI Express technology is different from PCI PCI X in the following ways PCI Express uses a point to point serial interface vs a shared parallel bus interface used in older PCI PCI X technology PCIe hardware connectors are not compatible with PCI PCI X see Figure 6 1 Potential sustained throughput of x16 PCI Expres...

Page 84: ...tion on page 89 This section provides instructions for adding or replacing a PCIe card in a PCIe expansion enclosure installed in your system To maximize the operating efficiency of your cards be sure to read all the introductory matter before beginning the installation Caution To protect the PCIe cards from ESD damage SGI recommends that you use a grounding wrist strap while installing a PCIe car...

Page 85: ... PCIe cards in the following lane bandwidth configurations Note Before installing the PCIe expansion cards be sure to remove each respective slot cover and use its screw to secure your expansion card in place 1 Working from the front of the expansion chassis locate the two thumb screws that hold the PCIe board carriage in the expansion chassis 2 Turn the two thumb screws counter clockwise until th...

Page 86: ... the board with the screw that previously held the metal slot cover 7 Push the PCIe board carriage back into the enclosure until it is seated and twist the retaining thumb screws clockwise right until fully secure Important After installation be sure to power on the PCIe expansion enclosure before re booting your system Figure 6 2 The PCIe Expansion Enclosure ...

Page 87: ...Adding or Replacing PCIe Cards in the Expansion Enclosure 007 5832 002 67 Figure 6 3 Card Slot Locations ...

Page 88: ...In the case of a fully configured loaded enclosure this may not be possible Caution The body of the power supply may be hot allow time for cooling and handle with care Use the following steps to replace a power supply in the blade enclosure box 1 Open the front door of the rack and locate the power supply that needs replacement 2 Disengage the power cord retention clip and disconnect the power cor...

Page 89: ...y extract it from the enclosure 5 Align the rear of the replacement power supply with the enclosure opening 6 Slide the power supply into the chassis until the retention latch engages you should hear an audible click 7 Reconnect the power cord to the supply and engage the retention clip Note If AC power to the rear fan assembly is disconnected prior to the replacement procedure all the fans will c...

Page 90: ......

Page 91: ...ter 7 7 Troubleshooting and Diagnostics This chapter provides the following sections to help you troubleshoot your system Troubleshooting Chart on page 72 LED Status Indicators on page 73 SGI Electronic Support on page 75 ...

Page 92: ...technical support organization An individual IRU will not power on Ensure the power cables of the IRU are plugged in Confirm the PDU s supporting the IRU are on No status LEDs are lighted on an individual blade Confirm the blade is firmly seated in the IRU enclosure See also Compute Memory Blade LEDs on page 74 The system will not boot the operating system Contact your SGI support organization htt...

Page 93: ...as IRU Power Supply LEDs Each power supply installed in an IRU has a bi color status LED The LED will either light green or amber yellow or flash green or yellow to indicate the status of the individual supply See Table 7 2 for a complete list Table 7 2 Power Supply LED States Power supply status Green LED Amber LED No AC power to the supply Off Off Power supply has failed Off On Power supply prob...

Page 94: ...t to right System power good green LED BMC heartbeat green LED Blue unit identifier UID LED BMC Ethernet 1 green LED BMC Ethernet 0 green LED Green 3 3V auxiliary power LED Green 12V power good LED If the blade is properly seated and the system is powered on and there is no LED activity showing on the blade it must be replaced Figure 7 1 shows the locations of the blade LEDs Figure 7 1 UV Compute ...

Page 95: ...grates several services so they work together to monitor your system notify you if a problem exists and search for solutions to problems Figure 7 2 shows the sequence of events that occurs if you use all of the SGI Electronic Support capabilities Figure 7 2 Full Support Sequence Example Page or e mail alert 5 Supportfolio Online View the case solutions 2 e mail 6 Implement solution SGI customer an...

Page 96: ...ousands of tested solutions for possible fixes to the problem Solutions that are located in SGI Knowledgebase are attached to the service case 5 You and the SGI support engineers can view and manage the case by using Supportfolio Online as well as search for additional solutions or schedule maintenance 6 Implement the solution Most of these actions occur automatically and you may receive solutions...

Page 97: ...and answers to questions that can be searched by sophisticated knowledge management tools You can log on to SGI Knowledgebase at any time to describe a problem or ask a question Knowledgebase searches thousands of possible causes problem descriptions fixes and how to instructions for the solutions that best match your description or question Supportfolio Online is a customer support resource that ...

Page 98: ......

Page 99: ...iguration ranges Note that while each compute memory blade holds two processor sockets one per node board each socket can support four six or eight processor cores Table A 1 SGI UV 2000 System Configuration Ranges Category Minimum Maximum Processors 32 processor cores 2 blades a a Dual node blades support eight to 16 cores per blade 2 048 processor cores per SSI Individual Rack Units IRUs 1 per ra...

Page 100: ...and side panels Height 79 5 in 201 9 cm Width 31 3 in 79 5 cm Depth 43 45 in 110 4 cm Shipping dimensions Height 81 25 in 206 4 cm Width 42 in 106 7 cm Depth 52 in 132 1 cm Single rack shipping weight approximate 2 381 lbs 1 082 kg air cooled 2 581 lbs 1 173 kg water assist cooling Single rack system weight approximate 2 300 lbs 1 045 kg air cooled 2 500 lbs 1 136 kg water assist cooling Access re...

Page 101: ... F 1500 m to 3000 m 5000 ft to 10 000 ft Temperature tolerance non operating 40 C 40 F to 60 C 140 F Relative humidity 10 to 80 operating no condensation 8 to 95 non operating no condensation Heat dissipation full SGI UV 2000 rack 115 6 kBTU hr maximum based on 33 88 kW approximate Cooling requirement Ambient air or optional water cooling Air flow intake front exhaust rear Approximately 2 800 CFM ...

Page 102: ...ations Feature Specification Single phase power requirements Voltage Frequency Power 200 240V 180 254 VAC min max 50 60 Hz 33 88 kW per rack Hold up time 16 ms Three phase power requirements Voltage Frequency Power Total harmonic distortion US Japan 208V 180 254 VAC International 400V 312 440 VAC 50 60 Hz 33 88 kW per compute rack Less than 10 at full load ...

Page 103: ... port on the baseIO blade see Figure A 1 has the following features Server class 2D hardware acceleration support with integrated 24 bit RAMDAC Display resolution up to 1600 x 1200 60Hz Up to 128 Mbytes DDRII memory interface support A single USB keyboard mouse is supported by the baseIO blade connectors The baseIO VGA interface see Table A 5 on page 84 can be used for all basic interaction with y...

Page 104: ...2 A Technical Specifications and Pinouts Table A 5 VGA Pin Functions Pin Number Function 1 Red 2 Green 3 Blue 4 N C 5 Ground 6 Ground 7 Ground 8 Ground 9 Ground 10 Ground 11 N C 12 DDCDAT 13 HSYNC 14 VSYNC 15 DDCCLK ...

Page 105: ...s for the Ethernet port operating in 10 100 Base T mode and also operating in 1000Base T mode NU Not used Table A 6 Ethernet Pinouts Ethernet 10 100Base T Pinouts Gigabit Ethernet Pinouts Pins Assignment Pins Assignment 1 Transmit 1 Transmit Receive 0 2 Transmit 2 Transmit Receive 0 3 Receive 3 Transmit Receive 1 4 NU 4 Transmit Receive 2 5 NU 5 Transmit Receive 2 6 Receive 6 Transmit Receive 1 7 ...

Page 106: ... Other features of the ports include the following Programmable data parity and stop bits Programmable baud rate and modem control Figure A 3 shows a serial port Figure A 3 Serial Port Connector Pin 7 Request to Send RTS Pin 3 Transmit Data TXD Pin 2 Receive Data RXD Pin 4 Data Terminal Ready DTR not used Pin 5 Ground Pin 9 Ringing Indicator RI not used Pin 8 Clear to Send CTS Pin 6 Data Set Ready...

Page 107: ... the 9 pin male DB 9 connector Table A 7 Serial Port Pinout Pin Assignment Description 1 DCD Data carrier detect 2 RXD Receive data 3 TXD Transmit data 4 DTR Data terminal ready 5 GND Signal ground 6 DSR Data set ready 7 RTS Request to send 8 CTS Clear to send 9 RI Ring indicator ...

Page 108: ... blade that supports general USB applications and optional keyboard and mouse configurations Table A 8 lists the pin assignments for the USB type A connector Figure A 4 Pin Number Locations for USB Type A Connector Table A 8 Pin Assignments for USB Type A Connector Signal Color Pin Number VCC Red 1 Data White 2 Data Green 3 Ground Black 4 1 2 3 4 ...

Page 109: ...may fall causing serious damage to the product 5 Slots and openings in the system are provided for ventilation To ensure reliable operation of the product and to protect it from overheating these openings must not be blocked or covered This product should never be placed near or over a radiator or heat register or in a built in installation unless proper ventilation is provided 6 This product shou...

Page 110: ...per adjustment of other controls may result in damage and will often require extensive work by a qualified technician to restore the product to normal condition If the product has been dropped or the cabinet has been damaged If the product exhibits a distinct change in performance indicating a need for service 11 If a lithium battery is a soldered part only qualified SGI service personnel should r...

Page 111: ...ia displayed on each device is an indication of conformity to the European requirements Caution This product has several governmental and third party approvals licenses and permits Do not modify this product in any way that is not expressly approved by SGI If you do you may lose these approvals and your governmental agency authority to operate this device CMN Number The model number or CMN number ...

Page 112: ... radio frequency energy and if not installed and used in accordance with the instruction manual may cause harmful interference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case you will be required to correct the interference at your own expense If this equipment does cause harmful interference to radio or television rec...

Page 113: ...Cet appareil numérique német pas de perturbations radioélectriques dépassant les normes applicables aux appareils numériques de Classe A préscrites dans le Règlement sur les interferences radioélectriques établi par le Ministère des Communications du Canada VCCI Notice Japan Only Figure B 1 VCCI Notice Japan Only Korean Class A Regulatory Notice Figure B 2 Korean Class A Regulatory Notice ...

Page 114: ...he cable supplied with your system If your monitor cable becomes damaged obtain a replacement cable from SGI Electrostatic Discharge SGI designs and tests its products to be immune to the effects of electrostatic discharge ESD ESD is a source of electromagnetic interference and can cause problems ranging from data errors and lockups to permanent component damage It is important that you keep all t...

Page 115: ... exposition aux rayons Warning Vorsicht Unsichtbare Laserstrahlung Wenn Abdeckung geöffnet nicht dem Strahl aussetzen Warning Advertencia Radiación láser invisible al ser abierto Evite exponerse a los rayos Warning Advarsel Laserstråling vedåbning se ikke ind i strålen Warning Varo Lavattaessa Olet Alttina Lasersåteilylle Warning Varning Laserstrålning når denna del år öppnad ålå tuijota såteeseen...

Page 116: ... Battery Statement Warning There is danger of explosion if a lithium battery is incorrectly replaced in this product Replace a battery only with the same or equivalent type recommended by the manufacturer Dispose of used batteries according to the manufacturer s instructions ...

Reviews: