manualshive.com logo in svg

Silicon Graphics ICE XA, Hardware User'S Manual, Page: 5 / 96

Share
Download
Silicon Graphics ICE XA Hardware User'S Manual Download Page 5

007-6399-002

 

v

Contents

List of Figures

  .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .   ix

List of Tables

    .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .   xi

Audience.     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     . xiii
Important Information    .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     . xiii
Chapter Descriptions      .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     . xiv
Related Publications .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .  xv
Conventions .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .xvii
Product Support  .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .xvii
Reader Comments    .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     xviii

1.

Operation Procedures

 .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .    1

Precautions   .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .    1

ESD Precaution .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .    1
Safety Precautions   .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .    2

Console Connections      .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .    3
Powering the System On and Off    .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .    4

Preparing to Power On  .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .    5
Powering On and Off    .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .    8

Console Management Power (cpower) Commands    .     .     .     .     .     .     .     .     .     .     .     .    8

Monitoring Your Server .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .  12

Chassis Management Monitoring and Control .     .     .     .     .     .     .     .     .     .     .     .     .     .     .  12
PCIe Subsystem Control     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .  13

2.

System Management

   .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .  15

Using the 1U Console Option    .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .  17
Levels of System and Chassis Control   .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .     .  17

Summary of Contents for ICE XA

Page 1: ...SGI ICE XA System Hardware User Guide Document Number 007 6399 002 ...

Page 2: ...ommercial computer software subject to the provisions of its applicable license agreement as specified in a 48 CFR 12 212 of the FAR or if acquired for Department of Defense units b 48 CFR 227 7202 of the DoD FAR Supplement or sections succeeding thereto Contractor manufacturer is SGI 900 North McCarthy Blvd Milpitas CA 95035 TRADEMARKS AND ATTRIBUTIONS SGI and the SGI logo are registered trademar...

Page 3: ...007 6399 002 iii Record of Revision Version Description 001 May 2015 First release 002 July 2015 Second release covering updated cpower commands ...

Page 4: ......

Page 5: ... 1 Operation Procedures 1 Precautions 1 ESD Precaution 1 Safety Precautions 2 Console Connections 3 Powering the System On and Off 4 Preparing to Power On 5 Powering On and Off 8 Console Management Power cpower Commands 8 Monitoring Your Server 12 Chassis Management Monitoring and Control 12 PCIe Subsystem Control 13 2 System Management 15 Using the 1U Console Option 17 Levels of System and Chassi...

Page 6: ...andwidth Overview 28 Blade Memory Features 29 Blade DIMM Memory Features 29 DIMM Bandwidth Factors 29 Memory Channel Recommendation 30 System InfiniBand Switch Blades 30 System Features and Major Components 31 Modularity and Scalability 31 System Administration Server 32 Rack Leader Controller 33 Multiple Chassis Manager Connections 33 The RLC as Fabric Manager 34 Service Nodes 35 Login Server Fun...

Page 7: ... XA Series D Rack 42U 46 ICE XA D Rack Technical Specifications 49 SGI ICE XA E Cell Rack Assemblies 50 E Cell Functional Overview 51 E Cell Compute Rack Specifications 51 E Cell Cooling Rack Specifications 52 Cooling Distribution Unit CDU Rack Specifications 53 5 SGI ICE XA Administration Leader Servers 55 Overview 56 System Hierarchy 56 Communication Hierarchy 57 1U Rack Leader Controller and Ad...

Page 8: ... B Safety Information and Regulatory Specifications 71 Safety Information 71 Regulatory Specifications 73 CMN Number 73 CE Notice and Manufacturer s Declaration of Conformity 73 Electromagnetic Emissions 73 FCC Notice USA Only 74 Industry Canada Notice Canada Only 74 VCCI Notice Japan Only 75 Chinese Class A Regulatory Notice 75 Korean Class A Regulatory Notice 75 Shielded Cables 76 Electrostatic ...

Page 9: ...w of a 1U Service Node 35 Figure 3 6 2U Service Node Front and Rear Panel Example 36 Figure 3 7 SGI Remote Solutions Process Overview 41 Figure 4 1 D Rack Front Lock Example 47 Figure 4 2 Optional Water Chilled Door Panels on Rear of ICE XA D Rack 48 Figure 4 3 E Cell Rack Configuration Example 50 Figure 4 4 E Cell Rack Assembly Example CDU on Left 54 Figure 5 1 SGI ICE XA System Administration Hi...

Page 10: ...x 007 6399 002 List of Figures Figure A 1 Ethernet Port 70 Figure B 1 VCCI Notice Japan Only 75 Figure B 2 Chinese Class A Regulatory Notice 75 Figure B 3 Korean Class A Regulatory Notice 75 ...

Page 11: ...pecifications 51 Table 4 3 SGI ICE XA E Cell Cooling Rack Specifications 52 Table 4 4 SGI ICE XA Cooling Distribution Unit CDU Specifications 53 Table A 1 SGI ICE XA Series Configuration Ranges 65 Table A 2 ICE XA System D Rack Physical Specifications 66 Table A 3 Environmental Specifications Single D Rack 67 Table A 4 SGI ICE XA E Rack Physical Specifications 68 Table A 5 Environmental Specificat...

Page 12: ......

Page 13: ...tten with the assumption that the reader has a good working knowledge of computers and computer systems Important Information Warning To avoid problems that could void your warranty your SGI or other approved service technician should perform all the setup addition or replacement of parts cabling and service of your SGI ICE XA series system with the exception of the following items that you can pe...

Page 14: ...rack leader and other support server nodes An outline of the server functions is also provided Chapter 6 Basic Troubleshooting provides recommended actions if problems occur on your system Chapter 7 Maintenance Procedures covers end user service procedures that do not require special skills or tools to perform Procedures not covered in this chapter should be referred to SGI customer support specia...

Page 15: ...y as an optional service node for login batch MDS or other service node purposes This server is not used as a system RLC or administrative server SGI Rackable C2112 GP2 System User Guide P N 007 6362 00x This guide covers general operation installation configuration and servicing of the 2U Rackable C2112 GP2 server node used in the SGI ICE XA system The 2U server can be used as a service node for ...

Page 16: ...ut software and documentation in this release are in a file named README SGI in the root directory of the SGI ProPack for Linux distribution media You can also view man pages by typing man title on a command line SGI systems include a set of Linux man pages formatted in the standard UNIXA man page style Important system configuration files and commands are documented on man pages These are found o...

Page 17: ...that a preceding element can be repeated man page x Man page section identifiers appear in parentheses after man page names GUI element This font denotes the names of graphical user interface GUI elements such as windows screens dialog boxes menus toolbars icons buttons boxes fields and lists Product Support SGI provides a comprehensive product support and maintenance program for its products as f...

Page 18: ... comments Online the document number is located in the front matter of the manual In printed manuals the document number is located at the bottom of each page You can contact SGI in the following ways Send e mail to the following address techpubs sgi com Contact your customer service representative and ask that an incident be filed in the SGI incident tracking system SGI values your comments and w...

Page 19: ...ions Before operating your system familiarize yourself with the safety information in the following sections ESD Precaution on page 1 Safety Precautions on page 2 ESD Precaution Caution Observe all electro static discharge ESD precautions Failure to do so can result in damage to the equipment Wear an approved ESD wrist strap when you handle any ESD sensitive device to eliminate possible damage to ...

Page 20: ... warning labels Caution Power off the system only after the system software has been shut down in an orderly manner If you power off the system before you halt the operating system data may be corrupted Warning If a lithium battery is installed in your system as a soldered part only qualified SGI service personnel should replace this lithium battery For a battery of another type replace it only wi...

Page 21: ...drawer closed when the console is not in use and prevents it from accidentally sliding open 2 Handle Used to push and pull the module in and out of the rack 3 LCD Display Controls The LCD controls include On Off buttons and buttons to control the position and picture settings of the LCD display 4 Power LED Illuminates blue when the unit is receiving power 1 2 3 4 Figure 1 1 Flat Panel Rackmount Co...

Page 22: ...through the RS 232 port is disabled Check with your service representative if use of an RS 232 terminal is required for your system The flat panel rackmount or other optional VGA console connects to the administration controller s video VGA and USB connectors on the back of the system see Figure 1 2 VGA Port Ethernet LAN Ports IPMI LAN Port USB Ports COM Port UID Power Supplies 2 Figure 1 2 Admini...

Page 23: ... the blade enclosure supplies and will start the chassis manager board in each enclosure Tip The chassis manager in each blade enclosure will stay powered on as long as there is power coming into the unit Turn off the PDU breaker switch that supplies voltage to the enclosure if you want to remove all power from the enclosure 3 If you plan to power on a server that includes optional mass storage en...

Page 24: ...Power distribution unit PDU Power source 6 007 6399 002 1 Operation Procedures Figure 1 3 Eight Outlet Single Phase PDU Example Figure 1 4 on page 7 shows an example of the three phase PDU ...

Page 25: ...Powering the System On and Off 007 6399 002 7 Figure 1 4 Three Phase PDU Example ...

Page 26: ... or single system components or individual racks The cpower command is as follows cpower option target_type action target_list Example cpower command arguments are listed and described in Table 1 1 See Table 1 2 on page 11 for examples of the cpower command strings Table 1 1 cpower option action target type and target list descriptions Argument Description Option h help Show this help message and ...

Page 27: ...y Turns on the identifying LED of the target for the period specified by the i seconds option see the description in the Option portion of this table on Powers on the target by sending an IPMI power on command Valid target types are switch iru leader node and system If the target type is system leaders and compute nodes are powered on first then the ICE compute nodes are powered on off Powers off ...

Page 28: ... reset on the target by sending an IPMI reset command Valid target types are leader and node The wait option is available for this action shutdown Shuts down the target but does not power it off by sending a shutdown h now command via ssh Waits for targets to shut down Valid target types are node leader and system Target_list Performs the listed action on all specified target types such as r1i n w...

Page 29: ... halt r i n Shuts down halts all the blade enclosure compute nodes in the system but not the administrative controller server rack leader controller or other service nodes cpower system off and cpower system on Reboots all rack leaders and nodes in a system cpower node on r1i0n8 Command tries to specifically boot rack 1 IRU0 node 8 cpower leader status Determines the power status of all rack leade...

Page 30: ...onsole management package These console connections enable you to view the status and error messages generated by your SGI ICE XA system You can also use these consoles to input commands to manage and monitor your system See the section System Power Status on page 17 for additional information Chassis Management Monitoring and Control There is one chassis management controller board CMC slot in ea...

Page 31: ...ns on blades must be ordered from the factory or installed by trained service personnel Additional PCIe based I O sub systems are sited in the administrative controller server rack leader controller and service node systems used with the blade enclosures These are the most easily configurable I O system interfaces for the SGI ICE XA systems See the particular server s user guide for detailed infor...

Page 32: ......

Page 33: ...wer down of the blade enclosure s compute node blades and environmental monitoring of all units within the enclosure The CMC takes direction from the RLC and stays powered on as long as there is power applied to the blade enclosure Note that the stand alone service nodes use IPMI to monitor system health Mass storage enclosures are not managed by the SGI ICE XA system controller network Figure 2 1...

Page 34: ...nitor Local Area Network LAN Local Area Network LAN Cat 5 Ethernet SGI ICE XA system admin and service node rack 16 007 6399 002 2 System Management Figure 2 1 SGI ICE XA System Admin and Service Node Network Access Example ...

Page 35: ...ol The chassis management control network configuration of your ICE XA series machine will depend on the size of the system and the control options selected Typically any system with multiple blade enclosures will be interconnected by the chassis managers in each blade enclosure Note Mass storage option enclosures are not monitored by the blade enclosure s CMCs Chassis Controller Interaction In al...

Page 36: ...nd adjust the activity of the cooling racks in an E Cell as well as the external cooling distribution unit CDU The CDU rack supplies liquid cooling to the individual blades within the E racks 48 port GigE switch 48 port GigE switch Stacking cables VLAN VLAN VLAN VLAN VLAN VLAN LAN1 LAN2 BMC LAN3 LAN4 LAN1 LAN2 BMC LAN3 LAN4 CMC 0 CMC 1 CMC 2 CMC 3 CMC 4 CMC 5 CMC 6 CMC 7 RLC node Customer LAN Syst...

Page 37: ...cpower commands are communicating with BMCs using the IPMI protocol Note that the term IRU represents a single blade enclosure within a rack This is a legacy identification from the ICE individual rack unit IRU nomenclature Note that system level power up commands are applied first to service nodes then to RLCs then to blade enclosures and compute blades The cpower commands may require several sec...

Page 38: ...not power off the system administration node server rack leader controller server or other service nodes See Console Management Power cpower Commands on page 8 for additional information on power on power off and power status commands The SGI Management Center Administration Guide for Clusters P N 007 6358 00x has more extensive information on these topics ...

Page 39: ...ach of the up to nine compute blades supported in an enclosure are equipped with up to four two socket nodes with ASICs memory components and I O chip sets mounted on them The blades slide directly in and out of the enclosures Every processor socket on a blade supports dual inline memory module DIMM memory units using DDR4 bandwidths Optional PCIe slots hard disk or solid state SSD drives and MIC ...

Page 40: ... shared memory system like that used in the SGI UV series of high performance compute servers Instead of passing pointers into a shared virtual address space parallel processes in an application pass messages and each process has its own dedicated processor and address space This chapter consists of the following sections System Models on page 22 SGI ICE XA System and Blade Architectures on page 2...

Page 41: ...IB switch ASICs located in switch blades in the blade enclosure eliminate the requirement for external IB switches The InfiniBand technology provides for fast communication between compute blades within the same chassis and also between compute blades in separate enclosures Optional water chilled D rack cooling is available for support nodes and storage Note that ICE XA blade enclosures require li...

Page 42: ...ack and typical support hardware that would be installed in the rack The rack would include single phase PDUs or optional three phase PDUs with enough outlets to support all the installed support hardware You can also add additional RAID and non RAID disk storage to your rack system and this should be factored into the number of required outlets An optional single phase PDU has 8 outlets and can b...

Page 43: ...ional service node Optional storage units 1U Gig E switch Rack leader controller Admin server Service node 1U console kbd monitor System Models 007 6399 002 25 Figure 3 2 D rack Standard and Optional Components Example ...

Page 44: ...ing fourteen data rate FDR InfiniBand embedded HCAs Single port IB HCA Dual port IB HCA Each of the two physical boards within the IP125 blade is divided into two logically independent compute nodes equipped with two processor sockets and eight DIMM slots Features of the IP125 blade include Eight Intel processors total within each blade The eight processors are cooled with liquid Cold Sink technol...

Page 45: ...cture is described in more detail in the following paragraphs The compute blade contains the processors memory and uses two of the following fourteen data rate FDR InfiniBand embedded HCAs Single port IB HCA mezzanine cards one per dual socket node board Each of the two physical boards within the IP139 blade is a logically independent two processor compute node equipped with eight DIMM slots Featu...

Page 46: ...A system node board is interconnected using two QuickPath Interconnect QPI links Each QPI link consists of two point to point 20 bit channels one send channel and one receive channel Each QPI channel is capable of sending and receiving at the same time on the same 20 bit channel The QPI link has a theoretical maximum aggregate bandwidth of 25 6 GB s using a 3 2 GHz clock rate and 38 4 GB s using a...

Page 47: ... memory DIMM DIMM Bandwidth Factors Note the following factors regarding processors and DIMMs on a blade Different processor SKUs may support different maximum DIMM speeds such as 1866 or 2133 Each DIMM has a maximum operating frequency or speed regardless of the processor it is connected to or the number of companion DIMMs Each of the DIMMs on a blade s node board must be the same capacity and fu...

Page 48: ...nd 18 ports from each ASIC for connecting to external targets The difference is in connectivity The premium switch has twice the external ports to use for expanding the topology and creating larger configurations with a higher bandwidth interconnect fabric Note that All to All and Hypercube topologies do not require external InfiniBand switches but are built by interconnecting the internal InfiniB...

Page 49: ...he system along with additional blade enclosures You can add different types of stand alone module options to a system rack to achieve the desired system configuration You can configure and scale blade enclosures around processing capability memory size or InfiniBand fabric I O capability The blade enclosure has redundant power supplies A cooling distribution unit CDU rack expands an ICE XA rack s...

Page 50: ...All compute blades Admin controller All Rack Leader Controllers Runs IPMI software Compute Blades Contains the following Processors Memory Optional PCIe slots and drives Optional MIC GPU cards Each Blade has a BMC Runs Linux OS Service Nodes Login Batch Gateway Optional Lustre Nodes Storage Runs Linux OS Each node has a BMC In Band Software Figure 3 3 SGI ICE XA System and Network Components Overv...

Page 51: ... blade stand alone 1U server The rack leader controllers are guided and monitored by the system administration server Each RLC in turn monitors pulls and stores data from all the blade enclosures within the logical rack that it monitors The rack leader then consolidates and forwards data requests received from the blade enclosures to the administration server A rack leader controller also supplies...

Page 52: ...ng distribution unit Figure 3 4 Administration and RLC Cabling to Chassis Managers The RLC as Fabric Manager In some SGI ICE XA configurations the fabric management function is handled by the rack leader controller RLC node The RLC is an independent server that is not part of the blade enclosure pair See the Rack Leader Controller on page 33 subsection for more detail The fabric management softwar...

Page 53: ...a 1U Service Node Login Server Function The login server function within the ICE XA system can be functionally combined with the I O gateway server node function in some configurations One or more per system are supported Very large systems with high levels of user logins may use multiple dedicated login server nodes The login node functionality is generally used to create and compile programs and...

Page 54: ... logins increase Users login to a batch server in order to run batch scheduler portable batch system load sharing facility PBS LSF programs Users login or connect to this node to submit these jobs to the system compute nodes I O Gateway Node The I O gateway server function may be combined with login or other service nodes for many configurations If required the I O gateway server function can be h...

Page 55: ...read write and modify data in the format imposed by these file systems When a client accesses a file it completes a filename lookup on the MDS node As a result a file is created on behalf of the client or the layout of an existing file is returned to the client For read or write operations the client then interprets the layout in the logical object volume LOV layer which maps the offset and size t...

Page 56: ...viceability RAS The SGI ICE XA server series components have the following features to increase the reliability availability and serviceability RAS of the systems Power and cooling Power supplies within the blade enclosure are redundant and can be hot swapped under most circumstances A rack level water chilled cooling option is available for D racks Blade enclosures have overcurrent protection at ...

Page 57: ...d Optional SGI Remote Services SGI RS The optional SGI RS system automatically detects system conditions that indicate potential future problems and then notifies the appropriate personnel This enables you and SGI global support teams to pro actively support systems and resolve issues before they develop into actual failures SGI Remote Services provides a secure connection to SGI Customer Support ...

Page 58: ...Remote Service Operations Overview An SGI Support Services Software Agent runs on each SGI system at your location enabling remote system monitoring and secure communication to SGI Support staff Your basic hardware and software configuration as well as system health information is captured and stored in the Cloud Figure 3 7 shows an example visual overview of the monitoring and response process Cl...

Page 59: ...ions to problems and answers to questions that can be searched by sophisticated knowledge management tools You can log on to SGI Knowledgebase at any time to describe a problem or ask a question Knowledgebase searches thousands of possible causes problem descriptions fixes and how to instructions for the solutions that best match your description or question ...

Page 60: ...ct Additional electronic services may become available after publication of this document To purchase a support contract that allows you to use all available SGI Electronic Support services contact your SGI sales representative For more information about the various support contracts see the following Web pages http www sgi com support http www sgi com services support ...

Page 61: ...enclosure employs front mounted power supplies Compute blade Holds up to four nodes and up to 24 memory DIMMs depending on blade type 1U RLC rack leader controller One 1U rack leader server is required for each eight CMCs in a system High availability configurations using redundant RLCs are supported 1U Administrative server This server node supports an optional console and administrative software...

Page 62: ...r RLC as well as the compute blades that reside in that rack Note that an air cooled D rack is used to support administrative and rack leader server nodes service specific nodes optional mass storage enclosures and potentially other options Optional System Components Availability of optional components for the SGI ICE XA series of systems may vary based on new product introductions or end of life ...

Page 63: ...l Specifications on page 49 SGI ICE XA E Cell Rack Assemblies on page 50 E Cell Functional Overview on page 51 Overview At the time this document was published only specific SGI ICE XA racks were approved for ICE XA systems shipped from the SGI factory See Figure 4 4 on page 54 for an example Contact your SGI sales or support representative for more information on configuring SGI ICE XA systems in...

Page 64: ...r doors in a system You cannot use the rear door key to secure the front door lock Cable entry exit area Cable access openings are located in the front floor and top of the rack Stand alone administrative leader and login server modules have cables that attach at the rear of the rack Rear cable connections will also be required for optional storage modules installed in the same rack with the servi...

Page 65: ...SGI ICE XA Series D Rack 42U 007 6399 002 47 Figure 4 1 D Rack Front Lock Example ...

Page 66: ...48 007 6399 002 4 Rack Information Figure 4 2 Optional Water Chilled Door Panels on Rear of ICE XA D Rack ...

Page 67: ... 062 lbs 1 136 kg approximate water cooled Shipping weight max 2 365 lbs 1 075 kg approximate air cooled 2 553 lbs 1 205 kg approximate water cooled Voltage range Nominal Tolerance range North America International 200 240 VAC 230 VAC 180 264 VAC Frequency Nominal Tolerance range North America International 60 Hz 50 Hz 47 63 Hz Phase required 3 phase or optional single phase I O rack Power require...

Page 68: ...igure 4 3 for an example The racks are connected together to create a sealed unit to support closed loop cooling The E Cell rack system does not exhaust heated air into the surrounding environment this means an E Cell does not add to the heat load of the computer room Multiple E Cells can be interconnected and configured to create very large systems Many E Cell configurations also require the use ...

Page 69: ...e left and right side compute racks are internally different because of air flow requirements Table 4 2 SGI ICE XA E Rack Technical Specifications Characteristic Specification Operating height width depth with skins and trim installed 93 in 236 2 cm x 23 6 in 60 cm x 60 in 152 4 cm Shipping height width depth pallet and crate 89 5 in 228 cm x 38 6 in 98 cm x 63 in 160 cm Empty compute rack weight ...

Page 70: ...aracteristic Specification Cooling rack height 93 in 236 2 cm E Cell cooling rack width 23 6 in 60 cm E Cell cooling rack depth 60 in 152 4 cm Shipping height width depth 89 5 in 228 cm x 38 6 in 98 cm x 63 in 160 cm pallet crate Cooling rack weight unit Shipping weight max Approx 1 400 lbs 635 kg Approx 1 816 lbs 825 5 kg Voltage range Nominal Tolerance range North America Japan International 480...

Page 71: ...e cooling modules at a temperature above the room s dew point All functions such as switching pumps if applicable controlling water temperature etc are automatic Table 4 4 SGI ICE XA Cooling Distribution Unit CDU Specifications Characteristic Specification CDU height 74 2 in 188 5 cm CDU width 23 6 in 60 cm CDU depth 39 4 in 100 cm Shipping height width depth 82 in 208 3 cm x 29 3 in 74 5 cm x 45 ...

Page 72: ...54 007 6399 002 4 Rack Information Figure 4 4 E Cell Rack Assembly Example CDU on Left ...

Page 73: ...ibe the stand alone servers that act as management infrastructure controllers The specialized functions these servers perform within the SGI ICE XA system primarily include Administration and management Rack leader controller RLC functions Other servers described in this chapter can be configured to provide additional services such as Fabric management usually used with larger systems Login Batch ...

Page 74: ... controller server also known as the system admin controller is at the top of the distributed management infrastructure within the SGI ICE XA system The overall SGI ICE XA series management is hierarchical see the following subsection System Hierarchy and also Figure 5 1 on page 58 with the RLC s communicating with the compute nodes via CMC interconnect System Hierarchy The SGI ICE XA system has a...

Page 75: ...cal rack as the RLC Chassis Management Controllers The CMCs within a logical rack communicate with the following The rack leader controllers RLCs within the same logical rack The following two components communicate with CMCs in E Cell rack systems The cooling rack controller CRC is assigned to the same logical rack as the CMCs The cooling distribution unit CDU is assigned to the same logical rack...

Page 76: ...bution Unit CDU Customer LAN 48 port GigE Switch System Control GigE Backbone V L A N 1 a n d V L A N 4 Each CMC talks to a maximum of 40 BMCs V L A N 3 V L A N 3 VLAN3 and VLAN4 Service Nodes V L A N 1 System Admin Node V L A N 1 a n d V L A N 3 Mid plane Board Management Controllers BMC Board Management Controllers BMC Up to 4 BMCs per blade Switch blade BMCs up to 4 58 007 6399 002 5 SGI ICE XA...

Page 77: ...vision and manage cluster functions using SGI cluster management software Refer to the SGI Management Center Administration Guide for Clusters P N 007 6358 00x if you need more detailed information The RLC can query the CMCs for monitored environmental data temperatures fan speeds and voltages for each blade enclosure Power control for each blade within an enclosure is handled by the Baseboard Man...

Page 78: ...s a dual processor serverboard based on the Intel C610 chipset The serverboard motherboard supports two Intel Xeon E5 2600 v3 series processors Four DDR4 memory channels are available per CPU socket with two DIMM slots per channel A direct media interface connects the node s PCH ASIC to processor 1 while 40 lane Gen 3 PCIe interconnect lines link both processors directly to the motherboard LAN por...

Page 79: ...file expansion slot 1U Service Nodes 007 6399 002 61 Figure 5 4 SGI Rackable C1104 GP1 1U Service Node Front and Rear Panel Example 2 1 Figure 5 5 SGI Rackable C1104 GP1 System Control Panel and LEDs From left to right the LED indicators are Overheat fan fail UID LAN1 and LAN2 network indicators Hard drive activity and power good LEDs ...

Page 80: ...vers are 2U rackmount service nodes Each model of the server has two main subsystems the 2U server chassis and a dual processor serverboard The C2112 GP2 system offered uses up to twelve hard disk drives Figure 5 6 shows a front and rear view example of the C2112 GP2 service node s components See the SGI Rackable C2112 GP2 System User Guide P N 007 6362 00x for more detailed information on these 2...

Page 81: ...rear view of the SGI UV 30 service node and describes the unit s external components HDD 0 HDD 1 HDD 2 HDD 3 HDD 4 HDD 5 HDD 6 HDD 7 HDD 8 HDD 9 HDD 10 HDD 11 HDD 12 HDD 13 HDD 14 HDD 15 HDD 16 HDD 17 HDD 18 HDD 19 HDD 20 NVMe HDD 21 NVMe HDD 22 NVMe HDD 23 NVMe Control panel Hard drive bays 24 Power supplies 2 PCI expansion slots with riser cards UID switch LED USB Ports VGA Port IPMI LAN Port LA...

Page 82: ......

Page 83: ...0 System level Specifications Table A 1 summarizes the SGI ICE XA series configuration ranges Table A 1 SGI ICE XA Series Configuration Ranges Category Minimum Maximum Blades per enclosure 2 bladesa a Compute blades support four stuffed sockets each 9 blades Blades per E Cell 18 blades 72 Compute nodes per blade 4 compute nodes 4 compute nodes Blade enclosure 1 per rack 4 per rack Compute blade DI...

Page 84: ...ll maximum 2 062 lbs 1 136 kg approximate water cooled Shipping weight maximum 2 553 lbs 1 205 kg approximate water cooled Shipping height maximum 88 75 in 225 4 cm Shipping width 44 in 111 8 cm Shipping depth 62 75 in 159 4 cm Voltage range Nominal Tolerance range North America International 200 240 VAC 230 VAC 180 264 VAC 180 254 VAC Frequency Nominal Tolerance range North America International ...

Page 85: ...ating no condensation Rack cooling requirements Ambient air or optional water cooling Heat dissipation to air Air cooled ICE XA rack Approximately 115 63 kBTU hr maximum based on 33 89 kW 100 dissipation to air Heat dissipation to air Water cooled ICE XA rack Approximately 5 76 kBTU hr maximum based on 33 89 kW 5 dissipation to air Heat dissipation to water Approximately 109 85 kBTU hr maximum bas...

Page 86: ...ght full 2 500 lbs 1 134 kg approximate Shipping weight max 2 908 lbs 1 319 kg approximate Voltage range Nominal Tolerance range North America International 200 240 VAC 230 VAC 180 264 VAC 180 254 VAC Frequency Nominal Tolerance range North America International 60 Hz 50 Hz 47 63 Hz 47 63 Phase required single phase or optional 3 phase Power requirements max 76 kVA 77 47 kW Hold time 20 ms Power c...

Page 87: ...0 C 40 F to 60 C 140 F Relative humidity 10 to 95 operating no condensation 10 to 95 non operating no condensation Rack cooling requirements Chilled water cooling Heat rejection dissipation to air Zero BTUs Heat rejection dissipation to water Approximately 246 kBTU hr maximum 21 tons based on 100 dissipation to water Maximum altitude 10 000 ft 3 049 m operating 40 000 ft 12 195 m non operating E C...

Page 88: ... A 1 Ethernet Port Table A 6 shows the cable pinout assignments for the Ethernet port operating in 10 100 Base T mode and also operating in 1000Base T mode Table A 6 Ethernet Pinouts Ethernet 10 100Base T Pinouts Gigabit Ethernet Pinouts Pins Assignment Pins Assignment 1 Transmit 1 Transmit Receive 0 2 Transmit 2 Transmit Receive 0 3 Receive 3 Transmit Receive 1 4 NU 4 Transmit Receive 2 5 NU 5 Tr...

Page 89: ...may fall causing serious damage to the product 5 Slots and openings in the system are provided for ventilation To ensure reliable operation of the product and to protect it from overheating these openings must not be blocked or covered This product should never be placed near or over a radiator or heat register or in a built in installation unless proper ventilation is provided 6 This product shou...

Page 90: ...per adjustment of other controls may result in damage and will often require extensive work by a qualified technician to restore the product to normal condition If the product has been dropped or the cabinet has been damaged If the product exhibits a distinct change in performance indicating a need for service 11 If a lithium battery is a soldered part only qualified SGI service personnel should r...

Page 91: ...opean requirements Caution This product has several governmental and third party approvals licenses and permits Do not modify this product in any way that is not expressly approved by SGI If you do you may lose these approvals and your governmental agency authority to operate this device CMN Number The model number or CMN number for the system is on the system label which is mounted inside the rea...

Page 92: ...o communications Operation of this equipment in a residential area is likely to cause harmful interference in which case you will be required to correct the interference at your own expense If this equipment does cause harmful interference to radio or television reception which can be determined by turning the equipment off and on you are encouraged to try to correct the interference by using one ...

Page 93: ... numériques de Classe A préscrites dans le Règlement sur les interferences radioélectriques établi par le Ministère des Communications du Canada VCCI Notice Japan Only Figure B 1 VCCI Notice Japan Only Chinese Class A Regulatory Notice Figure B 2 Chinese Class A Regulatory Notice Korean Class A Regulatory Notice Figure B 3 Korean Class A Regulatory Notice ...

Page 94: ...trostatic discharge ESD ESD is a source of electromagnetic interference and can cause problems ranging from data errors and lockups to permanent component damage It is important that you keep all the covers and doors including the plastics in place while you are operating the system The shielded cables that came with the unit and its peripherals should be installed correctly with all thumbscrews f...

Page 95: ...n Warning Advarsel Laserstråling nar deksel åpnesstirr ikke inn i strålen Lithium Battery Statements Warning If a lithium battery is a soldered part only qualified SGI service personnel should replace this lithium battery For other types replace the battery only with the same type or an equivalent type recommended by the battery manufacturer or the battery could explode Discard used batteries acco...

Page 96: ...amma batterityp eller en ekvivalent typ som rekommenderas av apparattillverkaren Kassera anvãnt batteri enligt fabrikantens instruktion Warning Varoitus Päristo voi räjähtää jos se on virheellisesti asennettu Vaihda paristo ainoastaan laitevalmistajan suosittelemaan tyyppiin Hävitä käytetty paristo valmistajan ohjeiden mukaisesti Warning Vorsicht Explosionsgefahr bei unsachgemäßen Austausch der Ba...

Reviews:

No comments