manualshive.com logo in svg

Cisco SFS 7008, Hardware Manual, Page: 1 / 108

Share
Download
Cisco SFS 7008 Hardware Manual Download Page 1

Part Number: 

OL-7725-01

Cisco SFS 7008 InfiniBand Server Switch 

Hardware Guide (Topspin 270 Hardware Guide)
Release 2.2.0 Update 1

Product ID: 140265

Summary of Contents for SFS 7008

Page 1: ...Part Number OL 7725 01 Cisco SFS 7008 InfiniBand Server Switch Hardware Guide Topspin270HardwareGuide Release 2 2 0 Update 1 Product ID 140265 ...

Page 2: ...f by or for the U S Government shall be governed solely by the terms of the license agreement and shall be prohibited except to the extent expressly permitted by the terms of that agreement Any technical data provided that is not covered by the above provisions shall be deemed technical data commercial items pursuant to DFAR section 227 7015 a or equivalent Any use modification reproduction releas...

Page 3: ...ons 16 LEDs 16 Power Supplies 16 Fan Trays 17 Management Interface Modules 17 Fabric Controller Modules 18 Node and Core Slots 18 Line Interface Modules LIM 19 Chassis ID Module 19 Rack Alarm 19 Administrative Features 20 Real Time Clock 20 Latency 20 Non Volatile Memory 20 Vital Product Data Storage 20 Diagnostics 20 2 Installing the Topspin 270 System 21 Prepare the Site 21 Read the Cautionary S...

Page 4: ...Power Supply Modules 35 Removing a Power Supply Module 36 Installing a New Power Supply Module 38 Fan Tray Modules 39 About the Fan Tray Modules 39 Removing a Fan Module 39 Installing a Fan Module 41 Fabric Controllers 42 About the Fabric Controllers 42 Removing a Fabric Controller 42 Installing a Fabric Controller 44 Upgrading the Controller Card 44 Line Interface Management Modules LIM 45 About ...

Page 5: ...h Chassis Manager 76 Monitor the Device 76 Monitor the Cards 79 Monitor the InfiniBand Ports 80 Monitor the Power Supplies 81 Monitor the Fans 82 Monitor the Temperature 83 Monitoring the System with Element Manager 84 Interpreting the Summary Tab 84 Interpreting the Power Supplies Tab 85 Interpreting the Fans Tab 85 Interpreting the Sensors Tab 85 Monitor the System With the CLI 86 6 Hardware Dia...

Page 6: ...vi 7 Specifications and Compliance Certifications 103 Chassis and Management Interface 103 Electrical Specifications 104 EMC Immunity 104 Safety 104 Acoustics 104 Product Markings 105 8 Index 107 ...

Page 7: ...interference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at his own expense Safety Information Electrical Cautions on page vii General Cautions on page ix Electrical Cautions CAUTION Use only the power cable provided with your Topspin system Inspect the power co...

Page 8: ...or straight into the jack If the chassis comes equipped with a power plug retainer move the bail wire back into place to keep the power plug firmly in place CAUTION The Topspin system contains lithium batteries Do not attempt to replace or discard these batteries The batteries may only be serviced by Topspin service personnel CAUTION Observe and follow service markings Do not service the Topspin s...

Page 9: ...o not spill food or liquids on your system components Protect your Topspin system from sudden power surges and interruptions by using a surge suppressor line conditioner or uninterruptable power supply UPS Place cables appropriately so that they do not obstruct any egress within the data center and they do not block any ventilation inlets or outlets Rack mount the Topspin chassis according to the ...

Page 10: ...x ...

Page 11: ...Switch fail over without rebooting or resetting any cards in the chassis You can access the hot standby controller card with a connection to the serial console port A CLI session to the standby controller provides read only access to the controller You can view but not configure the card Because the hot standby features keeps both controller cards up the show card command identifies the card on wh...

Page 12: ...and will assume the role of fabric controller or fabric node depending on the slot into which they are installed This increases the ease of replacing components because only one type of fabric card has to be stocked and will become a controller or node depending on what is needed Hi Availability Hardware The Topspin 270 features hot swappable and redundant Power Supply Modules Fan Trays Line Inter...

Page 13: ... the master fails another subnet manager will take over within seconds All necessary state information is kept in sync Non Blocking Architecture The Topspin 270 provides non blocking switch element architecture with full bi directional bandwidth for the switch chassis About the Topspin 270 Chassis An overview of the Topspin 270 hardware features are described in this section Diagram of the Chassis...

Page 14: ...14 Figure 1 2 Back Chassis View ...

Page 15: ...ng Slot numbers are printed on the chassis for easy identification Figure 1 3 Chassis Slot Numbering in Front Non port Side Power Supply ID 1 Power Supply ID 2 Fan ID 2 Slot 9 Slot 10 Slot 11 Slot 12 Slot 13 Slot 14 Fan ID 1 ...

Page 16: ...larm All cabling is on the rear of the chassis LEDs LEDs are located on both the front and back of the chassis Refer to Interpreting the Front Panel LEDs on page 65 and Interpreting the Back Panel LEDs on page 71 for more information Power Supplies Refer to Installing a New Power Supply Module on page 38 for installation instructions The Topspin 270 has two AC DC bulk power supply modules Only one...

Page 17: ...o to full speed if one is available CAUTION The fan modules do not have guards Do not remove a fan module completely from the bay until the blades have stopped moving approximately 15 seconds Management Interface Modules See Figure 1 2 on page 14 for a diagram of the chassis Refer to Installing a Management Interface Module on page 50 for installation instructions The Topspin 270 supports redundan...

Page 18: ...em Controller Switch fabric spine Switch fabric end nodes Stores redundant Vital Product Data VPD from the Chassis ID module This allows the chassis to continue functioning and the VPD information to be recovered even if a Chassis ID module fails Each Fabric Controller module runs the management software and contains non volatile storage The behavior and responsibility of each fabric controller mo...

Page 19: ...LIMs which are installed in the rear of the chassis this is opposite of the fabric modules see Figure 1 2 on page 14 The LIMs provide the physical InfiniBand port interfaces and are 4x over copper The number of LIMs in your Topspin 270 chassis depends on your particular configuration Chassis ID Module The chassis ID module is hot swappable and is located on the rear of the chassis see Figure 1 2 o...

Page 20: ...y Some VPD info can be accessed via CLI the Java GUI or the Web GUI The following Vital Product Data can be recovered by returning a Field Replaceable Unit to the original manufacturer Note This requires the appropriate support contract Power on hours Manufacturing part number Serial number Final test date Card ID Failure code Failure date Operation status Failure log OEM part number Diagnostics R...

Page 21: ...formation that you need to safely and successfully prepare your environment for your Topspin 270 Read this section carefully before you install your device Read the Cautionary Statements Refer to the FCC Statement on page vii and the Safety Information on page vii Prepare the Physical Environment for the Topspin 270 System Make sure you have the right cables and sufficient ventilation Unpack the T...

Page 22: ...vided The shelf must support the weight of the chassis which can be up to 106 pounds with all possible components installed Screws appropriate to your rack which are used to secure the rack handles to the rack posts Three people are recommended to lift the switch into the rack however the procedure can be performed by two people Note The Topspin 270 chassis weighs up to 106 pounds fully loaded Rac...

Page 23: ... have determined that the switch will be justified toward the front of the rack then use a 2 phillips screwdriver to unscrew the rack ears from the back of the switch If you have determined that the switch will be justified toward the back of the rack then use a 2 phillips screwdriver to unscrew the rack ears from the front of the switch Figure 2 2 Unscrew Extra Rack Ears from the Chassis 6 Separa...

Page 24: ...24 7 Use 2 3 people to lift the switch into the rack Figure 2 3 Chassis Set onto Shelf 8 Push the chassis into the rack until the rack ears are flush with rails Figure 2 4 Rack Ears Flush with Rails ...

Page 25: ... to Rails Install Optional HA Components If you have purchased a High Availability HA package install the following components Redundant Power Supply Refer to Power Supply Modules on page 35 Redundant Fan Tray Refer to Fan Tray Modules on page 39 Redundant Management Interface Module Refer to Management Interface Modules on page 49 ...

Page 26: ...nt Interface cards make sure that you connect to the left Management Interface module slot 15 which will be the primary Management card upon initial boot up The serial console port is labeled 10101 b Connect the other end of the serial cable to your terminal server or management workstation For detailed information on how to connect the serial console cable please see the documentation included wi...

Page 27: ...commended Management Configuration The diagram below shows the recommended management port connections To have constant access to the chassis remotely redundantly connect the serial ports on two Management Interface cards to a terminal server Figure 2 7 Recommended Management Configuration Power on the Chassis Use only the power cable provided with your InfiniBand system 4 Remove the power cords f...

Page 28: ...rating at 47 63Hz Attach the chassis only to approved power sources as indicated by the electrical ratings label If you are unsure of the correct power source to use contact your support personnel or your local power company The chassis automatically starts and boots You can watch the running status via the serial console Use the correct external power source 8 Check the LEDs on the front of the T...

Page 29: ...n reboots j If you have two Fabric Controllers installed in Core slots you will receive a message asking if you want to save the configuration to the Standby Controller Answer Yes to save the configuration across both controllers Assigning an Address Dynamically a When the system has completed booting press Enter several times to display the CLI prompt Login Login super Password super Topspin 270 ...

Page 30: ...ss both controllers Connect Network Devices This section describes how to connect the InfiniBand system to other network devices InfiniBand devices can be connected to InfiniBand enabled servers About Connectors The Topspin 270 device supports the following types of connectors Management ports Serial console port male DB 9 connector Ethernet Management port RJ 45 jack for unshielded twisted pair c...

Page 31: ... opposite end of the InfiniBand cable will most likely be connected to an InfiniBand enable host refer to the HCA Installation Guide If your host does not provide an ample amount of free space around a given IB port double check that your IB cable connector engages fully Wiggle your connector back and forth to be sure that both sides of the connector have locked firmly into place Connecting to a R...

Page 32: ...steps you should already have these items configured If your device meets these requirements proceed to Launch Chassis Manager on page 32 Otherwise to prepare your device perform the following steps NOTE Consult your network administrator for an IP address subnet mask and gateway address before you begin this process 1 If you have not yet configured an IP address for the Management port refer to C...

Page 33: ... IP address in Step f Figure 2 10 Web Browser Window A log in window opens Figure 2 11 displays the log in window Figure 2 11 Chassis Manager Log In Window 3 Enter your Server Switch user name and password in the log in window and click the OK button Chassis Manager loads in your browser window Figure 2 12 Chassis Manager Opening ...

Page 34: ... the Topspin CD ROM into the CD ROM drive of a server that has network access to a Topspin management port 3 The GUI can be found in the following location on the CD ROM Linux install_linux_ia64 bin Linux install_linux_x86 bin Windows install exe Solaris install_solaris_sparc bin 4 Run the installation wizard a On Windows double click install exe b On Solaris and Linux systems enter sh install_you...

Page 35: ... Power Supply Modules About the Power Supply Modules The Topspin 270 power supply units are hot swappable Only one power module is necessary to power the unit however two power supplies are recommended for redundancy You can add a second module without powering off the chassis If you have two power supply units installed you can remove one of them without removing power from the chassis About a Fa...

Page 36: ... blanking panel to install in its place as overheating may occur 3 Make sure you have a 1 phillips screwdriver to disengage the fasteners Never place your hand inside an empty card or module bay You should never have cause to place a hand anywhere inside the Topspin 270 chassis 4 Remove the bezel cover from the front of the switch 5 Locate the power supply that you want to remove Refer to Power Su...

Page 37: ...ssis Figure 3 1 Diagram of Power Supply to the Associated Power Cord 8 Use a 1 phillips screwdriver to unscrew the fasteners that hold the power supply module in place Figure 3 2 Loosening Captive Screws Power Cord back Power Supply front ...

Page 38: ... have cause to place a hand anywhere inside the Topspin 270 chassis To insert a power supply unit 1 Remove the new power supply from the package 2 Ground yourself appropriately 3 Insert the Topspin provided power cord into the receptacle if one is not already connected and plug it into a power source The power cord receptacles are located on the back of the chassis Each power cord receptacle contr...

Page 39: ... and Interpreting the Fans Tab on page 85 for monitoring information Locating the Fan Tray Both fan modules are located on the front of the chassis When facing the front of the switch with the bezel cover removed the fan modules are located in the left and right receptacles of the Topspin 270 chassis The slots are labelled on the chassis Refer to Figure 1 1 for a diagram of the chassis Removing a ...

Page 40: ...it until the fan blades have stopped moving before completely removing the fan tray from the bay or risk injury 6 Wait 15 seconds to allow the fan blades to stop moving Figure 3 6 Partially Removing Fan Tray 7 Pull the fan tray completely out of the bay 8 Install the blanking panel in place of the fan module Only one fan module is required to run the switch however the device should never be run w...

Page 41: ... the front of the switch if you have not already done so 4 Refer to Removing a Fan Module on page 39 if a module is still in place 5 Remove the blanking panel if no fan module was in place 6 Align the fan module with the bay and slide the module into the bay Figure 3 7 Pushing Fan Module into Slot 7 Push the module until it is firmly in place 8 Use the 1 phillips screw driver to tighten the captiv...

Page 42: ...roller from a core slot make sure that the second pairing of Fabric Controller Management Interface module is intact 2 Removing the fabric controller in the core slot that is currently acting as master will cause a fail over to the standby pair of fabric controller Management Interface modules It takes up to 3 seconds for the standby fabric controller to become a new master a If you are removing a...

Page 43: ... of the card toward you The card will be released Figure 3 10 Opening Fabric Card Levers 7 Use the levers to pull the card toward you and remove it from the bay 8 Place a blanking panel over the open bay No bay should ever be run without a blanking panel or a module installed as overheating may occur or Refer to Installing a Fabric Controller on page 44 to install a new fabric controller ...

Page 44: ...e chassis to verify the status Refer to Fabric Controller LEDs on page 70 10 Tighten the captive screws on both ends of the Fabric Controller module Figure 3 11 Tight the Captive Screws 11 Refer to Upgrading the Controller Card on page 44 Upgrading the Controller Card It is likely that the image version on the new Fabric Controller card will not match the firmware on the rest of the chassis After ...

Page 45: ...er Guide Line Interface Management Modules LIM About LIM Cards Refer to Line Interface Modules LIM on page 19 for specific information about the LIM modules About a Failed LIM Module If you believe a line interface module has failed contact technical support Refer to LIM Status LEDs on page 75 and Monitor the Cards on page 79 for monitoring information Locating a Failed LIM Module The Line Interfa...

Page 46: ...ull the connector away from the port Figure 3 12 Removing a Pinch Type Connector b To remove a cable with a pull connector grasp the connector with one hand and push it toward the port then pull the latch away from the port with your other hand and gently wiggle the connector away from the port Figure 3 13 Removing a Pull Type Connector 2 1 3 ...

Page 47: ... LIM card Figure 3 14 Loosen the Captive Screws 5 Release the LIM module by pulling both levers toward you then toward the outside of the chassis Figure 3 15 Releasing the LIM Module Levers 6 Use the levers to pull the module from the bay Figure 3 16 Pulling a LIM Module from the Slot ...

Page 48: ...anking panel if a LIM module was not currently in place 5 Align the LIM module and slide it into the bay as far as possible The module will not go into the bay completely without closing the levers 6 When the LIM module is nearly installed in the bay press the levers in toward each other Figure 3 17 Closing the LIM Module Levers 7 Check the LIM status LED to determine that the module is functionin...

Page 49: ... you have a method of covering the slot before removing the module Do not remove the module unless you have a replacement or a blanking panel for the slot as overheating may occur 2 Determine if the Management Interface module that you are removing is currently connected to the master fabric controller Note The removal of the Master Management Interface module will trigger a fail over of the Fabri...

Page 50: ... or serial cables to the ports 8 Tighten the outside screws with a 1 phillips screwdriver Chassis ID Modules About Chassis ID Modules Refer to Chassis ID Module on page 19 for additional information Failed Chassis ID Module If you believe a chassis ID module has failed contact technical support Refer to Chassis ID LEDs on page 74 and Monitor the Cards on page 79 for monitoring information A failur...

Page 51: ...tive Screws 4 Pull the Chassis ID module from the bay Figure 3 21 Remove the Chassis ID Module 5 Do not allow the bay to remain empty as overheating may occur The Topspin 270 should never be run without the replacement module so you should immediately install the new Chassis ID module Refer to Installing a Replacement Chassis ID Module on page 52 ...

Page 52: ... the chassis ID module with the slot and push the module completely into the bay 5 Use the LEDs to verify the status of the module Refer to Chassis ID LEDs on page 74 The new Chassis ID has been previously serialized with the information that is unique to your chassis 6 Reboot the chassis by using the GUI or by using the reload command Example Topspin 270 reload System configuration has been modif...

Page 53: ...Upgrading an Individual Controller Card on page 56 Upgrading Individual Node Cards on page 59 Upgrade all Cards in a Chassis These procedures assumes you are upgrading all fabric controllers and node cards in the chassis Upgrading a Topspin 270 with the CLI For the commands needed to upgrade a Topspin 270 chassis using the CLI refer to the CLI Reference Guide ...

Page 54: ... image a Select Maintenance File Management b Click on a img file if one exists and click the Delete button c Repeat for all Server Switches you wish to upgrade 3 Copy the new image to the Server Switch a Select Maintenance File Management b Click the Import button c File Type Image d Select Remote FTP Server or Local File to navigate to the file Figure 4 1 Copy the img File to Server Switch e Cli...

Page 55: ... prompted d Repeat for all Server Switches you wish to upgrade Figure 4 2 Watching the File Copy Progress e Click Ok when the Image Install Completed Successfully message appears 5 Configure the image for the next boot a Select Maintenance Boot Config b Select the new image from the Image Source drop down menu and click the Apply button Figure 4 3 Set the Boot Config c Repeat for all Server Switch...

Page 56: ...ocedure needed to upgrade a Topspin 270 chassis using the Chassis Manager GUI refer to the Chassis Manager User Guide Upgrading an Individual Controller Card When upgrading a single Controller card for example when replacing an old fabric Controller card with a new one it is recommended that you use the CLI if you need to change the image on the new card You can use the Element Manager or Chassis ...

Page 57: ...ory 109676 kbytes used disk space 30891 kbytes free disk space 71488 kbytes last image source TopspinOS 2 2 0 build531 primary image source TopspinOS 2 2 0 build531 image TopspinOS 2 2 0 build531 cpu descr PPC 440GP Rev C Rev 4 129 pvr 4012 0481 fpga firmware rev ae ib firmware rev 0004031fe8 slot id 12 used memory 18092 kbytes free memory 109676 kbytes used disk space 30891 kbytes free disk space...

Page 58: ...pspinOS 2 2 0 build531 image TopspinOS 2 2 0 build531 cpu descr PPC 440GP Rev C Rev 4 129 pvr 4012 0481 fpga firmware rev ae ib firmware rev 0004031fe8 slot id 12 used memory 16017 kbytes free memory 107432 kbytes used disk space 30891 kbytes free disk space 71488 kbytes last image source TopspinOS 2 2 0 build487 primary image source TopspinOS 2 2 0 build487 image TopspinOS 2 2 0 build487 cpu desc...

Page 59: ...b Enter boot config primary image source then paste the copied image file name Example 7 Reset the individual Controller card without rebooting the whole chassis Example Upgrading Individual Node Cards Upgrading a Node Card with the CLI For the commands needed to upgrade a node card using the CLI refer to the CLI Reference Guide Topspin 270 install image Topspin 270 TopspinOS 2 2 0 build531 img op...

Page 60: ...ke room for the new image a Select Maintenance File Management b Click on a img file if one exists and click the Delete button c Repeat for all Server Switches you wish to upgrade 3 Copy the new image to the Server Switch a Select Maintenance File Management b Click the Import button c File Type Image d Select Remote FTP Server or Local File to navigate to the file Figure 4 5 Copy the img File to ...

Page 61: ...d click the Install button c Click Yes when prompted Figure 4 6 Watching the File Copy Progress d Click Ok when the Image Install Completed Successfully message appears 5 Configure the image for the next boot a Select Maintenance Boot Config b Select the new image from the Image Source drop down menu and click the Apply button Figure 4 7 Set the Boot Config ...

Page 62: ...lick the down radio button and select the Apply button Figure 4 8 Disable and Enable the Node Card s c Click the up radio button and select the Apply button 7 View the new image on the node card s when the card comes back online a Select View Device Front View b Right click one of the cards and select Properties c Click the Inventory tab and view the version name in the Current Image Source field ...

Page 63: ...63 Upgrading Node Card s with the Chassis Manager For the procedure needed to upgrade node cards using the Chassis Manager GUI refer to the Chassis Manager User Guide ...

Page 64: ...64 ...

Page 65: ...EDs on page 71 Monitoring the System with Chassis Manager on page 76 Monitoring the System with Element Manager on page 84 Monitor the System With the CLI on page 86 Interpreting the Front Panel LEDs The front of the Topspin 270 chassis has the following types of LED indicators System Wide Status LED on page 66 Power Supply LEDs on page 67 Fan LEDs on page 69 Fabric Controller LEDs on page 70 ...

Page 66: ... of the chassis the system wide status LED is found on the top left corner of the switch In addition a mirror of the system wide LEDs are positioned on the back of the chassis Refer to Management Interface Module LEDs on page 71 Interpreting the System Status LED Table 5 1 Interpreting the System Wide LED see Figure 5 1 Color State Indication off No system power or LED failure Green solid on Syste...

Page 67: ...er Supply LEDs Yellow blinking System identify This state is initiated by the user This LED can be initiated manually by using the diag LED test Refer to the Command Line Reference Guide for more information Example To run identity test on Power Supply 1 config mode diag power supply 1 test led start start flashing stop stop flashing Table 5 1 Interpreting the System Wide LED see Figure 5 1 Color ...

Page 68: ...ositioned on the back of the chassis Refer to Management Interface Module LEDs on page 71 Interpreting the Power Supply LEDs Table 5 2 Interpreting the Power Supply LEDs see Figure 5 2 Color State Indication Green and Yellow off No power to the power supply or LED failure Green solid on Power Supply running with no detected errors Green off No power to the power supply LED failure or DC output fai...

Page 69: ...y test on fan 1 config mode power supply 1 test led start start flashing stop stop flashing Table 5 4 Interpreting the Fan LEDs see Figure 5 1 Color State Indication Green and Yellow off No power to the fan tray or LED failure Green solid on Fan tray running with no detected errors Green off No power to the fan tray LED failure or yellow LED is ON Yellow off Fan tray running with no errors detecte...

Page 70: ...rs detected Green off No power to the fabric controller LED failure or yellow LED is On Yellow off No failure on the fabric controller Yellow solid on Module error detected Operator intervention required Yellow blinking Identify Assists in identifying a particular Field Replaceable Unit on the chassis This state is initiated by the user This LED can be initiated manually by using the diag LED test...

Page 71: ...s The Management Interface modules have six LED yellow over green indicator pairs which show critical system module statuses The six pairs of LED indicators are a mirror of the LEDs that appear on the front of the chassis System wide status Table 5 7 Management Module status Table 5 8 Power Supply 1 and 2 status Table 5 10 Fan Tray 1 and 2 status Table 5 9 In addition the Ethernet Management port ...

Page 72: ...e or yellow LED is ON Yellow solid on At least one module failure in the system Operator attention required The label indicates a failure Yellow blinking Identify Assists in identifying a particular Field Replaceable Unit on the chassis This state is initiated by the user This LED can be initiated manually by using the diag LED test Refer to the Command Line Reference Guide for more information Ex...

Page 73: ...ashing Table 5 9 Interpreting the Fan Tray Status LEDs see Figure 5 6 Color State Indication Green over Yellow off No module power or LED failure Green solid on Fan tray is running with no errors detected Green off No power to the fan tray LED failure or yellow LED is On Yellow solid on Failure of the fan tray Operator attention required The label indicates a failure Yellow blinking Identify a fan...

Page 74: ...reen off No power to the Power supply LED failure or yellow LED is On Yellow solid on Failure of the Power Supply Operator attention required The label indicates a failure Table 5 11 Interpreting the Master Management Connection LEDs see Figure 5 6 Color State Indication Green off Management module is not connected to the active master controller or is connected to the system s standby master cont...

Page 75: ...ule LED failure or yellow LED is On Yellow solid on Failure of the Chassis ID module Operator attention required The label indicates a failure Yellow blinking Identify a Chassis ID module Assists in identifying a particular Field Replaceable Unit on the chassis This state is initiated by the user This LED can be initiated manually by using the diag LED test Refer to the Command Line Reference Guid...

Page 76: ...opspin 270 Quick Start Guide or the Chassis Manager User Guide Monitor the Device 1 Launch the Chassis Manager by entering the IP address of the InfiniBand switch into your web browser 2 Press the Enter key IB Port LEDs Table 5 15 Interpreting the InfiniBand Port Status LED Top Logical LED Bottom Traffic LED Indication off off No link signal detected off solid on Physical link OK No logical link e...

Page 77: ...77 3 The Device Rear View and the Device Front View appear Figure 5 10 Chassis Manager 270 Device Rear View ...

Page 78: ... module is installed A field that read Power Supplies 1 2 would indicate that a power supply was installed in both possible slots The color of the integer indicates the status of the power supply A green number indicates that the power supply is Up A red number indicates that the power supply has failed 5 Use the visual representation of the LEDs to monitor the status of the cards ports power supp...

Page 79: ... menu 5 Click Cards in the left navigation tree The Cards view appears Figure 5 12 Chassis Manager Cards Window 6 You can monitor the following types of cards InfiniBand 12 port Line Interface modules with 4x transmission capacity ib12port4xTX Fabric controller modules installed in a Core slot The 12x refers to the internal chip speed controllerFabric12x Fabric controller modules installed in a No...

Page 80: ...nce they are inserted into the chassis Monitor the InfiniBand Ports 1 Launch the Chassis Manager by entering the IP address of the InfiniBand switch into your web browser 2 Log into the chassis 3 The Device Rear View and the Device Front View appear 4 In the left navigation tree select the Chassis Cards The list of cards appear 5 Click the radio button next to the LIM card whose ports you want to ...

Page 81: ...anager by entering the IP address of the InfiniBand switch into your web browser 2 Log into the chassis 3 The Device Rear View and the Device Front View appear 4 View the Power Supply status at the top of the window to quickly check the status color and the number of modules installed If only one number appears then only one power supply is installed The actual integer refers to the slot in which ...

Page 82: ...k the status color and the number of modules installed If only one number appears then only one fan is installed The actual integer refers to the slot in which the fan module is installed A field that read Fans 1 2 would indicate that a fan trays are installed in both slots The color of the integer indicates the status of the fan A green number indicates that the fan is Up A red number indicates t...

Page 83: ...enu Click Sensors in the left navigation tree The Sensors window appears Figure 5 17 Chassis Manager Sensors Window 5 Verify that the sensor is Up by checking the Current Status column 6 Compare the Current Temp c column to the Alarm Temp and Shutdown Temp columns The Current Temp should be lower than the Alarm Temp The Shutdown Temp indicates the degree in celsius at sea level at which the switch...

Page 84: ...e Sensors at once Interpreting the Power Field A green check next to the Power summary indicates that at least one power source is connected and functioning properly A red check mark indicates that power supply AC is disconnected Interpreting the Fans field A green check next to the Fans summary indicates at least one fan is present and functioning properly A red check indicates a fan failure Inte...

Page 85: ...g status of the fans Figure 5 20 Element Manager Fans Tab 4 Note the OperStatus field A status of up means that the fan is operating properly 5 Note the Speed field The integer in this field represents a percentage The percentage changes based on the ambient temperature of the unit and will increase as the temperature rises Interpreting the Sensors Tab Use the Health Status Sensors tab to view the...

Page 86: ...t of CLI commands refer to the CLI Reference Guide Use the following CLI commands to monitor the Power Supplies the fans and the sensors Monitor the Power Supplies show power supply Example Monitor the Fans show fan An oper status of up means that the blower is operating correctly within the fan unit Topspin 270 show power supply Power supply Information ps type oper status utilization voltage 1 A...

Page 87: ... 30 degrees C above external ambient plus 1 degree for every 1 000 ft above sea level The acceptable temperatures for the Topspin 270 varies depending on the card that is being monitored Topspin 270 show fan Fan Information fan oper status speed 1 up 76 2 up 77 3 up 74 4 up 77 Fan Seeprom product pca pca fru fan serial number serial number number number 1 2 3 4 Topspin 270 show sensor Sensor Infor...

Page 88: ...88 ...

Page 89: ...nning tests in with the Java GUI A Power On Self Test POST is run automatically on various components at power on The following examples refer to running tests and displaying test with the CLI For complete diagnostic command information refer to the Command Line Reference Guide LED Tests LED tests allow you to blink a particular LED to more easily identify a specific component in a rack Self Tests...

Page 90: ... diagnostic self test on a card 1 Enter the diag card command You cannot stop the card test once it has begun Example 2 Exit the test to view the progress of the test The test takes approximately 5 8 minutes Example of test in progress Topspin 270 enable Topspin 270 config Topspin 270 config diag card 11 Topspin 270 config diag card 11 test self test Topspin 270 config diag card 11 start Topspin 2...

Page 91: ...ard 11 exit Topspin 270 config exit Topspin 270 show diagnostic card 11 Diagnostic Tests For Cards test self test slot id 11 iterations 1 action start result success percentage completed 100 result string Card Test Final report PASSED Please reboot system ...

Page 92: ... 02 00 2004 Anafa2Init a2update set to IGNORE Thu Mar 4 19 03 56 2004 POST SEEPROM PASSED Thu Mar 4 19 03 56 2004 POST FPGA PASSED Thu Mar 4 19 03 57 2004 POST SUMMIT PASSED Thu Mar 4 19 03 58 2004 POST RTC PASSED Thu Mar 4 19 04 02 2004 POST FAN PASSED Thu Mar 4 19 04 02 2004 card_startup x card is starting up Thu Mar 4 19 04 02 2004 Anafa2Init a2update set to IGNORE Thu Mar 4 19 04 23 2004 Anafa...

Page 93: ... test Example Topspin 270 enable Topspin 270 config Topspin 270 config diag chassis test standard Topspin 270 config diag chassis start Topspin 270 config diag chassis Topspin 270 config diag chassis exit Topspin 270 config exit Topspin 270 show diag chassis Diagnostic Tests For Chassis module type chassis module number 1 test standard iterations 1 option none action start result success percentag...

Page 94: ...ost Post Status fru slot post status error codes card 1 passed 0 0 0 0 card 2 passed 0 0 0 0 card 7 passed 0 0 0 0 card 8 passed 0 0 0 0 card 9 passed 0 0 0 0 card 10 passed 0 0 0 0 card 11 passed 0 0 0 0 card 12 passed 0 0 0 0 card 13 passed 0 0 0 0 card 14 passed 0 0 0 0 card 15 passed 0 0 0 0 card 17 passed 0 0 0 0 fan 1 passed 0 0 0 0 fan 2 passed 0 0 0 0 fan 3 passed 0 0 0 0 fan 4 passed 0 0 ...

Page 95: ...n 270 show diag fan Diagnostic Tests For Fan module type fan module number 1 test self test iterations 1 action start result in progress percentage completed 70 result string Self Test Current report In progress Topspin 270 Topspin 270 config diag fan 1 exit Topspin 270 config exit Topspin 270 show diag fan Diagnostic Tests For Fan module type fan module number 1 test self test iterations 1 action...

Page 96: ...pspin 270 show diag fru error Fru Error fru slot fru error card 1 none card 2 none card 7 none card 8 none card 9 none card 10 none card 11 none card 12 none card 13 none card 14 none card 15 none card 17 none fan 1 none fan 2 none Topspin 270 reload System configuration is modified Save yes default no filename y Proceed with reload yes default no y Topspin 270 enable Topspin 270 config Topspin 27...

Page 97: ...er supply Information ps type admin status oper status utilization voltage 1 AC up up n a 48 2 AC up up 15 47 Topspin 270 enable Topspin 270 config Topspin 270 config diag power supply 2 Topspin 270 config diag power supply 2 test self test Topspin 270 config diag power supply 2 start Topspin 270 config diag power supply 2 exit Topspin 270 config exit Topspin 270 show diag power supply Diagnostic ...

Page 98: ... 270 show diag fru error Fru Error fru slot fru error card 9 none card 10 none card 11 none card 12 none card 13 none card 14 none card 15 none card 17 none fan 1 none fan 2 none fan 3 none fan 4 none power supply 1 none power supply 2 none Topspin 270 Topspin 270 reload System configuration is modified Save yes default no filename y Proceed with reload yes default no y ...

Page 99: ...OST SUMMIT PASSED Thu Mar 4 10 57 50 2004 POST RTC PASSED Thu Mar 4 10 57 54 2004 POST FAN PASSED Thu Mar 4 10 57 54 2004 card_startup x card is starting up Thu Mar 4 10 57 54 2004 Anafa2Init a2update set to IGNORE Thu Mar 4 10 58 16 2004 Anafa2 POST firmware check PASSED Thu Mar 4 19 01 55 2004 POST SEEPROM PASSED Thu Mar 4 19 01 55 2004 POST FPGA PASSED Thu Mar 4 19 01 55 2004 POST SUMMIT PASSED...

Page 100: ... fan 2 none power supply 1 none Table 6 1 Topspin 270 Baseboard Errors Error Number Description 1 Summit Power Controller Configuration Error 2 I2C Communication Error 3 Serial EEPROM Error 4 DiskOnChip Error 5 Memory Error 6 March SSO Error 7 Realtime Clock Error 8 Fan Error 9 FPGA Error 10 Summit High Temp Error 12 Summit High Current Error 14 Summit Voltage Out of Range Error 16 Firmware Error ...

Page 101: ...101 2 Power Supply Fan Fail Error 3 Power Supply I2C Communication Error Table 6 2 Topspin 270 Power Supply Errors Error Number Description ...

Page 102: ...102 ...

Page 103: ...0C max per 60 minutes Operating Altitude 0 to 10 000 ft Non Operating Altitude 0 to 40 000 ft Operating Humidity 8 to 80 non condensing Non Operating Humidity 5 to 90 RH at 65C for 24 hrs Non condensing Operating Humidity Gradient 10 maximum per 60 min Operating Shock 5G max 11ms half sine wave 10G max 5ms half sine wave Non Operating Shock 10G max 11ms half sine wave Operating Vibration Sinusoida...

Page 104: ...t 15 Subpart B Class A ICES 003 Issue 2 EN 61000 3 2 Harmonics EN 61000 3 3 Flicker EN 55022 1998 EN 55024 1998 EN 61000 4 1 2 3 4 5 6 8 11 Japan VCCI V3 02 04 Table 7 4 Safety Description UL60950 3rd ed CSA 22 2 No 60950 2000 IEC60950 EN60950 EN60825 1 and EN60825 2 Table 7 5 Acoustics Country Deployment Description Sound Pressure 37dB at 25C ambient ISO 7779 and section 8 5 of ISO 3744 1994 E So...

Page 105: ...105 Product Markings UL FCC Statement VCCI CE ICES ...

Page 106: ...106 ...

Page 107: ... card 11 InfiniBand port LEDs 75 L launching Chassis Manager 32 LEDs 71 74 chassis ID 74 chassis manager 78 ethernet management port 74 fabric controller 70 fans 69 InfiniBand ports 75 LIM 75 line interface module 75 management interface module 71 master management connection 74 power supply 67 73 system status 66 LIM about 19 LEDs 75 line interface modules about 19 M management interface module L...

Page 108: ...4 show power supply 97 slot numbers 15 speed port 81 starting Chassis Manager 32 switch configuration 32 switch fabric end nodes about the fabric controller module 18 switch fabric spine about the fabric controller module 18 system controller about the fabric controller module 18 system wide status LED 66 T temperature monitor with chassis manager 83 V view port properties 81 ...

Reviews:

No comments