Cisco SFS 7024 Hardware User'S Manual Download Page 7

Page: 7 / 116

Contents

Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide

OL-8794-04

S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m .

Deprecated

A P P E N D I X

Troubleshooting

Hardware Checks

Switch

Problem

Fix

Power Supply

Problem

Fix

Fan

Problem

Fix

OOB Ethernet RJ45 Port

Problem

Fix

SFS 7024 Leaf Module IB Ports

Problem

Fix

Troubleshooting Scenarios

InfiniBand

Invalid IP Address entered for SWC via Console Port

Bad IB Cable

Improperly Seated IB Cable

Summary of Contents for SFS 7024

Page 1: ...isco Systems Inc 170 West Tasman Drive San Jose CA 95134 1706 USA http www cisco com Tel 408 526 4000 800 553 NETS 6387 Fax 408 526 4100 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Text Part Number OL 8794 04 ...

Page 2: ...the interference by using one or more of the following measures Turn the television or radio antenna until the interference stops Move the equipment to one side or the other of the television or radio Move the equipment farther away from the television or radio Plug the equipment into an outlet that is on a different circuit from the television or radio That is make certain the equipment and the t...

Page 3: ...xi Reporting Security Problems in Cisco Products xii Product Alerts and Field Notices xii Obtaining Technical Assistance xiii Cisco Technical Support Documentation Website xiii Submitting a Service Request xiv Definitions of Service Request Severity xiv Obtaining Additional Publications and Information xiv Product Overview 1 SFS 7024 Feature Set 1 Strategic Benefits 1 Key Design Features 1 SFS 702...

Page 4: ...nd Routing Cable 14 Power Requirements 15 Installation Tasks Checklist 16 Safety Information 16 Tools and Equipment Required 18 Check the Installation Site 19 Unpack the Equipment 19 Installation Tasks 20 Mounting Kit 20 Mark the Rack 20 Install the Rails in the Rack 20 Rack Mount the Switch 21 Installing the Switch Face Plate 24 Installing the Spine and Leaf Modules 25 Removing a Module or Blank ...

Page 5: ...Module Views 43 Leaf Module View 43 Spine Module View 44 Leaf and Spine Module Component Details Area 45 Leaf and Spine Details Header 45 Leaf and Spine Information Area 45 Displaying the Chassis View 46 Chassis View Component Details Area 47 Chassis Details Header 47 Rebooting Components from Chassis Viewer 47 Chassis View Component Information Area 49 Chassis View Component Information Area Tabs...

Page 6: ...ing the Switch OOB IP Address 76 Configuring the Switch Default Gateway IP Address 76 Spine View Menu 78 Logging 78 Purging the Log 79 Select Boot Image 80 License Keys Key Administration 80 Adding a New License Key 81 Deleting a License Key 81 A P P E N D I X A Technical Specifications 83 A P P E N D I X B Command Line Interface 85 Overview 85 Commands and Functional Groups 86 Online Help 87 Keyb...

Page 7: ...ted 93 A P P E N D I X C Troubleshooting 95 Hardware Checks 95 Switch 95 Problem 95 Fix 95 Power Supply 95 Problem 95 Fix 95 Fan 96 Problem 96 Fix 96 OOB Ethernet RJ45 Port 96 Problem 96 Fix 96 SFS 7024 Leaf Module IB Ports 96 Problem 96 Fix 96 Troubleshooting Scenarios 97 InfiniBand 97 Invalid IP Address entered for SWC via Console Port 97 Bad IB Cable 97 Improperly Seated IB Cable 97 ...

Page 8: ...Contents vi Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide OL 8794 04 Se n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a ck d o c c i s c o c o m ...

Page 9: ...applies to the SFS 7024 Release 3 1 or later Table 1 lists the new and changed features available with each supported SFS 7024 release Table 1 Documented Features for the Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Feature Description Changed in Release Where Documented Initial release of the Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide ...

Page 10: ...iguration page 2 31 Rebooting Multiple Managed Spines page 2 39 Double Data Rate DDR capabilities Added DDR information 3 4 Product Overview page 1 1 Port Statistics Field Descriptions page 3 68 CLI command ismPortSetSpeed inthe section IbSwitchInfo page 5 81 of Appendix B Command Line Interface Table 1 Documented Features for the Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide contin...

Page 11: ...Networks LANs Ethernet concepts Simple Network Management Protocol SNMP InfiniBand Organization This guide is organized as follows Chapter Title Description Chapter 1 Product Overview High level information about the Cisco SFS 7024 Chapter 2 Installation Task oriented information for installing the SFS 7024 Chapter 3 Operations and Administration Task oriented information for configuring and monit...

Page 12: ... the Cisco SFS 7012 and SFS 7024 Cisco SFS 7024 InfiniBand Server Switch Release Notes for Cisco Releases Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Cisco SFS 7024 InfiniBand Server Switch Installation and Configuration Note Obtaining Documentation Cisco documentation and additional literature are available on Cisco com This section explains the product documentation resources th...

Page 13: ...mentation You must be a registered Cisco com user to access Cisco Marketplace Registered users may order Cisco documentation at the Product Documentation Store at this URL http www cisco com go marketplace docstore If you do not have a user ID or password you can register at this URL http tools cisco com RPF register register do Documentation Feedback You can provide feedback about Cisco technical...

Page 14: ... Privacy PGP or a compatible product for example GnuPG to encrypt any sensitive information that you send to Cisco PSIRT can work with information that has been encrypted with PGP versions 2 x through 9 x Never use a revoked encryption key or an expired encryption key The correct public key to use in your correspondence with PSIRT is the one linked in the Contact Summary section of the Security Vu...

Page 15: ...ct Identification Tool to locate your product serial number before submitting a request for service online or by phone You can access this tool from the Cisco Technical Support Documentation website by clicking the Tools Resources link clicking the All Tools A Z tab and then choosing Cisco Product Identification Tool from the alphabetical list This tool offers three search options by product ID or...

Page 16: ...sure that all service requests are reported in a standard format Cisco has established severity definitions Severity 1 S1 An existing network is down or there is a critical impact to your business operations You and Cisco will commit all necessary resources around the clock to resolve the situation Severity 2 S2 Operation of an existing network is severely degraded or significant aspects of your b...

Page 17: ...hed by Cisco Systems for engineering professionals involved in designing developing and operating public and private internets and intranets You can access the Internet Protocol Journal at this URL http www cisco com ipj Networking products offered by Cisco Systems as well as customer support services can be obtained at this URL http www cisco com en US products index html Networking Professionals...

Page 18: ...xvi Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide OL 8794 04 ...

Page 19: ...or SFS 7024 components and expansion modules are field replaceable and hot pluggable To allow easy scaling the SFS 7024 provides 24 expansion slots Each slot can support expansion modules with twelve 10 Gbit sec or 4X IB ports meaning the SFS 7024 can scale to 288 4X InfiniBand ports The SFS 7000 Series switches make possible the highest density of InfiniBand fabrics available today SFS 7024 Featu...

Page 20: ...ompliant U L Listed Thermal Management Features Eight 8 fan trays hot plug N 1 fans Two 2 fans per tray 60mm 12VDC Available air flow 400 cfm 20 in H2O Expected air velocity on the switch chip 400 lfpm Fan rotation monitor I2C interface to CME Thermal input from ambient air sensor and Switch chip via IBML links Power Design Features Up to twelve 12 350 Watt power supplies 3 30 Width x 10 67 Depth ...

Page 21: ...024 switch and its associated components include Management Configuration Monitoring Diagnostics Figure 1 1 Chassis Viewer Home Page The Chassis Viewer runs on the Chassis Management Unit CMU processor of the SFS 7024 spine module s and is accessed through an OOB LAN workstation connected to the Ethernet port of the switches Chassis Viewer Functionality For the SFS 7024 Chassis Viewer provides an ...

Page 22: ...and capable servers connected to target devices InfiniBand capable routers provide connectivity between InfiniBand subnets Figure 1 2 Subnet Manager When a network is initially powered up the Subnet Manager queries the subnet management agents running on the network devices for information about node port addressing schemes routing tables and partitions From that point on the Subnet Manager period...

Page 23: ...ts interaction with the SMAs InfiniBand General Services Managers and Agents The InfiniBand specification defines the InfiniBand General Services Managers and their associated agents General Services Managers exchange messages with agents to manage and monitor the performance and the physical environment of devices on the network Once the InfiniBand network is up and running the InfiniBand General...

Page 24: ...upport Built in support for Simple Network Management Protocol SNMP allows users to integrate a SFS 7024 into their existing management frameworks SNMP allows users access to all statistics trend analysis alarm handling filtering and performance monitoring capabilities supported by these management frameworks SNMP MIBs SNMP Management Information Bases MIBs are management elements that are used by...

Page 25: ...sco SFS 7024 and its components and it includes the following information Planning the Installation page 2 13 Installation Tasks page 2 20 Hot Swapping Components page 2 39 Note Before you install operate or service the system read the Regulatory Compliance and Safety Information for the Cisco SFS 7012 and SFS 7024 for important safety information ...

Page 26: ...1030 Warning A readily accessible two poled disconnect device must be incorporated in the fixed wiring Statement 1022 Statement 1019 Main Disconnecting Device Warning The plug socket combination must be accessible at all times because it serves as the main disconnecting device Statement 1019 Waarschuwing De combinatie van de stekker en het elektrisch contactpunt moet te allen tijde toegankelijk zi...

Page 27: ...s Tämä tuote vaatii suojauksen oikosulkuja ylivirtaa vastaan osana asennusta rakennukseen Asenna ainoastaan kansallisten ja paikallisten johdotussäännösten mukaisesti Attention La protection de ce produit contre les courts circuits surtensions doit être assurée par la configuration électrique du bâtiment Vérifiez que l installation a lieu uniquement en conformité avec les normes de câblage en vigu...

Page 28: ...bre cableado tanto locales como nacionales a las que se tenga que atener Varning Denna produkt kräver att kortslutningsskydd överström tillhandahålles som en del av byggnadsinstallationen Installera bara i enlighet med nationella och lokala kabeldragningsbestämmelser Aviso Este produto requer uma proteção contra curto circuito sobrecorrente que deve fazer parte da instalação do edifício Faça a ins...

Page 29: ... équipement doit être installé conformément aux normes électriques nationales et locales Warnung Die Installation der Geräte muss den Sicherheitsstandards entsprechen Avvertenza L installazione dell impianto deve essere conforme ai codici elettrici locali e nazionali Advarsel Installasjon av utstyret må samsvare med lokale og nasjonale elektrisitetsforskrifter Aviso A instalação do equipamento tem...

Page 30: ...lacer le couvercle lors les terminaux ne sont pas en service Assurez vous que les conducteurs non isolés ne sont pas accessibles lorsque le couvercle est en place Warnung In mit Gleichstrom betriebenen Terminals kann es zu gefählicher Spannung kommen Die Terminals müssen abgedeckt werden wenn sie nicht in Betrieb sind Stellen Sie bei Benutzung der Abdeckung sicher dass alle nicht isolierten stromf...

Page 31: ...a acceso a conductores descubiertos cuando la cubierta esté colocada Varning Farlig spänning eller skadlig energi kan finnas i likströmsterminalerna Sätt alltid tillbaka höljet när terminalerna inte används Försäkra att inga oisolerade ledare kan nås när höljet sitter på plats Figure 2 1 Environmental Requirements Ambient operating temperature 50 104 F 5 40 C Non operating temperature 35 C to 65 C...

Page 32: ...earth ground Provide enough room to work on the equipment Clear the work site of any unnecessary materials Make sure the equipment will have enough clearance for front and rear access Installing and Routing Cable Note Building and electrical codes vary depending on the location Comply with all code specifications when planning the site and installing cable When running cables to the equipment cons...

Page 33: ... consumption requirement of 350W Also ensure that the site meets all power supply requirements Before installation and periodically after installation check that the site is receiving clean power Install a power conditioner if necessary Be sure the site is properly grounded to avoid damage from lightning and power surges Uninterruptible Power Supply Consider the following when selecting Uninterrup...

Page 34: ...witch in the rack Step 6 Install IB cables between the SFS 7024 and other IB enabled network devices Step 7 Install intra cabinet power and grounding cables for the switch Step 8 Power up the switch Step 9 Verify the default system IP address for each hemisphere 192 168 100 9 Step 10 Add the equipment to the network Safety Information The following safety guidelines are provided to ensure both per...

Page 35: ...very heavy approximately 175 lbs It is recommended that a lifting device be used to handle a fully loaded chassis Caution Always load the rack from the bottom up loading the heaviest item first Caution Make sure the rack is level and stable before extending any component from the rack Note Ensure that proper airflow is provided to components of the rack Protecting Against Electrostatic Discharge C...

Page 36: ...anch circuit providing power to the rack The total rack load should not exceed 80 percent of the branch circuit rating Caution Keep power cord and connection cables clear of obstructions that might cause damage Caution Do not attempt to service the unit yourself The first course of action is to contact Technical Support Note Unplug this unit from the electrical outlet and refer servicing to a qual...

Page 37: ...lly true if installing or removing an SFS 7024 switch in the upper half of the cabinet when the lower half is empty Unpack the Equipment Warning Read all installation instructions before connecting the system to its power source Step 1 Carefully open the box and unpack the SFS 7024 switch The SFS 7024 is shipped fully populated and should contain SFS 7024 Chassis Leaf modules up to 24 Leaf module ...

Page 38: ...shelf able to support 175 lbs is required Mounting Hardware Kit Contents Kit Mounting Rails containing One pair left and right of bottom support rail assemblies One pair of top support rail assemblies Four heyclips Kit Mounting Hardware 3 8 Square Hole containing Twenty four 10 32 x 0 375 pan head Phillips screws Twenty caged nut adapters for square holed racks Mark the Rack Allow 14U 24 50 inches...

Page 39: ...back flange chassis leaf module side to the rack by installing two screws into the rail and rack Figure 4 Rail Back Flange Step 3 Fasten the rail front flange chassis fan side to the rack by installing one screw into the top hole of each rail Figure 5 Rail Front Flange Install the second rail on the other side of the rack by repeating steps 1 through 3 Rack Mount the Switch Caution Because of its ...

Page 40: ... power supplies are on the front of the chassis leaf modules are to the rear Caution Never lift the switch with the handles on the spine modules leaf modules power supplies and fan trays These handles are not designed to support the weight of the SFS 7024 Step 4 Tighten the screw on the bottom of each side of the chassis into the corresponding bottom hole of the front flange of each rail Figure 6 ...

Page 41: ...he chassis rear side as shown in Figure 8 Figure 8 Top Rail Assembly a When complete the top rail assemby should look like Figure 9 Install 1 screw and caged nut into each hole in the chassis sheet metal Connect the top rail to rack with 1 screw and caged nut into each hole Install 1 screw into each hole in the chassis sheet metal Install the heyclip here ...

Page 42: ... Lower Mounting Bracket and Heyclip Step 8 Install the heyclip to the rail assembly Step 9 If applicable reinstall the chassis fascia s Installing the Switch Face Plate To install the switch face plate s Step 1 On the switch fan side insert the notches on the top of the fascia into the two slots on the chassis frame Snap the bottom of the faceplate in place Install the lower rear mounting bracket ...

Page 43: ...to chassis slots the following recommendations apply a Spine Modules It is recommended that the spine module s be installed into Lower Hemisphere Slot 1 for managed For redundant management populate slots 1 and 2 with management capable spines Use slot 3 for unmanaged Upper Hemisphere Slot 5 for managed For redundant management populate slots 5 and 6 with management capable spines Use slot 4 for u...

Page 44: ...assis slots and that the handles are in the locked position This prevents accidental removal provides proper grounding for the system and helps to seat the bus connectors in the backplane receptacles Removing a Module or Blank The handles are self locking To unlock push up on the handles to disengage from the lock notch Then gently pull the handles out and slide the module out of the slot Note If ...

Page 45: ...he leaf modules and spine modules and the corresponding spine RJ 45 ports It is also important to understand the slot numbering for the fans and power supplies and the corresponding AC power inlets for the power supplies Figure 2 13 SFS 7024 Chassis Front View Spine 1 Managed Fan 4 Fan 2 Fan 3 Fan 1 PS 6 PS 5 PS 4 PS 3 PS 2 PS 1 Spine 2 Managed Spine 3 Unmanaged Fan 8 Fan 6 Fan 7 Fan 5 PS 12 PS 11...

Page 46: ...ert the cable in the port do not twist the connector to achieve the correct orientation Instead reach back a few feet on the cable and twist the bulk cable to allow the connector to rotate to the proper orientation Doing this prevents all of the rotational forces from acting right at the connector terminations Caution It is important to provide strain relief for the IB cable connector Leaf 1 RJ 45...

Page 47: ...the heyclips on the support rails Note Be certain that the power cords are firmly seated into the SFS 7024 AC power inlets Depending upon the purchased configuration refer to Figure 2 14 for which AC power inlet to use Step 2 If necessary replace the faceplates over the switch fans Step 3 Connect the power cables to an AC power outlet Step 4 When the SFS 7024 switch is plugged into an AC power out...

Page 48: ...ss with the command line interface CLI command showChassisIpAddr command The system returns the information similar to the following Chassis IP Address 192 168 100 9 Net mask 0xffffff00 Changing the SFS 7024 IP Address and Default Gateway via the CLI Note The following tasks must be performed for both the upper and lower hemispheres of the SFS 7024 The CLI can be accessed via Telnet SSH or through...

Page 49: ...ress in dotted decimal i e xxx xxx xxx xxx format and m netMask is the new subnet mask in dotted decimal i e xxx xxx xxx xxx format Step 7 To change the SFS 7024 default gateway IP address enter setDefaultRoute h ipaddress where h ipaddress is the new default gateway IP address in dotted decimal i e xxx xxx xxx xxx format Step 8 To to exit the CLI enter logout Updating Management Spine IP Addresse...

Page 50: ...ires within 5 seconds Step 4 At the boot prompt enter the new spine IP address with the following syntax spineip NEW IP ADDRESS Then press Enter Step 5 At the boot prompt enter reboot and press Enter Upon reboot the managed spine will display information similar to the following Unified Boot Manager For The T3 Platform Image Date Jan 19 2006 15 03 31 Checking L2 functionality BCM1125 L2 caches ini...

Page 51: ...leave Bit 0 Number of Mem Channels 1 Testing memory Memory tests pass CPU0 flushing caches L2 flush complete Start type 0xBFC006A0 Jumping to romStart Initializing HyperTransport bus HyperTransport initialization completed rintf MBOX connect interrupt_source 28 vector 62 status 0 Printf MBOX intEnable status 0 Found Intel Strata Flash 128 MBit 0x8918 Mounted raw file system on device image1 size 6...

Page 52: ...tem on device rfa1 size 2097152 bytes Network configuration requested cliEnabled 1 sbe0 speed 100 fullDuplex 0 flowControl 0 sbe1 speed 100 fullDuplex 1 flowControl 0 Note The command spineip changes the IP address for image1 and image2 Verifying Start up The following are ways to determine that the system has started successfully The IB link status indicator LEDs are lit up on the switch ports wh...

Page 53: ...D is Blue if any external InfiniBand links have been established If no external IB links have been established the LED if off RJ45 LEDs The SFS 7024 RJ45 connector has two LEDs Act and 100 The 100 LED is Green when a 100Mbps link is connected The Act LED is Green when an Ethernet link has been established and blinking when the link is active Fan LEDs Fan LEDs indicate the following status es Green...

Page 54: ... state Blinking Green once every four seconds LED test state Off module is in the removable state Spine and Leaf Module Attention LED The Attention LED indicates one of the following conditions Off the system functioning normally Steady Amber the system requires some attention which could indicate one of the following conditions The switch temperature is at a warning level on the module The switch...

Page 55: ...reen DDR Green indicates that the switch is capable of running at DDR speeds Off indicates that the switch is not capable of running at DDR speeds i e SDR only Accessing On line Help Online help can be accessed from anywhere within the Chassis Viewer by clicking on the buttons as shown in Figure 2 17 Figure 2 17 Chassis Viewer Online Help Button s The on line help screens contain topical informati...

Page 56: ...024 Step 1 Power down the switch by removing the power cords from the AC power inlets Rebooting Components from Chassis Viewer Step 1 From the Chassis Details header click Reboot A screen similar to the following is displayed Figure 2 19 Reboot Window Step 2 Select the radio button of the spine to be rebooted or select the radio button to reboot the entire hemisphere Step 3 Click Reboot ...

Page 57: ...re with any switch traffic n reboots just the management card of the slave spine in a non disruptive manner Note If accessing the CLI through Telnet or SSH the user will need to reconnect to the CLI following the reboot Hot Swapping Components Hot Swapping Spine and Leaf Modules Note Following are the general guidelines for hot swapping leaf and spine modules Caution Be certain that the managed sp...

Page 58: ...Step 4 Carefully slide the fan out until it is completely removed from its slot To install a fan unit Step 1 Place the unit into the slot Slowly slide the fan unit in until it engages into the connector Step 2 Using the panel screw push up to re engage the unit Step 3 Tighten the captive panel screw Hot Swapping Power Supplies The SFS 7024 switch requires a minimum of six power supplies for normal...

Page 59: ...ry management interface for each hemisphere of the SFS 7024 switch one Chassis Viewer for each hemisphere allowing the user to perform management configuration and monitoring tasks related to InfiniBand networks The Chassis Viewer runs on the Chassis Management Unit CMU of the SFS 7024 managed spine modules The browser must be on a workstation which has connectivity to the RJ 45 OOB LAN port on th...

Page 60: ...ormation for the SFS 7024 chassis and components fans and power supplies leaf modules and spine modules The selected component provides hyperlinks to related menus and information where the user can perform configuration and monitoring tasks Help Button Figure 3 2 Help Button The HELP button displays online help Each help screen gives the user a high level topic specific description Support Button...

Page 61: ...laying the Leaf and Spine Module Views Leaf Module View To display the leaf module view for the SFS 7024 Step 1 Mouse over the leaf module to display The edges of the leaf module are highlighted green as shown in Figure 3 5 below Figure 3 5 Leaf Module Mouseover Left click the mouse The leaf module view will be displayed ...

Page 62: ...ne Module View To display the spine module view for the SFS 7024 Step 1 Mouse over the spine module to display The edges of the spine module are highlighted green as shown in Figure 3 7 below Figure 3 7 Spine Module Mouseover Left click the mouse The spine module view will be displayed Figure 3 8 Spine Module View ...

Page 63: ... 10 Leaf and Spine Details Header Leaf and Spine Information Area The Leaf and Spine Information Area allows the user to view high level information for each specific leaf or spine module The information area contains two different fields The white fields allow the user to add or modify applicable general and system information which is specific to their environment The gray fields are tied to liv...

Page 64: ...w The edges of the chassis are highlighted green as shown in Figure 3 11 below Figure 3 11 Leaf Module Chassis Mouseover Left click the mouse The chassis view will be displayed Step 2 The second way is to mouse over the outer region of the spine module view The edges of the chassis are highlighted green as shown in Figure 3 12 below Figure 3 12 Spine Module Chassis Mouseover Left click the mouse T...

Page 65: ...e areas Details Header Information area Menu Chassis Details Header The Chassis Details Header allows the user to execute the most common tasks for the SFS 7024 switch Display the applicable hemisphere Home page Reboot View FRU View Log Figure 3 14 Chassis Details Header Rebooting Components from Chassis Viewer Step 1 From the Chassis Details header click Reboot A screen similar to the following i...

Page 66: ...orts Step 2 The system prompts for a user name At the prompt enter admin Step 3 The system prompts for a password At the prompt enter adminpass The system responds with Welcome to the SFS 7024 CLI Type list for the list of commands Step 4 To reboot multiple spines on the SFS 7024 enter the following command reboot now m n where now initiates the reboot process as soon as the user presses Enter i e...

Page 67: ...m information Additionally the Component Information Area has Apply and Refresh buttons which perform the following functionality Apply Saves any user edits within the white fields to flash memory Refresh Refreshes all fields in the information areas Chassis View Component Information Area Tabs The tabs along the top of the information area present information about the following components LED an...

Page 68: ... field only take effect after a chassis power cycle i e shutting down the chassis and powering it back up The net mask of the chassis can be changed by the administrator System Description A textual description of the system which can be assigned by the administrator IB Node Description Assigned by the administrator the IB node description is an IB fabric applicable name that will be displayed wit...

Page 69: ...ription A description of the component assigned by an administrator Alias Name Name of the component assigned by an administrator Serial Num Component serial number Detail A button for each row that displays additional detail about the component Additional details include Part Number Model Version Manufacturer Name Product Name Manufacturer Identification and Manufactured Date Apply Button Saves a...

Page 70: ...kplane Tab The Backplane tab displays switch backplane information For descriptions of the fields see the Power Tab Additionally the user can add or modify applicable Switch component information which is specific to their network environment Modifying Switch Component Information Following is the procedure for modifying the fields for switch components Step 1 Select the applicable tab System Chas...

Page 71: ...k oriented descriptions for configuring and monitoring the SFS 7024 switch and its feature functionality Chassis View Menu Figure 3 19 Chassis View Menu The Chassis View Menu allows the user to execute all configuration and operation tasks available for the SFS 7024 switch Logging The Logging submenu allows the user to set and reset levels for the message log file ...

Page 72: ... The Log System Configurator Device Tab window is displayed Figure 3 22 Log System Configurator Device Tab The Device tab presents current log level configuration settings for the following software modules RAM The circular log buffer contained in memory To access the contents of this buffer use the Chassis Viewer View Log button Syslog All output messages are saved to the syslog host From this sc...

Page 73: ...icates that a serious system error has occurred which might be recoverable If the system exhibits any instability the user should reboot the system or component If errors persist the user should immediately contact the supplier s technical support ALARM Indicates that a serious problem has occurred which degrades capacity or service If the error is recoverable the user should correct the failure I...

Page 74: ...ets DEBUG5 Messages that contain the packet dumps within an I O flow I O flows contain multiple packets Note When configuring the log levels to display debug messages care should be taken to ensure that system performance issues are weighed against troubleshooting requirements Generally the higher the debug number the more information is written to the log Specifically debug 3 5 have the most affe...

Page 75: ... the etc sysconfig syslog file and ensure that the r is included in the SYSLOGD_OPTIONS This allows logging from a remote system For example SYSLOGD_OPTIONS r m 0 Step 2 Type etc init d syslog restart and press Enter Note To centralize logging for all switches in an IB fabric the user can configure each switch to point to the same syslog server running Linux which has the syslog daemon syslogd run...

Page 76: ...yed Figure 3 29 Firmware Update Screen Step 3 In the Select Target Slot Column select the hardware component to change its firmware Note If there are multiple spine modules the user can select all applicable slots Step 4 From the Image to Overwrite drop down list choose a firmware image to overwrite Step 5 In the Firmware Update Package text box enter the path to the alternate firmware file If the...

Page 77: ...Submenu Target Configuration The Target Configuration button displays the SNMP Target Configuration Window allowing the user to view and edit existing SNMP trap destinations Figure 3 31 Target MIB Configuration Button To display the Target Configuration window Step 1 From the menu select SNMP Step 2 Select Target Configuration Step 3 The SNMP Target Configuration window is displayed ...

Page 78: ...t entry use the following CLI command snmpTargetAddr add n name a addr p port t timeout r retry_count l tag_list v parameters s storage_type For example To add a trap target with the IP address 192 168 0 123 that accepts SNMP v2c style traps snmpTargetAddr add n traphost1 a 192 168 0 123 p v2 params Or to add the same target except using SNMP v1traps snmpTargetAddr add n traphost1 a 192 168 0 123 ...

Page 79: ...aps Parameters Specifies a mapping to an entry in the SNMP Target Parameters table determining the version of SNMP to use Storage Type This field determines whether or not the entry is saved for each reboot of the SFS 7024 Nonvolatile means that the value is saved and remains with each subsequent reboot Volatile or Other indicates it will not be saved Status Indicates the current status of the row...

Page 80: ...d determines whether or not the entry is saved for each reboot of the SFS 7024 Nonvolatile means that the value is saved and remains with each subsequent reboot Volatile or Other indicates it will not be saved Status Indicates the current status of the row The row may be in one of three states Active Not in service Not Ready Note A status of not in service indicates that the current row will not b...

Page 81: ...n is displayed Figure 3 34 Filter Status Screen Setting Community Strings The Set Community Stings screen allows the user to set two SNMP community names Read Only Community Name Read Write Community Name Figure 3 35 Set Community Strings Button To set the Community Strings Step 1 Click SNMP Step 2 Click Set Community Strings The Set Community Strings screen is displayed ...

Page 82: ...lows read and write access to SNMP fields exported by the SNMP server Step 3 In each field enter a meaningful name such as public and private shown above and click on Apply Chassis Traps The Chassis Trap Control screen allows the user to set default trap scenarios related to SFS 7024 Figure 3 37 Chassis Trap Control Step 1 Click Chassis Step 2 Click Chassis Traps Step 3 Click Trap Control The Chas...

Page 83: ...tes that a module is not responding to HEARTBEAT poll requests that are issued by the internal chassis management service icsChassisTrapModuleInserted This trap indicates that a module was inserted into the chassis IcsChassisTrapModuleRemoved This trap indicates that a module was removed from the chassis icsChassisTrapModuleFailed This trap indicates that a module has failed and is not operational...

Page 84: ...p indicates that an error condition was encountered when reading the EEPROM of the power supply icsChassisTrapPowerSupplyFanFailed This trap indicates that a power supply fan has failed and is not operational Fan Group icsChassisTrapFanNotResponding This trap indicates that a fan is not responding to HEARTBEAT poll requests that are issued by the internal chassis management service icsChassisTrapF...

Page 85: ...Statistics submenu select IB Port Stats The IB Port Statistics window is displayed Figure 3 40 IB Port Statistics Understanding Port Naming Conventions Following is an explanation of the conventions used in the Port Name column Leaf modules ports L Leaf module number P Leaf module port number Example L13P01 is leaf module 13 port number 1 Interswitch Link ISL Ports S Spine module number L Leaf lea...

Page 86: ...known Active Link Width Indicates the bandwidth of the link on the backplane The bandwidth is specified as a multiplier of 2 5 Gbit sec full duplex serial links As an example 4X specifies a bandwidth of 10 Gbit sec Note Values of 1X are possible in this field with 4X IB cables if poor cable connections or defective 4X IB cables are used Link Width Enabled Indicates actual link width as opposed to ...

Page 87: ... and or consolidate the results of this counter Link Downed The number of times the link error recovery process failed The value of the counter does not increment past 255 The Performance Manager may reset and or consolidate the results of this counter Receive Errors Number of errors received on the port Remote Physical Error Received Number of remote physical errors received on the port Transmit ...

Page 88: ... the Leaf Port Stats menu select IB Port Stats Figure 3 41 Leaf Port Stats Menu The leaf port statistics window is displayed Figure 3 42 Leaf Port Statistics Window For information on the each IB port statistic field refer to the section Port Statistics Field Descriptions page 3 68 Spine Modules Step 1 Select a spine module The spine module view is displayed Step 2 From the Spine Port Stats menu s...

Page 89: ...Statistics Field Descriptions page 3 68 Set Field Thresholds The Set Field Thresholds screen allows the user to set for a specific parameter s an error message threshold for the 12 cable ports on the SFS 7024 Figure 3 45 Set Field Thresholds To change error reporting thresholds do the following Step 1 Click on Port Stats Step 2 Click on Set Field Thresholds The Set Field Thresholds screen is displ...

Page 90: ...lds will be displayed as red on the home page The following are descriptions for each field in the Set Field Thresholds area Note The thresholds for the following four fields are set as a percentage of maximum that is the percentage of maximum port capacity which depending upon the IB fabric configuration can be 4X 10 Gbps 1X 2 5 Gbps portXmitDataThresh The threshold for the number of 32 bit data ...

Page 91: ...rs received on the port portRecvSwRelayErrThresh The threshold for the number of switch relay errors received on the port portXmitDiscardThresh The threshold for the number of transmit discards received on the port portPKeyViolInThresh The threshold for the number of times PKey inbound was invalid on the port portPKeyViolOutThresh The threshold for the number of times PKey outbound was invalid on ...

Page 92: ...he menu click Time Service Step 2 Click Set System Time The System Time Information screen is displayed Figure 3 48 System Time Information Screen To use NTP Step 1 Click the Use Network Time Protocol checkbox Step 2 Enter the IP address for the NTP server Step 3 To save click on Apply Figure 3 49 Time Service NTP Setup To manually set the system time ...

Page 93: ...end dates for daylight saving time Step 3 To save click on Apply Figure 3 51 Time Service Time Zone Daylight Saving Time Setup Time Zone Tips In the U S the following time zones are in effect Eastern Standard Time GMT 5 Central Standard Time GMT 6 Mountain Standard Time GMT 7 Pacific Standard Time GMT 8 Daylight Saving Time Tips For most of the United States Daylight Saving Time begins at 2 a m on...

Page 94: ...s To configure the Switch IP address Step 1 From the OOB LAN IP submenu click Set OOB LAN IP Figure 3 52 Set Switch OOB IP Address Button Step 2 Click in the OOB IP Address field Figure 3 53 Set OOB LAN IP Window Step 3 Enter the correct switch IP address Step 4 Enter the correct net mask Step 5 Click Apply Configuring the Switch Default Gateway IP Address The Set Default Gateway IP address Window...

Page 95: ...Figure 3 54 Set Switch Default Gateway IP Address Button Step 2 Click in the OOB IP Address field Figure 3 55 Set Default Gateway IP Window Step 3 Type in the correct switch default gateway IP address Step 4 Click Apply Note A reboot is required to activate the new gateway IP address ...

Page 96: ...tion on IB port statistics refer to the section SFS 7024 Port Statistics page 3 67 Logging The Logging submenu allows the user to view set levels reset levels and purge the message log file Figure 3 57 Logging Submenu Viewing the Log The View Log button allows the user to view the message log Figure 3 58 View Log Button To view the message log ...

Page 97: ...following steps Step 1 From the Messages window select Edit Select All or CTRL A Step 2 Select Edit Copy or CTRL C Step 3 Open a text editing package such as Notepad Step 4 Select Edit Paste or CTRL V Step 5 Save as a plain text txt file Purging the Log The Purge Log button purges the RAM clearing the log file s Figure 3 60 Purge Log Button To purge the log Step 1 From the menu click Logging Step ...

Page 98: ...e SFS 7024 To select a boot image Figure 3 62 Select Boot Image Button Step 1 From the menu select Maintenance Step 2 Click Select Boot Image The Boot Image Selection screen is displayed Figure 3 63 Boot Image Selection Screen To choose a new boot image Step 1 Click on the radio button of the new boot image Step 2 Click Apply License Keys Key Administration The License Key submenu allows the user ...

Page 99: ...window is displayed Figure 3 66 License Key Management Information Window Step 4 Enter the license key information in the New Key text box and click Apply Note The license key number should be part of the paperwork shipped with the product If the feature functionality is purchased at a later date the license key number will be provided via e mail Deleting a License Key Step 1 Click on the License ...

Page 100: ...82 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide OL 8794 04 Chapter Figure 3 68 License Key Delete Prompt Step 4 Click OK to delete ...

Page 101: ...board via IBML links Environmental Operating temperature 50 104 F 5 40 C at sea level altitude derating 2 F 1 C per 300m to 2 000m Non operating temperature 35 C to 65 C Relative humidity non condensing operating 5 85 non operating 5 90 Self contained thermal management Power Supply Up to twelve redundant hot plug supplies 90 264 VAC operation 350W max power per supply Input 90 264V AC 47 63Hz 1 P...

Page 102: ...84 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide OL 8794 04 Appendix ...

Page 103: ...H For a standalone SFS 7024 the user would Telnet to the unit s IP address es Once connected the CLI works as any telnet session does To access the CLI a login and password is required There are two user modes operator and administrator with the following access privileges Operator Read only access Administrator Read and write Access Reboot access Can change operator and administrator passwords Ca...

Page 104: ... fan tray power supply and FRU information Network General network commands Firmware Provides commands for updating the firmware via a File Transfer Protocol FTP server or Secure Copy Protocol SCP if using SSH to access the SFS 7024 The SFS 7024 has the ability to store the location of the firmware files for future upgrades Additionally the Firmware functional group includes commands for viewing t...

Page 105: ...des for each command all necessary information to successfully execute the command For example typing help fwShowUpdateParams displays the following information NAME fwShowUpdateParams SYNOPSIS fwShowUpdateParams DESCRIPTION Display the default update firmware settings OPTIONS None Keyboard Shortcuts The CLI keeps a history of recently executed commands This history is available via the Up and Dow...

Page 106: ...cute the help COMMAND NAME command General help Prints out help info for a specific command list Lists all the valid commands history Display command history reboot Reboots the device who Display all the active CLI sessions killCliSession Terminate a CLI session broadcast Write a message to all active CLI sessions swapBsDel Toggle the key binding for the backspace character setTermWidth Change the...

Page 107: ...ShowLids smGetPriority Use smShowPriority smDumpGroups Use smShowGroups smDumpServices Use smShowServices smDumpSubscriptions Use smShowSubscriptions smDisplayMasterLMC Use smShowMasterLMC smDisplaySmMasterLid Use smShowMasterLid smDumpLidMap Use smShowLidMap smDisplayMaxLid Use smShowMaxLid smDisplaySMParms Use smShowSMParms ismTune ...

Page 108: ...asterSpine1 showInventory NAME Slot 2 DESCR 4X 12 Port Card PID 74 4316 02 VID V02 SN SST0639000C NAME Spine 1 DESCR Fabric Module MGR D PID 74 4319 02 VID V02 SN SST06390002 NAME Chassis DESCR 144 Port IB Server Switch PID 74 4314 02 VID V02 SN SST06390001 NAME Power Supply 1 DESCR SFS 7012 7024 Power Supply PID 74 4321 01 VID N A SN N A NAME Power Supply 2 DESCR SFS 7012 7024 Power Supply PID 74...

Page 109: ...outes for the OOB management port ping Send Ping packets to a specified IP address showChassisIpAddr Displays the chassis IP address setChassisIpAddr Change the chassis IP address showDefaultRoute Displays the default gateway IP address setDefaultRoute Change the default gateway IP address arpShow Displays the link level adress resolution protocol ARP table hostShow Displays the host name table ...

Page 110: ...evices option 1 do not change settings for the following devices BriefRam Changes will have no effect Console This device changes log messages that are displayed on the RS232 port Trap Modifying traps may have adverse effects if the device is configured to send traps to a SNMP management station By default it is configured to send traps Enabling additional log levels will have no effect but disabl...

Page 111: ...iew Enable Disable ports for entire chassis ismPortDisable Disables the named port ismPortSetSpeed Sets a named port s speed to 2 5Gbs 5 0Gbs or auto negotiate ismIslSet12x View Set Unset chassis link width to 12X except external ports ismIslSetSpeed View Set port link speeds to 2 5 5 0 or AutoNegotiate except external ports ismShowPStatThresh Display the port statistics thresholds ismSetPStatThre...

Page 112: ...tureSm Capture subnet manager information captureIsm Capture IB switch information captureChassis Capture chassis information captureLog Capture log information captureMisc Capture miscellaneous information This includes information such as license keys memory test time zone and time Daylight Saving Time DST captureSnmp Capture SNMP information captureShell Capture shell command information ...

Page 113: ...n Hardware Checks page C 95 Troubleshooting Scenarios page C 97 Hardware Checks Switch Power Supply Problem Fix The Switch has no power Ensure that the power cord s is attached to the Switch and the power outlet Ensure that the power supply s is seated properly Problem Fix DC OK LED is off Indicates DC power failure or no DC power is present AC OK LED is off Indicates AC power failure or no AC pow...

Page 114: ...This problem would occur if there is a RJ45 cable that has poor shielding or contact of pins Ensure that the cable is a straight through Cat 5 cable not a crossover cable If using a straight through cable and still experiencing this problem Test with a known good cable Absence of Ethernet link and or intermittent Ethernet connectivity Ensure that the Ethernet cable is Cat 5E or Cat 6 certified Pro...

Page 115: ...sing the console port during the boot sequence Bad IB Cable Symptoms When viewing the IB fabric with a subnet manager viewer no nodes will be seen or only the nodes that have a good IB connection will be seen Resolution Workaround Possibly a bad IB cable s Ensure that there is a Blue LED illuminated on the leaf module IB ports of the SFS 7024 switch Make sure that all devices nodes can be seen in ...

Page 116: ...98 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide OL 8794 04 Appendix ...

Search results

Summary of Contents for SFS 7024

Reviews:

Related manuals for SFS 7024

Brands by name

Popular brands

Cisco SFS 7024, Hardware User'S Manual

Search results

Summary of Contents for SFS 7024

Reviews:

Related manuals for SFS 7024

Brands by name

Popular brands