Cisco SFS 7012 Hardware User'S Manual Download Page 38

Page: 38 / 176

1-28

Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide

OL-8787-05

sbe1 speed=100 fullDuplex=1 flowControl=0

Note

The command

spineip

changes the IP address for

image1

and

image2

SFS 7012 Component LEDs

Chassis Status LED

The chassis status LED is

Green

when the system is functioning normally.

The chassis status LED is

Amber

when one of the following conditions exists:

•

The system ambient temperature exceeds 52 C but remains less than 60 C.

•

Any Fan Alarm is amber.

•

Any power supply AC OK LED is off.

•

Any power supply DC OK LED is off

•

Any spine module Attention LED is on, or it has been determined that a spine is not functioning
(even if it is unable to light the LED).

•

Any leaf module Attention LED is on, or it has been determined that a leaf is not functioning (even
if it is unable to light the LED).

The chassis status LED is

Red

when the system can no longer function properly and indicates one of the

following conditions:

•

The system ambient temperature exceeded 60 degrees C.

•

No functional fan trays are present.

•

No functional spines are present.

•

No functional leaves are present.

The chassis status LED is

off

when:

•

There are no functional power supplies present.

•

There are no management cards in the system

•

AC power has been removed from the system.

Subnet Manager Agent (SMA) LED

There is a single SMA LED associated with the system. This LED is

Blue

if any external InfiniBand

links have been established. If no external IB links have been established, the LED if

off

RJ45 LEDs

The SFS 7012 RJ45 connector has two LEDs,

Act

and

100

. The

100

LED is

Green

when a 100Mbps

link is connected. The

Act

LED is

Green

when an Ethernet link has been established, and blinking when

the link is active.

Fan LEDs

Fan LEDs indicate the following status(es):

•

Green

indicates that the fan is functioning properly.

Summary of Contents for SFS 7012

Page 1: ...isco Systems Inc 170 West Tasman Drive San Jose CA 95134 1706 USA http www cisco com Tel 408 526 4000 800 553 NETS 6387 Fax 408 526 4100 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Text Part Number OL 8787 05 ...

Page 2: ...o correct the interference by using one or more of the following measures Turn the television or radio antenna until the interference stops Move the equipment to one side or the other of the television or radio Move the equipment farther away from the television or radio Plug the equipment into an outlet that is on a different circuit from the television or radio That is make certain the equipment...

Page 3: ... the Installation 1 7 Rack Specifications and Recommendations 1 7 Cable Requirements 1 8 Uninterruptible Power Supply 1 8 Installation Tasks Checklist 1 9 Safety Information 1 9 Tools and Equipment Required 1 11 Check the Installation Site 1 11 Unpack the Equipment 1 12 Installation Tasks 1 12 Mounting Kit 1 13 Mark the Rack 1 13 Install the Rails in the Rack 1 13 Rack Mount the Switch 1 14 Instal...

Page 4: ...splaying the Leaf and Spine Module Views 2 3 Leaf Module View 2 3 Spine Module View 2 4 Leaf and Spine Module Component Details Area 2 5 Leaf and Spine Details Header 2 5 Leaf and Spine Information Area 2 5 Displaying the Chassis View 2 6 Chassis View Component Details Area 2 7 Chassis Details Header 2 7 Rebooting Components from Chassis Viewer 2 7 Chassis View Component Information Area 2 8 Chass...

Page 5: ...3 Leaf and Spine Module IB Port Statistics 2 35 Leaf Modules 2 35 Spine Modules 2 35 Set Field Thresholds 2 36 Time Service 2 38 Configuring the Switch OOB IP Address 2 41 Configuring the Switch Default Gateway IP Address 2 41 Spine View Menu 2 43 Logging 2 43 Purging the Log 2 44 Maintenance 2 45 Select Boot Image 2 45 License Keys Key Administration 2 46 Adding a New License Key 2 46 Deleting a ...

Page 6: ... B 49 KeyManagement B 53 IbSwitchInfo B 54 TimeManagement B 68 SNMP B 71 Capture B 76 A P P E N D I X C Troubleshooting C 1 Hardware Checks C 1 Switch C 1 Problem C 1 Fix C 1 Power Supply C 1 Problem C 1 Fix C 1 Problem C 2 Fix C 2 OOB Ethernet RJ45 Port C 2 Problem C 2 Fix C 2 SFS 7012 Leaf Module IB Ports C 2 Problem C 2 Fix C 2 Troubleshooting Scenarios C 3 InfiniBand C 3 Invalid IP Address ent...

Page 7: ...e Users Guide Feature Description Changed in Release Where Documented Initial release of the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Redundant Management Added redundant management information 3 3 Installing the Spine and Leaf Modules page 1 17 Updating Management Spine IP Addresses in a Redundant Management Configuration page 1 25 Double Data Rate DDR capabilities Added DDR i...

Page 8: ...uration page 2 19 Accessing the CLI page B 3 Added the following CLI commands userAdd userRem userListShow userAdd allows multiple user accounts to be created userRem allows user accounts to be removed userListShow allows the list of user accounts to be displayed 4 1 1 1 11 Refer to the CLI command group General page B 4 Table 1 Documented Features for the Cisco SFS 7012 InfiniBand Server Switch H...

Page 9: ...ic working knowledge of Local Area Networks LANs Ethernet concepts Simple Network Management Protocol SNMP InfiniBand Organization This guide is organized as follows Chapter Title Description Chapter 1 Installation Task oriented information for installing the Cisco SFS 7012 Chapter 2 Operations and Administration Task oriented information for configuring and monitoring the SFS 7012 Appendix A Tech...

Page 10: ...3012R Cisco SFS 7012 InfiniBand Server Switch Release Notes for Cisco Releases Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Cisco SFS 7012 InfiniBand Server Switch Installation and Configuration Note Obtaining Documentation Obtaining Support and Security Guidelines For information on obtaining documentation obtaining support providing documentation feedback security guidelines and ...

Page 11: ...ts components and it includes the following information Planning the Installation page 1 7 Installation Tasks page 1 12 Hot Swapping Components page 1 30 Note Before you install operate or service the system read the Regulatory Compliance and Safety Information for the Cisco Server Fabric Switches 7000P 7000D 7008P 7012 7024 and 3012R for important safety information ...

Page 12: ...0 Warning A readily accessible two poled disconnect device must be incorporated in the fixed wiring Statement 1022 Statement 1019 Main Disconnecting Device Warning The plug socket combination must be accessible at all times because it serves as the main disconnecting device Statement 1019 Waarschuwing De combinatie van de stekker en het elektrisch contactpunt moet te allen tijde toegankelijk zijn ...

Page 13: ...ämä tuote vaatii suojauksen oikosulkuja ylivirtaa vastaan osana asennusta rakennukseen Asenna ainoastaan kansallisten ja paikallisten johdotussäännösten mukaisesti Attention La protection de ce produit contre les courts circuits surtensions doit être assurée par la configuration électrique du bâtiment Vérifiez que l installation a lieu uniquement en conformité avec les normes de câblage en vigueur...

Page 14: ... cableado tanto locales como nacionales a las que se tenga que atener Varning Denna produkt kräver att kortslutningsskydd överström tillhandahålles som en del av byggnadsinstallationen Installera bara i enlighet med nationella och lokala kabeldragningsbestämmelser Aviso Este produto requer uma proteção contra curto circuito sobrecorrente que deve fazer parte da instalação do edifício Faça a instal...

Page 15: ...uipement doit être installé conformément aux normes électriques nationales et locales Warnung Die Installation der Geräte muss den Sicherheitsstandards entsprechen Avvertenza L installazione dell impianto deve essere conforme ai codici elettrici locali e nazionali Advarsel Installasjon av utstyret må samsvare med lokale og nasjonale elektrisitetsforskrifter Aviso A instalação do equipamento tem de...

Page 16: ...er le couvercle lors les terminaux ne sont pas en service Assurez vous que les conducteurs non isolés ne sont pas accessibles lorsque le couvercle est en place Warnung In mit Gleichstrom betriebenen Terminals kann es zu gefählicher Spannung kommen Die Terminals müssen abgedeckt werden wenn sie nicht in Betrieb sind Stellen Sie bei Benutzung der Abdeckung sicher dass alle nicht isolierten stromführ...

Page 17: ...mounting rail hole pattern identified in IEC Standard 297 Mounting holes flush with the rails to accommodate the switch Use a rack grounding kit and a ground conductor that is carried back to earth or to another suitable building ground Ground the equipment rack to earth ground Provide enough room to work on the equipment Clear the work site of any unnecessary materials Make sure the equipment wil...

Page 18: ...ir UTP cables can build up Electrostatic Discharge ESD charges when being pulled into a new installation Before installing category 5 UTP cables discharge ESD from the cable by plugging it into a port on a system that is not powered on When required for safety and fire rating requirements plenum rated cable can be used Check the local building codes to determine when it is appropriate to use plenu...

Page 19: ...stall the switch in the rack Safety Information The following safety guidelines are provided to ensure both personal safety for the user and to protect the system from potential damage These precautions cover the following categories Precautions for Rack Mountable Products Protecting Against Electrostatic Discharge Electrical Safety Precautions Precautions fit into one of three categories Note A t...

Page 20: ...ion Make sure the rack is level and stable before extending any component from the rack Note Ensure that proper airflow is provided to components of the rack Protecting Against Electrostatic Discharge Caution Use a grounded wrist strap designed to prevent static discharge Caution Static electricity can harm delicate components inside the system To prevent ESD damage users need discharge any static...

Page 21: ...yourself The first course of action is to contact Technical Support Note Unplug this unit from the electrical outlet and refer servicing to a qualified service center if any of the following conditions occur The power cord is damaged or frayed The unit has been dropped or the case has been damaged The unit has been exposed to any liquids The unit does not operate normally when all operating instru...

Page 22: ...n instructions before connecting the system to its power source Step 1 Carefully open the box and unpack the SFS 7012 switch The SFS 7012 is shipped fully populated and should contain SFS 7012 Chassis Leaf modules up to 12 Leaf module blanks up to 11 These blanks populate unused leaf module slots to help maintain the thermal integrity of the chassis Spine modules up to 3 Spine module blanks up to ...

Page 23: ...ght of bottom support rail assemblies One pair of lower rear mounting brackets Two heyclips Kit Mounting Hardware 3 8 Square Hole containing Eighteen 10 32 x 0 375 pan head Phillips screws Fourteen caged nut adapters for square holed racks Mark the Rack Allow 7U 12 25 inches of vertical space to install the SFS 7012 switch in the rack Step 1 Determine the location on the rack of the bottom of the ...

Page 24: ...ack by installing two screws into the rail and rack Figure 1 Rail Back Flange Step 3 Fasten the rail front flange chassis fan side to the rack by installing one screw into the top hole of each rail Figure 2 Rail Front Flange Install the second rail on the other side of the rack by repeating steps 1 through 3 Rack Mount the Switch Caution Because of its size and weight it is recommended that either...

Page 25: ...e it onto the rails The fans and power supplies are on the front of the chassis leaf modules are to the rear Caution Never lift the switch with the handles on the spine modules leaf modules power supplies and fan trays These handles are not designed to support the weight of the SFS 7012 Step 4 Tighten the screw on the bottom of each side of the chassis into the corresponding bottom hole of the fro...

Page 26: ...wn in Figure 5 Figure 5 Install the Lower Mounting Bracket and Heyclip Step 7 Install the heyclip to the rail assembly Step 8 If applicable reinstall the chassis fascia s Installing the Switch Face Plate To install the switch face plate s Install 1 screw and caged nut into each hole above and below the handle Install the lower rear mounting bracket to the rail assembly and chassis Install the heyc...

Page 27: ...Modules Note The purchased configuration for the SFS 7012 is shipped fully populated Follow these steps when it becomes necessary to install or replace spine modules and leaf modules Step 1 Remove the necessary spine modules spine module blanks leaf modules and leaf module blanks For detailed instructions please refer to the section Removing a Module or Blank page 1 17 Note If the user is only add...

Page 28: ... 4 Push the handles in to fully close Note Be sure that all cards are fully inserted in their respective chassis slots and that the handles are in the locked position This prevents accidental removal provides proper grounding for the system and helps to seat the bus connectors in the backplane receptacles Connect Equipment to the Ports and Power On the System Note Before performing the tasks in th...

Page 29: ...t connectors If the IB cable connector is not properly oriented to fit onto the port receptacle i e while attempting to insert the cable in the port do not twist the connector to achieve the correct orientation Instead reach back a few feet on the cable and twist the bulk cable to allow the connector to rotate to the proper orientation Doing this prevents all of the rotational forces from acting r...

Page 30: ...n the lower rail assemblies Note Be certain that the power cords are firmly seated into the SFS 7012 AC power inlets Depending upon the purchased configuration refer to Figure 1 9 to determine the correct AC power inlet to use Step 2 If necessary replace the faceplates over the switch fans Step 3 Connect the power cables to an AC power outlet Step 4 When the SFS 7012 switch is plugged into an AC p...

Page 31: ...must be logged in as the administrator At the prompt enter super Step 4 The system prompts for a password At the prompt enter super The system responds with Welcome to the SFS 7012 CLI Type list for the list of commands Step 5 Verify the IP address with the command line interface CLI command showChassisIpAddr command The system returns the information similar to the following Chassis IP Address 19...

Page 32: ...e h ipaddress is the new IP address in dotted decimal i e xxx xxx xxx xxx format and m netMask is the new subnet mask in dotted decimal i e xxx xxx xxx xxx format Step 6 To change the SFS 7012 default gateway IP address enter setDefaultRoute h ipaddress where h ipaddress is the new default gateway IP address in dotted decimal i e xxx xxx xxx xxx format Step 7 To to exit the CLI enter logout Using ...

Page 33: ...e Chassis Viewer GUI Step 1 Power up the switch Step 2 Connect a Category 5 or 6 Cat 5 6 Ethernet cable to the RJ 45 connector on spine 1 Connect the other end of the Cat 5 6 to an OOB LAN Ethernet hub or Ethernet switch where a work station can access the 7012 A work station can be connected directly to the Ethernet port of spine 1 of the 7012 if using a crossover Ethernet cable Power up the swit...

Page 34: ...N IP Window Step 7 Enter the new switch IP address Step 8 Click in the Net Mask field Step 9 Enter the new net mask Step 10 Click Apply The following screen is displayed Figure 14 OOB LAN IP Confirmation Window When the user clicks OK the Chassis Viewer refreshes and uses the new IP address Step 11 To change the switch default gateway from the main menu select OOB LAN IP then Set Default Gateway I...

Page 35: ... address for the following reasons Unique IP addresses are used when sending syslog messages from a managed spine to a syslog server Gives the user the ability to ping each management spine separately If the IP addresses are not unique collisions will occur causing IP operations to fail To update the IP address on a managed spine do the following Step 1 Ensure that the spine module is connected to...

Page 36: ...perTransport bus HyperTransport initialization completed rintf MBOX connect interrupt_source 28 vector 62 status 0 Printf MBOX intEnable status 0 Found Intel Strata Flash 128 MBit 0x8918 Mounted raw file system on device image1 size 6291456 bytes Mounted raw file system on device image2 size 6291456 bytes Mounted raw file system on device dump0 size 1048576 bytes Mounted flash file system on devic...

Page 37: ...ethernet e NEW IP ADDRESS inet on backplane b host inet h 192 168 100 1 gateway inet g user u ftp ftp password pw blank use rsh ftp flags f 0x0 target name tn startup script s other o sbe Loading package from flash device image1 Boot System 7012 Boot Image Information Product SFS7012 BSP t3 Version 4 1 1 1 11 Compressed Image Size 3616523 bytes md5 46086777be1b5bae45140a440425b915 vxWorks Image Ty...

Page 38: ...ght the LED The chassis status LED is Red when the system can no longer function properly and indicates one of the following conditions The system ambient temperature exceeded 60 degrees C No functional fan trays are present No functional spines are present No functional leaves are present The chassis status LED is off when There are no functional power supplies present There are no management car...

Page 39: ...wer failure or no AC power is present SFS 7012 Leaf and Spine Module LEDs Leaf Module IB Port LEDs Each SFS 7024 leaf module port has a Blue IB link status LED that provide the following indications On the logical link is up port is in the Active state Off the physical link is down port is in the Down state Spine and Leaf Module Status LED The status LED indicates one of the following conditions S...

Page 40: ...dicate the master spine Off indicates that the management board is in the standby mode if the STAT LED is Green In a redundantly managed system if the Capable LED is also Green this would indicate the slave spine DDR Green indicates that the switch is capable of running at DDR speeds Off indicates that the switch is not capable of running at DDR speeds i e SDR only Shutdown Procedures In order to ...

Page 41: ...sis the handles will begin to close Step 4 Push the handles in to fully close Hot Swapping the Fan Unit Step 1 Loosen the captive panel screw Step 2 Pull the panel screw down to partially disengage the unit Step 3 Slowly pull the unit The unit will disengage from the connector Step 4 Carefully slide the fan out until it is completely removed from its slot To install a fan unit Step 1 Place the uni...

Page 42: ...1 32 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL 8787 05 Step 8 Tighten the captive panel screw ...

Page 43: ...Chassis Viewer is Cisco s browser based management software The Chassis Viewer provides the primary management interface for the SFS 7012 switch allowing the user to perform management configuration and monitoring tasks related to InfiniBand networks The Chassis Viewer runs on the Chassis Management Unit CMU of the SFS 7012 managed spine modules The browser must be on a workstation which has conne...

Page 44: ...7012 chassis Each SFS 7012 leaf module Each SFS 7012 spine module Logging and monitoring functionality Home Page Figure 2 2 Chassis Viewer Home Page The Chassis Viewer home page provides a high level overview of the SFS 7012 switch and individual leaf and spine modules This area is the starting point to more detailed information for the SFS 7012 chassis and components fans and power supplies leaf ...

Page 45: ...ription Support Button Figure 2 4 Support Button The Support button displays key contact information for support displayed in the following window Figure 2 5 Support Contact Screen Displaying the Leaf and Spine Module Views Leaf Module View To display the leaf module view for the SFS 7012 Step 1 Mouse over the leaf module to display The edges of the leaf module are highlighted green as shown in Fi...

Page 46: ...ule view will be displayed Figure 2 7 Leaf Module View Spine Module View To display the spine module view for the SFS 7012 Step 1 Mouse over the spine module to display The edges of the spine module are highlighted green as shown in Figure 2 8 below Figure 2 8 Spine Module Mouseover Left click the mouse The spine module view will be displayed ...

Page 47: ...s Header allows the user to execute the most common tasks for the SFS 7012 switch Display the Home page View field replaceable unit FRU information Access online help Figure 2 11 Leaf and Spine Details Header Leaf and Spine Information Area The Leaf and Spine Information Area allows the user to view high level information for each specific leaf or spine module The information area contains two dif...

Page 48: ...he information areas Displaying the Chassis View There are two ways to display the chassis view for the SFS 7012 Step 1 Mouse over the outer region of the leaf module view The edges of the chassis are highlighted green as shown in Figure 2 12 below Figure 2 12 Leaf Module Chassis Mouseover Left click the mouse The chassis view will be displayed Step 2 The second way is to mouse over the outer regi...

Page 49: ...a contains three areas Details Header Information area Menu Chassis Details Header The Chassis Details Header allows the user to execute the most common tasks for the SFS 7012 switch Display the Home page View Log Figure 2 15 Chassis Details Header Rebooting Components from Chassis Viewer Step 1 From the Chassis Details header click Reboot A screen similar to the following is displayed ...

Page 50: ...two different fields The white fields allow the user to add or modify applicable general and system information which is specific to their environment The gray fields are tied to live data from the selected hardware component as well as live system information Additionally the Component Information Area has Apply and Refresh buttons which perform the following functionality Apply Saves any user ed...

Page 51: ...displays the overall system information of the SFS 7012 This information includes the following items Out of Band LAN IP The IP address of the switch Netmask The current net mask settings for the chassis System Description A read only textual description of the system IB Node Description Assigned by the administrator the IB node description is an IB fabric applicable name that will be displayed wi...

Page 52: ... Tab The Chassis FRU tab displays switch Field Replaceable Unit FRU information This information includes the following items Type The type of component Description A description of the component assigned by an administrator Alias Name Name of the component assigned by an administrator Serial Num Component serial number Detail A button for each row that displays additional detail about the compone...

Page 53: ... fan information For descriptions of the fields see the Power Tab Backplane Tab The Backplane tab displays switch backplane information For descriptions of the fields see the Power Tab Additionally the user can modify the Description field adding information specific to their network environment Modifying Switch Component Information Following is the procedure for modifying the fields for switch c...

Page 54: ...hassis View Menu Figure 2 20 Chassis View Menu The Chassis View Menu allows the user to execute all configuration and operation tasks available for the SFS 7012 switch Logging The Logging submenu allows the user to set and reset levels for the message log file Figure 2 21 Logging Submenu Set Level Figure 2 22 Set Level Button The Set Level button allows the user to set log level configuration para...

Page 55: ... Syslog tab From this screen the user can change any of the log level settings for a specific software module by clicking on the Configure hyperlink which displays a configuration screen Figure 2 24 Device Tab Software Module Configurator To change any Log Level settings Step 1 Click the On Off checkbox to the right of the setting Step 2 Click the Submit button to save any changes The following li...

Page 56: ...nformational message indicating changes that a user has made to the system configuration The user does not need to take any action INFO Informational messages that occur during a system or component boot The user does not need to take any action PERIODIC An informational message containing periodic statistics The user does not need to take action Debug message levels 1 through 5 Debug messages are...

Page 57: ...syslog host If the Host IP address is 0 0 0 0 no syslog host is configured otherwise log messages are sent to the syslog server at a specified IP address and port To setup the syslog host Step 1 In the Host IP dialog box enter the IP address of the syslog host where the log files are to be saved Step 2 Click the Apply button to save the IP address Configure Syslog on a Linux Server Step 1 Edit the...

Page 58: ...re sent to a syslog server they will appear in the log as being sent from the IP address of the master spine Reset Log Levels The Reset Levels button resets the logging levels to their factory default values Figure 2 27 Reset Levels Button To reset the logging levels Step 1 From the menu select Logging Step 2 Click Logging Step 3 Click Reset Levels The Reset Levels window is displayed Figure 2 28 ...

Page 59: ...utton The Firmware Update button allows the user to select an alternate firmware file for the SFS 7012 These alternate files are reflected in the drop down lists in the Firmware Update screen To download firmware Step 1 From the menu select Maintenance Step 2 Click Firmware Update The Firmware Update screen is displayed Figure 2 31 Firmware Update Screen Step 3 In the Select Target Slot Column sel...

Page 60: ... The LDAP service resides on a server that has access to a user code and password database On a SFS 7012 with LDAP enabled when a user attempts to login to either Chassis Viewer or the CLI the LDAP client intercepts the login attempt and rather than authenticating internally encrypts and packages the information in an LDAP packet and sends it to a pre configured LDAP server over TCP IP i e the out...

Page 61: ...the session timeout duration in seconds click on the existing configuration The row changes to orange Step 4 In the HTTP Timeout Duration field enter the new timeout duration in seconds The default is 0 seconds i e no timeout Note If the user is leaving their workstation for a period of time be sure to close the browser window Step 5 In the CLI Timeout Duration field enter the new timeout duration...

Page 62: ...filter SNMP trap information Figure 2 37 SNMP Submenu Target Configuration The Target Configuration button displays the SNMP Target Configuration Window allowing the user to view and edit existing SNMP trap destinations Figure 2 38 Target MIB Configuration Button To display the Target Configuration window Step 1 From the menu select SNMP Step 2 Select Target Configuration Step 3 The SNMP Target Co...

Page 63: ...or creating new target entries To create a new target entry use the following CLI command snmpTargetAddr add n name a addr p port t timeout r retry_count l tag_list v parameters s storage_type For example To add a trap target with the IP address 192 168 0 123 that accepts SNMP v2c style traps snmpTargetAddr add n traphost1 a 192 168 0 123 v v2 params Or to add the same target except using SNMP v1t...

Page 64: ...t the trap receiver will get link up down traps Parameters Specifies a mapping to an entry in the SNMP Target Parameters table determining the version of SNMP to use Storage Type This field determines whether or not the entry is saved for each reboot of the SFS 7012 Nonvolatile means that the value is saved and remains with each subsequent reboot Volatile or Other indicates it will not be saved St...

Page 65: ...Authentication no privacy AuthNoPriv Authentication no privacy AuthPriv Authentication and privacy Storage Type This field determines whether or not the entry is saved for each reboot of the SFS 7024 Nonvolatile means that the value is saved and remains with each subsequent reboot Volatile or Other indicates it will not be saved Status Indicates the current status of the row The row may be in one ...

Page 66: ...m the menu select SNMP Step 2 Click Filter Status The SNMP Filter Status screen is displayed Figure 2 41 Filter Status Screen Setting Community Strings The Set Community Stings screen allows the user to set two SNMP community names Read Only Community Name Read Write Community Name Figure 2 42 Set Community Strings Button To set the Community Strings ...

Page 67: ...in an SNMP client allows read and write access to SNMP fields exported by the SNMP server Step 3 In each field enter a meaningful name such as public and private shown above and click Apply Configuration File Administration The Configuration File Administration menu allows the user to perform various administrative tasks related to the configuration files for each line card populating the switch F...

Page 68: ...guration file to a line card the system sets the card mode to Disabled This allows the user to verify that the configuration file is correct before returning the card to Auto Backup mode In the Disabled mode use the Backup and Restore buttons to either back up or restore a configuration file Auto Backup All configuration changes to a line card are automatically backed up to the CMU Auto Restore Th...

Page 69: ...ile Upload Download Screen To upload a configuration file from a server to the CMU Step 1 For a selected module click the Upload button The following screen is displayed Figure 2 50 Upload Screen Step 2 Type the path to the desired server location or click Browse to locate the correct path Step 3 Click Submit To download a configuration file from the CMU to a server Step 1 For a selected module cl...

Page 70: ...e desired trap s Note To generate an immediate trap click the applicable Gen Trap button Step 5 To save settings click on Apply Note If the checkbox is not checked the Gen Trap button will not generate a trap Following are definitions for each configuration file trap CfgSrvBackupFailed The server was instructed to backup a file for a particular slot which failed CfgSrvSyncError Synchronization to ...

Page 71: ... not change the defaults unless instructed by Technical Support Chassis Traps The Chassis Trap Control screen allows the user to set default trap scenarios related to SFS 7012 Figure 2 53 Chassis Trap Control Step 1 Click Chassis Step 2 Click Chassis Traps Step 3 Click Trap Control The Chassis Trap Control screen is displayed Figure 2 54 Chassis Trap Control Screen Step 4 Select or deselect the de...

Page 72: ...d into the chassis IcsChassisTrapModuleRemoved This trap indicates that a module was removed from the chassis icsChassisTrapModuleFailed This trap indicates that a module has failed and is not operational icsChassisTrapModuleSelfTestFailure This trap indicates that the module failed one or more of its self test icsChassisTrapModuleEEPROMReadFailure This trap indicates that an error condition was e...

Page 73: ...led This trap indicates that a power supply fan has failed and is not operational Fan Group icsChassisTrapFanNotResponding This trap indicates that a fan is not responding to HEARTBEAT poll requests that are issued by the internal chassis management service icsChassisTrapFanTrayInserted This trap indicates that a fan was inserted into the chassis icsChassisTrapFanTrayRemoved This trap indicates th...

Page 74: ...tistics submenu select IB Port Stats The IB Port Statistics window is displayed Figure 2 56 IB Port Statistics Understanding Port Naming Conventions Following is an explanation of the conventions used in the Port Name column Leaf modules ports L Leaf module number P Leaf module port number Example L10P01 is leaf module 10 port number 1 Interswitch Link ISL Ports S Spine module number L Leaf leaf m...

Page 75: ... serial links that are currently being used on a port The current bandwidth capability of a port is determined by multiplying this value by the Active Link Speed of this port For instance a 4X DDR link has a bandwidth capability of 20Gb s Note Values of 1X are possible in this field with 4X IB cables if poor cable connections or defective 4X IB cables are used Link Width Enabled Link Width Enabled...

Page 76: ...unter does not increment past 255 The Performance Manager may reset and or consolidate the results of this counter Link Downed The number of times the link error recovery process failed The value of the counter does not increment past 65535 The Performance Manager may reset and or consolidate the results of this counter Receive Errors Number of errors received on the port Remote Physical Error Rec...

Page 77: ...nd packet was discarded Leaf and Spine Module IB Port Statistics To access IB port statistics for a specific leaf or spine module perform the following steps Leaf Modules Step 1 Select a leaf module The leaf module view is displayed 1 From the Leaf Port Stats menu select IB Port Stats Figure 2 57 Leaf Port Stats Menu The leaf port statistics window is displayed Figure 2 58 Leaf Port Statistics Win...

Page 78: ...ion on the each IB port statistic field refer to the section Port Statistics Field Descriptions page 2 33 Set Field Thresholds The Set Field Thresholds screen allows the user to set for a specific parameter s an error message threshold for the 12 cable ports on the SFS 7012 Figure 2 61 Set Field Thresholds To change error reporting thresholds do the following Step 1 Click on Port Stats Step 2 Clic...

Page 79: ... will be displayed as red on the home page The following are descriptions for each field in the Set Field Thresholds area Note The thresholds for the following four fields are set as a percentage of maximum that is the percentage of maximum port capacity which depending upon the IB fabric configuration can be 4X 10 Gbps 1X 2 5 Gbps portXmitDataThresh The threshold for the number of 32 bit data wor...

Page 80: ...reshold for the number of remote physical errors received on the port portXmitDiscardThresh The threshold for the number of transmit discards received on the port portPKeyViolInThresh The threshold for the number of times PKey inbound was invalid on the port portPKeyViolOutThresh The threshold for the number of times PKey outbound was invalid on the port portRawViolInThresh The threshold for the n...

Page 81: ...menu click Time Service Step 2 Click Set System Time The System Time Information screen is displayed Figure 2 64 System Time Information Screen To use NTP Step 1 Click the Use Network Time Protocol checkbox Step 2 Enter the IP address for the NTP server Step 3 To save click on Apply Figure 2 65 Time Service NTP Setup To manually set the system time ...

Page 82: ...the Which Day in Month drop downs set the start and end dates for daylight saving time Step 3 To save click on Apply Figure 2 67 Time Service Time Zone Daylight Saving Time Setup Time Zone Tips In the U S the following time zones are in effect Eastern Standard Time GMT 5 Central Standard Time GMT 6 Mountain Standard Time GMT 7 Pacific Standard Time GMT 8 Daylight Saving Time Tips For most of the U...

Page 83: ... address Step 4 Enter the correct net mask Step 5 Click Apply The following screen is displayed Figure 70 OOB LAN IP Confirmation Window When the user clicks OK the Chassis Viewer refreshes and uses the new IP address Configuring the Switch Default Gateway IP Address The Set Default Gateway IP address Window allows the user to configure the IP address for the default gateway to route packets from ...

Page 84: ...ure 2 71 Set Switch Default Gateway IP Address Button Step 2 Click in the Gateway Address field Figure 2 72 Set Default Gateway IP Window Step 3 Type in the correct switch default gateway IP address Step 4 Click Apply Note A reboot is required to activate the new gateway IP address ...

Page 85: ...n on IB port statistics refer to the section SFS 7012 Port Statistics page 2 32 Logging The Logging submenu allows the user to view set levels reset levels and purge the message log file Figure 2 74 Logging Submenu Viewing the Log The View Log button allows the user to view the message log Figure 2 75 View Log Button To view the message log ...

Page 86: ...lowing steps Step 1 From the Messages window select Edit Select All or CTRL A Step 2 Select Edit Copy or CTRL C Step 3 Open a text editing package such as Notepad Step 4 Select Edit Paste or CTRL V Step 5 Save as a plain text txt file Purging the Log The Purge Log button purges the RAM clearing the log file s Figure 2 77 Purge Log Button To purge the log Step 1 From the menu click Logging Step 2 C...

Page 87: ...he user to choose an alternative boot image for the SFS 7012 To select a boot image Figure 2 79 Select Boot Image Button Step 1 From the menu select Maintenance Step 2 Click Select Boot Image The Boot Image Selection screen is displayed Figure 2 80 Boot Image Selection Screen To choose a new boot image Step 1 Click on the radio button of the new boot image Step 2 Click Apply Note The image precede...

Page 88: ...e 2 82 Key Management Window Step 3 To add a new license key click the Add Key button The License Key Management Information window is displayed Figure 2 83 License Key Management Information Window Step 4 Enter the license key information in the New Key text box and click Apply Note The license key number should be part of the paperwork shipped with the product If the feature functionality is pur...

Page 89: ...012 InfiniBand Server Switch Hardware Users Guide OL 8787 05 Step 3 To delete a license key click the Delete button The system prompts with the following Figure 2 85 License Key Delete Prompt Step 4 Click OK to delete ...

Page 90: ...2 48 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL 8787 05 ...

Page 91: ...ir from a pressurized chamber inside a chassis and exhaust to the front of a chassis Temperatures of all major heat producing components are continuously monitored by system management modules Fan speed is monitored and automatically adjusted by system management modules to maintain appropriate temperatures of major heat producing components Monitoring is performed via a two wire I2C interface to ...

Page 92: ...ation 350W max power per supply Input 90 264 VAC 50 60Hz 1 Phase 4 0A max current at 115VAC Inrush Current 15A 115VAC 25 C cold start 30A 230VAC 25 C cold start Power Factor 0 95 Two IEC320 C14 connectors for independent AC inputs Certification Marks UL CSA CE VCCI GS FCC Class B IC Class B ICES 003 Table A 1 SFS 7012 Technical Specifications ...

Page 93: ... For a standalone SFS 7012 the user would Telnet to the unit s IP address es Once connected the CLI works as any telnet session does To access the CLI a login and password is required There are two user modes operator and administrator with the following access privileges Operator Read only access Administrator Read and write Access Reboot access Can change operator and administrator passwords Can...

Page 94: ...formation Network General network commands Firmware Provides commands for updating the firmware via a File Transfer Protocol FTP server or Secure Copy Protocol SCP if using SSH to access the SFS 7012 The SFS 7012 has the ability to store the location of the firmware files for future upgrades Additionally the Firmware functional group includes commands for viewing the current firmware revisions and...

Page 95: ... bootQuery Query boot image information bootSelect Change boot selection Online Help The online help for the CLI provides for each command all necessary information to successfully execute the command For example typing help fwShowUpdateParams displays the following information NAME fwShowUpdateParams SYNOPSIS fwShowUpdateParams DESCRIPTION Display the default update firmware settings OPTIONS None...

Page 96: ... 7012 CLI Type list for the list of commands Groups and Commands The following section lists the CLI s functional groups along with the commands for each group For more specific information for each functional group the user would execute the help GROUP NAME command For more specific command information the user would execute the help COMMAND NAME command General help Displays help information for...

Page 97: ...le to list all the commands that handle log configuration type Log list Displays a list of all valid commands Syntax Options Sample Output NOTES Specify the group name or use all to list all available commands list group noprompt verbose group Displays a list of commands for a particular group noprompt Displays a list of the command groups only verbose Print full help for each command instead of s...

Page 98: ...ory 30 max lines list Deprecated Network Firmware Log IbSwitchInfo TimeManagement Snmp Ethernet help list history reboot now m slot n s n all now Does not prompt the user before rebooting m Reboot Master local Spine 1 non disruptive slot n reset specific device where n slotNumber disruptive s Reboot Slave remote Spine 2 n Reboot Slave remote management card only non disruptive all Reboot All local...

Page 99: ... local device disruptively after prompt See also resetCard showInventory killCliSession Terminates an existing CLI session Syntax Options Sample Output NOTES This command logs out remote sessions Use who to obtain the list of active sessions who Displays all active CLI sessions Syntax Options Sample Output reboot Disruptive reboot selected Proceed with reboot N killCliSession sessionNumber session...

Page 100: ...o the system ip address ip address of the user if applicable broadcast Write a message to all active CLI sessions Syntax Options Sample Output NOTES Writes the supplied message to all other active CLI sessions The message to be written must be encapsulated in quotes and non empty swapBsDel Swaps the backspace and delete character key bindings Syntax Options Sample Output NOTES Terminals may bind t...

Page 101: ...characters getTermWidth Displays the terminal width for text formatting purposes Syntax Options Sample Output NOTES Displays the terminal width used for text formatting purposes Note that not all commands adhere to this setting prompt Set the CLI prompt global for all active CLI sessions Syntax Options Sample Output setTermWidth width width Width of the user s terminal window Minimum width is 20 c...

Page 102: ...n code from the last executed command Syntax Options Sample Output NOTES This allows for automated systems to determine if a command was successful or not rlogin Creates I O terminal to local cards Syntax Options Sample Output NOTES This command allows users to open a terminal to local I O devices within the chassis hemisphere The command rcmd is an alias of rlogin See also hostShow rcmd Creates I...

Page 103: ...rd Reboot a specific slot in the chassis Syntax Options Sample Output NOTES If you reset the switch you are connected to you will have to reconnect You can find out the valid slots for this device with the showInventory command logout Logout of the current CLI session Syntax Options Sample Output user Change user accounts Syntax rcmd resetCard n now n Chassis slot number now No prompt before reset...

Page 104: ...ntax Options user Name of user account to change to user operator User changed to operator passwd username username Name of the user whose password needs to be changed passwd operator1 User password changed successfully userAdd role username password role Can be either admin or operator username The name of the user to be added This name must be at least 4 characters in length password Optional pa...

Page 105: ... longer receive this prompt upon logging in NOTES The password entered can be the same as the current password userRem Remove a user account Syntax Options Sample Output userListShow List all user accounts for this device Syntax userAdd admin testuser testpass User added testuser Please change your passwords now Use Control C to exit or press Enter key to proceed changing password for user testuse...

Page 106: ... LDAP Server IP Address Syntax Options Sample Output NOTES This sets the LDAP server ip address The LDAP server will be contacted for remote authentication None userListShow username role operator1 operator USERID admin Bob admin loginMode mode mode 0 3 0 Username password required 1 username required 2 no authentication 3 LDAP authentication loginMode 1 Mode successfully changed to 1 Password is ...

Page 107: ...s Syntax Options Sample Output idleTimeoutSet Set idle timeout settings Syntax Options setldapSvrPort port port The Port of the ldap server you wish to set to authenticate setldapSvrPort 1 idleTimeoutGet None idleTimeoutGet CLI timeout is 600 seconds GUI timeout is 0 seconds idleTimeoutSet all cli gui seconds all Set the idle timeout for both the CLI and the GUI to the same value cli Set the idle ...

Page 108: ... idle timeout for the current CLI session Syntax Options Sample Output sessionTimeoutEnable Enable the idle timeout for this CLI session Syntax Options Sample Output loginMsgGet Displays the CLI login message for this device Syntax Options idleTimeoutSet 700 CLI timeout is set to 700 seconds sessionTimeoutDisable None sessionTimeoutDisable Disabled session idle timeout sessionTimeoutEnable None se...

Page 109: ...ginNameGet Display the name of the device displayed when logged into via telnet Syntax Options Sample Output NOTE The login name is an arbitrary string displayed prior to a user attempting a login to a new CLI session This command displays the current value of this string loginNameSet Sets the name of the device displayed when logged into via telnet loginMsgGet Welcome message Be certain to logout...

Page 110: ...t Displays the current serial authentication status Syntax Options Sample Output NOTES Displays whether user login and authentication is required on the serial console of the system serialAuthSet Enable or disable authentication on the systems serial console Syntax Options Sample Output loginNameSet text string None loginNameSet serialAuthGet None serialAuthGet serialAuthSet enable enable Boolean ...

Page 111: ... authentication exit Exit the CLI Syntax Options Sample Output Deprecated smDisplayLids use smShowLids smGetPriority use smShowPriority smDumpGroups use smShowGroups smDumpServices use smShowServices smDumpSubscriptions use smShowSubscriptions smDisplayMasterLMC use smShowMasterLMC smDisplaySmMasterLid use smShowMasterLid smDumpLidMap use smShowLidMap smDisplayMaxLid use smShowMaxLid smDisplaySMPa...

Page 112: ...an Speed 5m 1 RPM 0m PS2 Fan Speed 5m 1 RPM 0m PS3 Fan Speed 5m 1 RPM 0m PS4 Fan Speed 9642 RPM 0m PS5 Fan Speed 9642 RPM 0m PS6 Fan Speed 9507 RPM 0m FT1 Fan Speeds 8940 RPM 0m 8820 RPM 0m FT2 Fan Speeds 9120 RPM 0m 8880 RPM 0m FT3 Fan Speeds 9060 RPM 0m 8700 RPM 0m FT4 Fan Speeds 8640 RPM 0m 8760 RPM 0m Device T1 T2 A1 A2 1 2V 1 6V 1 8V Spine 1 34C 38C 26C 30C 1 226 1 489 1 773 Spine 2 41C 39C 2...

Page 113: ...ing None setIBNodeDesc Upper Hemisphere in Rack 1 fruInfo slot all slot Slot that you wish to display EEProm contents Defaults to 0 chassis EEProm NOTE The all parameter performs this command against all available slots for this device fruInfo Display chassis info xInfo_ChassisInfo RecType 1LastRec 0LenMult 0 ReadOnly 1RecordFormat 2RecLen 14 LogicalLen 020 HdrChkSum c6 ChassisGuid 00066a000300012...

Page 114: ...rameters will display all currently occupied card slots chassisQuery slot showType type card_type ignoreInvalidType slot slot number showType display the card type type card_type display slots that have given card type ignoreInvalidType do not return an error if an invalid card type is supplied NOTE Entering this command with no parameters will display all currently occupied card slots chassisQuer...

Page 115: ...02 NAME Chassis DESCR 144 Port IB Server Switch PID 74 4314 02 VID V02 SN SST06390001 NAME Power Supply 1 DESCR SFS 7012 7024 Power Supply PID 74 4321 01 VID N A SN N A NAME Power Supply 2 DESCR SFS 7012 7024 Power Supply PID 74 4321 01 VID N A SN N A NAME Fan Tray 1 DESCR SFS 7012 7024 Fan Tray PID 74 4323 01 VID N A SN N A NAME Fan Tray 2 DESCR SFS 7012 7024 Fan Tray PID 74 4323 01 VID N A SN N ...

Page 116: ...ackets sent 0 multicast packets received 0 multicast packets sent 0 input discards 1313 input unknown protocols 0 input errors 0 output errors lo0 unit number 0 Flags 0x8069 UP LOOPBACK MULTICAST ARP RUNNING Type SOFTWARE_LOOPBACK Internet address 127 0 0 1 Netmask 0xff000000 Subnetmask 0xff000000 Net 0x7f000000 Subnet 0x7f000000 Metric is 0 Maximum Transfer Unit size is 32768 sbe1 unit number 1 F...

Page 117: ...utput ping Send ping packets to a specified host Syntax Options routeShow None routeShow ROUTE NET TABLE destination gateway flags Refcnt Use Interface 0 0 0 0 172 26 0 254 3 2 1470 mgmt_eth1 172 26 0 0 172 26 0 221 101 0 0 mgmt_eth1 ROUTE HOST TABLE destination gateway flags Refcnt Use Interface 127 0 0 1 127 0 0 1 5 2 593 lo0 ping ipAddress packetCount IpAddress The IP address of the network hos...

Page 118: ...x Options Sample Output PING 172 26 0 254 56 data bytes 64 bytes from 172 26 0 254 icmp_seq 0 time 0 ms 64 bytes from 172 26 0 254 icmp_seq 1 time 0 ms 64 bytes from 172 26 0 254 icmp_seq 2 time 0 ms 64 bytes from 172 26 0 254 icmp_seq 3 time 0 ms 64 bytes from 172 26 0 254 icmp_seq 4 time 0 ms 172 26 0 254 PING Statistics 5 packets transmitted 5 packets received 0 packet loss round trip ms min av...

Page 119: ...packets from the OOB mangement port to an external network setDefaultRoute Change the default gateway IP address Syntax Options Sample Output NOTES This allows the user to configure the IP address for the default gateway to route packets from the OOB management port to an external network arpShow Displays the contents of the ARP table Syntax Options showDefaultRoute None showDefaultRoute Gateway I...

Page 120: ...how hostname inet address aliases localhost 127 0 0 1 home 10 90 90 0 slot1 127 1 0 1 slot2 127 1 0 2 slot3 127 1 0 3 slot4 127 1 0 4 slot5 127 1 0 5 slot6 127 1 0 6 slot7 127 1 0 7 slot8 127 1 0 8 slot9 127 1 0 9 slot10 127 1 0 10 slot11 127 1 0 11 slot12 127 1 0 12 slot13 127 1 0 13 slot14 127 1 0 14 slot15 127 1 0 15 slot16 127 1 0 16 slot17 127 1 0 17 slot18 127 1 0 18 slot19 127 1 0 19 slot20...

Page 121: ... all cards in a chassis of a particular type or everything Syntax fwUpdateSlot slotnumber host user password dir filename slotnumber The chassis slot numberto update host The name of the host where the firmware file resides user The FTP user name password The FTP user password dir After logging in the directory to cd to filename The name of the firmware file fwUpdateSlot 1 Enter 1 for FTP 2 for lo...

Page 122: ...faults for future firmware updates fwListFiles Note This command is not currently supported Lists the contents of the firmware directory Syntax Options Sample Output NOTES The firmware directory temporarily stores firmware files before they are written to flash fwShowUpdateParams Display the default update firmware settings Syntax Options all management Type of card to update See notes for details...

Page 123: ...ntax Options Sample Output showLastScpRetCode Display the return code from the last SCP Firmware Push Syntax fwSetUpdateParams c cardtype h hostname u username p password d directory f filename c cardtype Choices are manangement vfx vex ibx h hostname The host name or IP address of the FTP server u username The name of the user accessing the ftp server p password The password of the user accessing...

Page 124: ...mage version information Syntax slot The slot number in the chassis all All slots in the chassis showLastScpRetCode 101 SCP Slot 101 Last Exit Code 0 Success fwVersion slot slot Slot number fwVersion Slot 105 Information Firmware Version 4 1 1 1 11 Firmware build 4_1_1_1_11 Firmware BSP t3 MBC Version None Bootrom Version 4 1 1 1 11 Slot 106 Information Firmware Version 4 1 1 1 11 Firmware build 4...

Page 125: ... versions for the primary and alternate firmware images bootQuery 105 all Primary firmware version 4 1 1 1 11 Alternate firmware version 3 4 0 11 3 Active firmware version 4 1 1 1 11 bootSelect slot i index alternate version version noprompt slot The slot number using the next boot image i index The index of the boot image to be used next alternate Chooses the alternate image to be used next versi...

Page 126: ...rently supported smControl Starts and stops the embedded subnet manager Syntax Options Sample Output smConfig Configure startup parameters of the embedded subnet manager bootSelect 105 noprompt Currently installed firmware versions index alias version 1 image1 4 1 1 1 11 2 image2 3 4 0 11 3 indicates Default image will run at next reboot indicates Active image Default boot image index 1 smControl ...

Page 127: ...e 1 Ch Node 0 00066a000600013c 2 ports 24 path Port GUID S LID LMC _VL_ __MTU__ _WIDTH_ ____SPEED____ CAP_MASK N P 0 00066a000600013c 4 LID 0001 LMC 0000 8 8 2k 2k 4X 4X 2 5 2 5 00000a4a 0 0 4 0000000000000000 4 8 8 2k 2k 4X 4X 2 5 5 5 0 00000000 1 22 4 22 5 0000000000000000 4 8 8 2k 2k 4X 4X 2 5 5 5 0 00000000 1 23 4 23 6 0000000000000000 4 8 8 2k 2k 4X 4X 2 5 5 5 0 00000000 1 24 4 24 7 000000000...

Page 128: ...B 36 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL 8787 05 NOTES Use this command to display the current LID assignments for the devices in the InfiniBand fabric ...

Page 129: ... priority of the embedded subnet manager Syntax Options Sample Output NOTES Use this command to set the priority of the subnet manager Valid values are 0 15 smSetSweepRate Set the sweep rate of the embedded subnet manager Syntax Options Sample Output smShowPriority None smShowPriority The SM Priority is 0 smSetPriority None smSetPriority 0 The SM Priority has been set to 0 smSetSweepRate None smSe...

Page 130: ...to set the sweep rate in seconds of the baseboard manager Valid values are 30 86400 or 0 to turn the sweep off smForceSweep Force a fabric sweep by the embedded subnet manager Syntax Options Sample Output NOTES Use this command to force a sweep by the subnet manager bmForceSweep Force a fabric sweep by the embedded baseboard manager Syntax Options Sample Output bmSetSweepRate sweepRate sweepRate V...

Page 131: ... the host name as part of the output smShowGroups Multicast Groups join state key F Full N Non S SendOnly Member 0xff12601bffff0000 00000001ffffd5bb c001 qKey 0x00000000 pKey 0xFFFF mtu 4 rate 3 life 19 sl 0 0x0011750000ffd5bb F 0xff12401bffff0000 00000000ffffffff c000 qKey 0x00000000 pKey 0xFFFF mtu 4 rate 3 life 19 sl 0 0x00066a01a0007116 F 0x0002c902003fffd5 F 0x00066a00a00001ac F 0x00066a01a00...

Page 132: ...e in the embedded subnet manager Syntax Options smShowServices There is 1 Service Records Service ID 0x1100D03C34834444 Service GID 0xFE80000000000000 00066A000600013C Service P_Key 0x0000 Service Lease infinite Service Key 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 Service Name Service Rev 1 1 Service Data 8 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x...

Page 133: ...ber Inform Info GID 0x0000000000000000 0000000000000000 Start LID 0xFFFF End LID 0x0000 Is Generic Yes Subscribe Subscribe Type All Types Trap Number 0x0040 Queue Pair Number 0x000001 Response Time Value 19 Producer Type Subnet Management Subscriber GID 0xFE80000000000000 00066A01A0007116 Subscriber LID 0x0007 Subscriber PKey 0xFFFF Subscriber Start LID 0x0001 Subscriber End LID 0xBFFF Subscriber ...

Page 134: ...o set the SM s LMC value to be used on CA ports The default is zero smShowMasterLid Display the LID of the subnet manager Syntax Options Sample Output NOTE Use this command to display the SM s LID It may be the local LID if the SM is the master smShowLidMap Display the LID to port GUID map for the subnet manager Syntax Options smShowMasterLMC Master SM LMC 0 1 LID s per port smSetMasterLMC None sm...

Page 135: ...fault switch lifetime in the subnet manager smSetHoqLife Set the head of queue lifetime for the subnet manager Syntax smShowLidMap SM is currently in the MASTER state with Topology Pass count 341 Lid 0x0001 guid 0x00066a000600013c pass 341 SFS 7024 GUID 0x00066a00da000100 172 26 2 2 Spine 1 Ch Lid 0x0002 guid 0x00066a0007000170 pass 341 SFS 7024 GUID 0x00066a00da000100 172 26 2 2 Leaf 4 Chi Lid 0x...

Page 136: ...et manager Syntax Options Sample Output NOTES Use this command to set the VL stall value in the subnet manager smShowSMParms Display subnet manager parameters switch lifetime HOQ lifetime VLStall val pkt lifetime and dynamic PLT Syntax Options hoq lifetime smSetHoqLife 11 The SM Head of Queue Lifetime has been set to 11 smSetVLStall vl stall vl stall smSetVLStall 7 The SM VL Stall value has been s...

Page 137: ...in the PKey table of the subnet manager Syntax Options smShowSMParms SM priority is set to 0 SM LMC is set to 0 SM sweep rate is set to 300 SM max retries on receive set to 3 SM max receive wait interval set to 250 millisecs switchLifetime set to 13 HoqLife set to 11 VL Stall set to 7 packetLifetime constant is set to 18 Dynamic PLT ON using values 1 hop 16 2 hops 17 3 hops 17 4 hops 18 5 hops 18 ...

Page 138: ...his command to set the SM key The subnet manager must be offline and key value is up to 8 byte hex smShowKey Display SMInfo key of the Subnet manager Syntax Options Sample Output NOTES The SMInfo Key smkey is used to authenticate multiple SM s and authorize priviledged SA operations smSetMKey Set the subnet manager management key portInfo value Syntax Options smShowPKeys Index 0 PKey 0xffff Desc D...

Page 139: ...t Key is used to authorize priviledged subnet operations such as inititializion aliases and configuration smOptionConfig Use this command to configure support for non default modes of operation Syntax Options Sample Output NOTES Use of these options without explicit direction may cause the fabric to be inoperable sm SetMKey SM MKey 0x0 smShowMKey None sm ShowMKey SM MKey 0x0 smOptionConfig clear r...

Page 140: ...6 20GB 7 40GB 8 60GB 9 80GB 10 120GB Valid Values for SL is 0 only value supported at this time DO NOT CREATE THIS GROUP WITH PARAMETERS THAT YOUR FABRIC CANNOT SUPPORT smShowDefBcGroup Display the default broadcast group configuration Syntax Options Sample Output smSetDefBcGroup clear pKey mtu rate sl qKey clear Clear the configuration pKey Partition Key 0 defaults to use the default PKey at inde...

Page 141: ... Prefix value is 8 byte hex smShowGidPrefix Display Subnet manager s Subnet Prefix Syntax Options Sample Output NOTES The Subnet manager s assigned Subnet Prefix default 0xfe80000000000000 smSetSubnetSize Set the Subnet manager s subnet size Syntax Options Sample Output smSetGidPrefix Gid Prefix None smSetGidPrefix Gid Prefix smShowGidPrefix None smShowGidPrefix smSetSubnetSize subnetSize subnetSi...

Page 142: ...r limit of HCA ports on the subnet Setting this value will not take effect until the Subnet Manager is restarted smShowSubnetSize Display the size of the subnet Syntax Options Sample Output NOTES This value is used to tune the SM to handle the configured fabric size expressed in terms of HCA ports Log logShow Displays the log file Syntax Options smShowSubnetSize None smShowSubnetSize logShow None ...

Page 143: ...Target Device 3 d94 p3 NPort Id 0x0106d3 Connection Restored W 2006 10 04 20 26 31 246U Thread Log 0x8fdab3b0 Log Unable to Send Trap 523 Bad 65535 W 2006 10 04 20 26 31 256U Thread CPU1 0x1 Fcpi Target Device 6 ac6 p6 NPort Id 0x0106d6 Connection Restored W 2006 10 04 20 26 31 276U Thread Log 0x8fdab3b0 Log Unable to Send Trap 523 Bad 65535 W 2006 10 04 20 26 31 326U Thread Log 0x8fdab3b0 Log Una...

Page 144: ... logConfigure Type Q or X to exit Please enter the number corresponding to what you want to configure index name description 1 Device Logging device IE Ram syslog etc 2 Preset General log filter Select 1 Configurable devices index name D F E A W P C I P 1 2 3 4 5 1 Ram X X X X X X X X X 2 BriefRam 3 Console X X X X X X X X X 4 Trap X X X X X X 5 Syslog X X X X X X X X X Type Q or X to exit Enter t...

Page 145: ...n the messages Additional configuration may be necessary to fully configure the log system logShowConfig Display the current log configuration settings Syntax Options logResetToDefaults Log configuration has been reset logSyslogConfig h xxx xxx xxx xxx p xxxx f xx h ip_address Sets the host IP address in dotted decimal format xxx xxx xxx xxx p port The host port number on which the syslog server i...

Page 146: ... X X X 2 BriefRam 3 Console X X X X X X X X X 4 Trap X X X X X X 5 Syslog X X X X X X X X X Configurable presets index name state 1 Dump Enabled 2 Fatal Enabled 3 Error Enabled 4 Alarm Enabled 5 Warning Enabled 6 Partial Enabled 7 Config Disabled 8 Info Disabled 9 Periodic Disabled 10 Debug1 Disabled 11 Debug2 Disabled 12 Debug3 Disabled 13 Debug4 Disabled 14 Debug5 Disabled showKeys None showKeys...

Page 147: ...r At the prompt enter the number of the key you wish to remove IbSwitchInfo Note The following commands require a reboot of the affected chassis component This reboot will be disruptive and will cause the affected switch chips to be reset and have a part of their EEPROM to be reloaded ismPortSet12x ismChassisSetSpeed ismPortEnable addKey key key The license key to add addKey XXxxx YYYYY ZZZZZ 1111...

Page 148: ...ude errors dropped packets discarded packets and invalid packets Syntax Options ismPortStats clear noprompt cols X port X leaf X spine X clear Clears the statistics Statistics are displayed first then cleared noprompt Does not give the user a Continue prompt for each page of display cols X Sets the number of columns to be displayed per line port X Specifies a port s to display leaf X Displays all ...

Page 149: ... inbound invalid OutPKeyViol Number of times PKey outbound invalid InRawViol Number of times raw inbound packet discarded OutRawViol Number of times raw outbound packet was discarded LLIntegrity Number of local link integrity errors ExcesBufOvr Number of excessive buffer overrun errors The options leaf and spine are only available on platforms with removable leaf and spine modules ismPortCounters ...

Page 150: ...For the SFS 7012 the counters for the cable ports as well as the ports for each line card are shown For switches with more than 24 ports the user is prompted to continue the output after each group of 24 ports are displayed This command is best displayed with a terminal width of at least 120 columns ismLinearFwdb Displays the entries in the linear forwarding table LIDs and a cooresponding port are...

Page 151: ...clear the InfiniBand port statistic counters that have reached their maximum ismLinearFwdb switch switch switch number ismLinearFwdb Switch Leaf 3 Linear Fwdb LID Port 0001 19 L03S1Aa 0002 0 0003 12 L03P12 0004 13 L03S1Ba Switch Spine 1 A Linear Fwdb LID Port 0001 0 0002 9 S1AL03a 0003 9 S1AL03a 0004 11 S1AL03b ismMultiFwdb switch switch Switch identifier ismMultiFwdb Switch Leaf 3 Multicast Fwdb ...

Page 152: ... user to view set and unset port link width to 12X for specific port s Syntax Options Sample Output ismAutoClearConf disable enable warn log_first enable Enable the auto clear feature disable Disable the auto clear feature warn Generate warning log messages instead of the default information messages log_first Log first clear otherwise the first clear is not logged ismAutoClearConf enable Auto cle...

Page 153: ...porting 12X link aggregation This command will enable 12X link aggregation so that internal and external switching will be 12x Each 12X port is 3 aggregated 4x ports i e a TRIO where one will be reported as a 12x port and the other two ports are reported as disabled Each of the three aggregated 4x ports must be connected to another enabled 12X TRIO to establish a 12X link Using this command withou...

Page 154: ...e chassis is required to activate changes made with this command Note This command requires a reboot of the affected chassis component This reboot will be disruptive and will cause the affected switch chips to be reset and have a part of their EEPROM to be reloaded ismPortEnable Allows the user to enable or disable a port Syntax Options Sample Output ismChassisSetSpeed speed speed 1 2 5 2 5 0 or 3...

Page 155: ...able is set to 1 all ports in the hemisphere will be enabled If enable is set to 0 all leaf cable ports will be disabled Syntax Options Sample Output Note Using this command without the enable option displays current value of the port s A reboot is required to activate changes made with this command This reboot will be disruptive and will cause the affected switch chips to be reset and have a part...

Page 156: ...nsitive If it contains spaces it must be bounded by quotes e g ismPortSetSpeed Cable 1 Using this command with only the port option displays its current values A reboot is required to activate changes made with this command This reboot will be disruptive and will cause the affected switch chips to be reset and have a part of their EEPROM to be reloaded ismIslSet12x Allows the user to view set and ...

Page 157: ...changes made with ismChassisSetMtu This command will set maximum packet mtu size for both Internal AND External switching Calling this function without an mtu designator will display the ports current value A reboot is required to activate changes made with this command This reboot will be disruptive and will cause the affected switch chips to be reset and have a part of their EEPROM to be reloade...

Page 158: ...ta 32 bit data words transmitted 2 portRecvData 32 bit data words received 3 portXmitPkts data packets transmitted 4 portRecvPkts data packets received 6 portSymbolErr a 8B10B encoding violation or a displarity violation was detected 7 portLinkErrRecv link error recovery process happened successfully ismShowPStatThresh None ismShowPStatThresh Field Threshold Time Unit 1 portXmitData 0 Percent of M...

Page 159: ...integrity errors 18 portExcBufferOverrun excessive buffer overrun errors 19 portRelayedVL15Dropped remote VL15 packet was dropped 20 portLocalVL15Dropped local VL15 packet was dropped 21 portNonSMPDropped non SMP packet was dropped ismSetPStatThresh Modifies the port statistic thresholds Syntax Options Sample Output Note The available thresholds are portXmitData portRecvData portXmitPkts portRecvP...

Page 160: ...r Switch Hardware Users Guide OL 8787 05 portRecvRemPhysErr portXmitDiscard portPKeyViolIn portPKeyViolOut portRawViolIn portRawViolOut portLocalLinkInteg portExcBufferOverrun portRelayedVL15Dropped portLocalVL15Dropped portNonSMPDropped ...

Page 161: ... system time will be printed out timeZoneConf Display configure the time zone setting Syntax Options Sample Output time S ipaddr T hhmmss mmddyyyy S ipaddr Sets the NTP Server IP address T hhmmss mmddyyyy Set the local clock time hour minutes and seconds along with the month day and year time S 172 26 0 254 Configured the NTP server ip address successfully 13 53 02 10 06 2006 Configured to use NTP...

Page 162: ...1 1 4 4 1 10 timeNtpTimeout Display or set the number of seconds to wait for a NTP response Syntax timeDSTConf sw sd sm ew ed em sw Start which valid values 1 1st 2 2nd 3 3rd 4 4th 5 5th sd Start day valid values 1 Sunday 2 Monday 3 Tuesday 4 Wednesday 5 Thursday 6 Friday 7 Saturday sm Start month valid values 3 March 4 April 5 May 6 June 7 July 8 August 9 September 10 October 11 November ew End w...

Page 163: ...lay between syncing the clock via NTP Syntax Options Sample Output Note With no arguments this command displays the current NTP refresh time which is the delay in seconds between attempts to sync the clock via NTP This value can be configured by using this same command with the new refresh time in whole seconds as the only argument The NTP refresh time is not used on linecards or slave CMUs numSec...

Page 164: ...ring is displayed If options are entered then the corresponding community string is changed snmpTargetAddr Displays and allows the changing of the snmpTargetAddrTable entries Syntax snmpCommunityConf r readonly_comm_str w read_write_comm_str r A read only community string w A read write community string snmpCommunityConf r public Read Only Community String Was Set To public snmpTargetAddr show del...

Page 165: ...t machine IP address in dotted decimal form p Port The target port to send traps and information t Timeout The time to wait for an information response r Retry count The number of re send attempts for information l Tag list Indicates the traps and information that is sent v Parameters This maps to an entry in the snmpTargetAddrTable s Storage type Determines whether the entry is saved in flash mem...

Page 166: ...plays the contents of the snmpTargetParamsTable snmpTargetParams rfc2573t snmpTargetParamsMPModel v1 params 0 rfc2573t snmpTargetParamsMPModel v2 params 1 rfc2573t snmpTargetParamsMPModel v3 params 3 rfc2573t snmpTargetParamsSecurityModel v1 params 1 rfc2573t snmpTargetParamsSecurityModel v2 params 2 rfc2573t snmpTargetParamsSecurityModel v3 params 3 snmpNotifyProfile show show Displays the conten...

Page 167: ...fyTable see SNMP NOTIFICATION MIB RFC 2573 snmpNotifyFilter show show Displays the contents of the snmpNotifyFilterTable snmpNotifyFilter rfc2573n snmpNotifyFilterMask v1 params 0 rfc2573n snmpNotifyFilterMask v2 params 0 rfc2573n snmpNotifyFilterMask v3 params 0 rfc2573n snmpNotifyFilterType v1 params 1 rfc2573n snmpNotifyFilterType v2 params 1 rfc2573n snmpNotifyFilterType v3 params 1 snmpNotify...

Page 168: ...ysLocation c sysContact show show the contents of the snmpTargetAddrTable edit modify an existing row in the snmpTargetAddrTable n sysName c sysContact l sysLocation snmpSystem show rfc1907 sysDescr 7024 rfc1907 sysObjectID 1 3 6 1 4 1 10222 7 2 2 rfc1907 sysUpTime 0 Day s 0 Hour s 28 Minute s 28 Second s rfc1907 sysContact 2D 2D 45 6D 70 74 79 3B 20 4E 6F 20 56 61 6C 75 65 20 53 65 74 2D 2D rfc19...

Page 169: ...ay information for this device Syntax Options add add an entry to the V3 user table show show entries in the V3 user table edit modify an entry in the V3 user table delete remove an entry in the V3 user table a authentication algorithm and key Options MD5 SHA NONE Passphrase is required unless NONE is specified snmpUsrSec User initialmd5 Auth MD5 Auth Key 0x047b473f93211a17813ce5fff290066b Priv NO...

Page 170: ...This command is intended for support personnel captureLog Display log information for this device Syntax Options Note This command is intended for support personnel captureSm Display Subnet Management information for this device Syntax Options Note This command is intended for support personnel captureIsm Display Infiniband switch information for this device captureFw None captureLog None captureS...

Page 171: ...is information for this device Syntax Options Note This command is intended for support personnel captureNetwork Display chassis information for this device Syntax Options Note This command is intended for support personnel captureMisc Display miscellaneous information for this device Syntax Options captureIsm None captureChassis None captureNetwork None captureMisc None ...

Page 172: ... for support personnel captureSnmp Display SNMP information for this device Syntax Options Note This command is intended for support personnel captureShell Display shell command information for this device Syntax Options Note This command is intended for support personnel captureSnmp None captureShell None ...

Page 173: ...ion Hardware Checks page C 1 Troubleshooting Scenarios page C 3 Hardware Checks Switch Power Supply Problem Fix The Switch has no power Ensure that the power cord s is attached to the Switch and the power outlet Ensure that the power supply s is seated properly Problem Fix DC OK LED is off Indicates DC power failure or no DC power is present AC OK LED is off Indicates AC power failure or no AC pow...

Page 174: ... problem would occur if there is a RJ45 cable that has poor shielding or contact of pins Ensure that the cable is a straight through Cat 5 cable not a crossover cable If using a straight through cable and still experiencing this problem Test with a known good cable Absence of Ethernet link and or intermittent Ethernet connectivity Ensure that the Ethernet cable is Cat 5E or Cat 6 certified Problem...

Page 175: ...toms Cannot access the Chassis Viewer browser window The browser window times out and Chassis Viewer will not come up Resolution Workaround 1 Invalid IP Address entered for the chassis or spine modules via the console port Use the showChassisIpAddr command to be sure the address has been set correctly 2 If attempting to access the switch from a remote LAN ensure that the default gateway default ro...

Page 176: ...C 4 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL 8787 05 ...

Search results

Summary of Contents for SFS 7012

Reviews:

Related manuals for SFS 7012

Brands by name

Popular brands

Cisco SFS 7012, Hardware User'S Manual

Search results

Summary of Contents for SFS 7012

Reviews:

Related manuals for SFS 7012

Brands by name

Popular brands