manualshive.com logo in svg

Cisco TOPSPIN SFS 3012, Hardware Manual

Share
Download
Cisco TOPSPIN SFS 3012 Hardware Manual Download Page 29

11

Install InfiniBand Switch Cards

To install a switch card, perform the following steps:
1. Ground yourself appropriately.
2. Remove the blanking panel if one resides in the slot with a #1 Phillips-head screwdriver.
3. Remove the switch card from any packaging.
4. Extend the ejector levers on the left- and right-hand sides of the switch card completely.
5. Insert the switch card into slot 15 or slot 16 such that the ejector levers sit on the bottom of the 

switch card.

6. Press the switch card firmly into the slot so the fasteners begin to close.

Figure 2-7: 

Inserting a Switch Card

Summary of Contents for TOPSPIN SFS 3012

Page 1: ...Part Number OL 7722 01 Cisco SFS 3012 Multifabric Server Switch Hardware Guide Topspin 360 Hardware Guide Web Release v2 1 0 Product ID 140262 ...

Page 2: ...hereof by or for the U S Government shall be governed solely by the terms of the license agreement and shall be prohibited except to the extent expressly permitted by the terms of that agreement Any technical data provided that is not covered by the above provisions shall be deemed technical data commercial items pursuant to DFAR section 227 7015 a or equivalent Any use modification reproduction r...

Page 3: ...er Cautions ix Contact Information x 1 Product Registration xi THANK YOU FOR PURCHASING YOUR TOPSPIN PRODUCT xi 2 Standard Product Agreement xiii 3 Topspin 360 Overview 1 Introduction 1 Features 2 Performance 2 Unified Fabric 2 Transparent Topology 2 Redundancy and High Availability 3 Scalability 3 4 Topspin 360 Components 5 ...

Page 4: ...opspin 360 Components 20 Rack the Topspin 360 20 Attach a Serial Console Cable to a PC or Terminal 26 Boot your Topspin 360 and Configure Basic Connectivity 27 Assign a Static IP Address 27 Obtain an IP Address with DHCP 28 Connect InfiniBand Hosts 29 Manage the Topspin 360 32 Viewing and Updating the Software Image on the Chassis 33 View the Software Image Version with the CLI 33 View the Softwar...

Page 5: ...duction 49 Topspin 360 System LED 50 Power Supply LEDs 51 Blower Tray LEDs 52 Controller Card LEDs 53 IB Switch Card LEDs 54 IB Port LEDs 54 Fibre Channel Gateway LEDs 55 FC Port LEDs 55 Ethernet Gateway LEDs 56 Ethernet Port LEDs 56 8 Specifications and Compliance 57 General Specifications 57 Electrical Specifications 58 Certifications Regulatory 58 Laser Specs 58 ...

Page 6: ...vi ...

Page 7: ... to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at his own expense Safety Information Electrical Cautions on page vii General Cautions on page ix Laser Cautions on page ix Electrical Cautions CAUTION Use only the power cable provided with your Topspin 360 Inspect t...

Page 8: ...aight into the jack If the chassis comes equipped with a power plug retainer move the bail wire back into place to keep the power plug firmly in place CAUTION The Topspin 360 contains lithium batteries Do not attempt to replace or discard these batteries The batteries may only be serviced by Topspin service personnel CAUTION Observe and follow service markings Do not service the Topspin 360 except...

Page 9: ...ceable components Removing the enclosure cover voids your warranty See the warranty card for further details regarding the servicing of your chassis CAUTION Opening and or modifying expansion and system modules may void your warranty Refer to your warranty to determine access restrictions In general Do not spill food or liquids on your Topspin 360 components Protect your Topspin 360 from sudden po...

Page 10: ...tion Optical Parameters 48 00001 01 Fibre Channel CDRH IEC Laser Class 1 1 Maximum Data Rate 2 125 GB s Wavelength 850nm I O connector Standards used CDRH 21CFR Chapter I 1040 10 IEC IEC60825 1 1994 Table iii 2 Customer Contact Information Address Topspin Communications Inc 515 Ellis St Mountain View CA 94043 Telephone Corporate Headquarters 866 TOPSPIN or 650 316 3300 Fax 650 316 3269 Telephone T...

Page 11: ...ration Benefits Customers must register on line to receive the following benefits Software updates and downloads Product warranty support Customer service and support Product documentation Registration Instructions Please immediately follow the instructions below to register yourself as a Topspin user 1 Go to http support topspin com 2 Click the Register Now link below the customer login prompt 3 ...

Page 12: ...xii Phone 800 499 1473 Online Help Desk http support topspin com ...

Page 13: ...opspin Communications Inc Topspin to object to any additional or different provisions proposed by Customer shall not constitute a waiver of these terms and conditions nor constitute acceptance of any such Customer s terms and conditions All orders or contracts must be approved and accepted by Topspin at its home office at 515 Ellis Street Mountain View CA 94043 This Agreement shall be applicable w...

Page 14: ...tion of the Software iii reverse engineer reverse assemble or otherwise attempt to gain access to the source code of all or any portion of the Products iv use the Software for third party training commercial time sharing or service bureau use v remove alter cover or obfuscate any copyright notices trademark notices or other proprietary rights notices placed or embedded on or in the Products vi unb...

Page 15: ...vice or other process utilizing any Products or any part thereof infringes any third party intellectual property right and in such event Customer shall defend Topspin and its officers directors and employees against any such action and Customer shall pay all settlements entered into and all final judgments and costs including reasonable attorneys fees awarded against such party in connection with ...

Page 16: ...other party becomes the subject of a voluntary or involuntary petition in bankruptcy or any proceeding relating to insolvency receivership liquidation or composition for the benefit of creditors In the event that a party terminates this Agreement pursuant to this Section i the terms and conditions of this Agreement shall apply to all Products shipped prior to the date of termination of this Agreem...

Page 17: ... subject matter hereof and merges all prior negotiations and drafts of the parties with regard thereto No modification addition or deletion or waiver of any of the terms and conditions of this Agreement shall be binding on Topspin unless made in a non preprinted agreement clearly understood by both parties to be a modification or waiver and signed by a duly authorized representative of Topspin If ...

Page 18: ...xviii ...

Page 19: ...e Topspin 360 Server Switch provides data center managers with a high performance low latency interconnect that runs Fibre Channel and Ethernet traffic transparently over an InfiniBand IB backplane Figure 1 1 displays the front of the Topspin 360 Server Switch with the bezel on Figure 1 1 Topspin 360 Chassis Front View Bezel End ...

Page 20: ...ver resources at 10 Gbps speeds The combination of high bandwidth and low latency allows resources to be disaggregated and dynamically reassembled without the limits of the shared PCI bus Unified Fabric The Topspin 360 integrates storage server and networking I O into one unified fabric With only one interface card in each host you can manage all resources on one fabric and eliminate the need to i...

Page 21: ...nternal Topspin 360 architecture Figure 1 3 Fully Redundant System Architecture The Topspin 360 can be used in a variety of networking environments including database tiers application tiers and Web tiers The Topspin 360 provides 10 Gbps connectivity to servers 1 Gbps connectivity to Ethernet networks and 2 Gbps connectivity to Fibre Channel networks You can also aggregate uplinks for greater band...

Page 22: ...4 ...

Page 23: ...Trays on page 15 Introduction The components of the Topspin 360 support the scalability and high availability of the Server Switch The sections in this chapter discuss how to use install remove and swap field replaceable components to maximize the potential of your Topspin 360 You can install the following components in your chassis controller cards I O gateways Fibre Channel and Ethernet InfiniBa...

Page 24: ...e master active Slot 14 is the standby The startup configuration file can be synchronized between the active and the standby controllers The CLI prompts users to synchronize the controllers When the master controller fails or reboots the standby controller automatically takes over as the new master All I O cards Switch cards Fibre Channel gateways and Ethernet gateways reboot when a failover occur...

Page 25: ...n the card completely 5 Insert the controller card module into slot 1 or slot 14 such that the ejector lever sits on the bottom left hand side of the module 6 Push the controller card firmly into the slot The ejector lever begins to close Figure 2 2 Inserting the Controller Card ...

Page 26: ...8 7 Push the ejector lever up until it clicks into place Figure 2 3 Closing the Ejector Lever ...

Page 27: ...teways You can add remove and swap I O gateways while your Topspin 360 runs However if the software image on your gateway does not match the software image that runs on your Server Switch you must install the correct software on your gateway For details refer to the install command in the Command Line Interface Reference Guide Instructions on viewing the software image is described in Viewing and ...

Page 28: ...s to close 7 Push the ejector lever up until it clicks into place 8 Open a telnet session and login to the chassis if you have not already done so 9 View the primary software image version for all cards in the chassis use the show card inventory command Look for the primary image source field for each slot The slots are described in Figure 1 2 InfiniBand Switch Cards InfiniBand switch cards connec...

Page 29: ...hillips head screwdriver 3 Remove the switch card from any packaging 4 Extend the ejector levers on the left and right hand sides of the switch card completely 5 Insert the switch card into slot 15 or slot 16 such that the ejector levers sit on the bottom of the switch card 6 Press the switch card firmly into the slot so the fasteners begin to close Figure 2 7 Inserting a Switch Card ...

Page 30: ...12 7 Close both fastener levers simultaneously and completely Figure 2 8 Closing Switch Ejector Levers ...

Page 31: ... functional card installed in slot 16 3 Properly ground yourself to avoid potential electrostatic discharge and damage to the card 4 Facing the back of the Topspin 360 chassis unfasten both screws on the InfiniBand switch card Do not attempt to remove the screws from the card Just unscrew them until you are sure the card is no longer attached to the chassis 5 Open both ejector levers simultaneousl...

Page 32: ...ply Modules Install Power Supply Modules To insert a power supply perform the following steps 1 Ground yourself appropriately 2 Remove the blanking panel if one resides in the slot 3 Remove the power supply module from any packaging 4 Insert the power supply into an open slot such that the pull handle sits close to the blower module NOTE The power supplies should be inserted in opposite directions...

Page 33: ...a flat sheet of metal with the same dimensions as the power module faceplate Blower Trays The hot swappable blower trays fans of your Topspin 360 maintain the internal temperature of your Server Switch You do not need to turn off power to the chassis to replace a blower tray Access the blower tray from the front bezel end of the Topspin 360 chassis Figure 2 11 displays the blower trays in the chas...

Page 34: ...the top of the tray 4 Tighten the captive screw on the front panel to secure the tray to the chassis Removing Blower Trays To remove a blower tray perform the following steps 1 Ground yourself appropriately 2 Unfasten the captive screw 3 Pull the fan toward you until it completely disengages from the chassis ...

Page 35: ...ay to ensure appropriate cooling NOTE Each blower module contains two fans for a total of four fans The system can tolerate one out of four blowers failing When you remove a blower module you have three minutes to replace it with a fully functioning blower module ...

Page 36: ...18 ...

Page 37: ...age 29 Manage the Topspin 360 on page 32 Viewing and Updating the Software Image on the Chassis on page 33 Introduction The sections in this chapter explain how to mount your Topspin 360 in a rack boot the Topspin 360 and configure basic services For advanced configuration information refer to the Command Line Interface Reference Guide or the Element Manager User Guide Prepare the Site for the Top...

Page 38: ...nfiniBand Switch Card on page 42 For details regarding installing power supplies and fans refer to Installing a Power Supply on page 44 and Installing a Blower Tray on page 46 For details regarding installing Fibre Channel gateways refer to the Fibre Channel Gateway User Guide For details regarding installing Fibre Channel gateways refer to the Ethernet Gateway User Guide Rack the Topspin 360 To m...

Page 39: ...is with the screws provided as shown Figure 3 1 and Figure 3 2 Figure 3 1 Positioning the Side Flanges Figure 3 2 Fastening the Side Flanges 8 If necessary for your rack add fasteners with appropriate threads to your rack to prepare your rack for the rails ...

Page 40: ...22 9 Position the chassis brackets to the rack rails as shown in Figure 3 3 Figure 3 3 Rail Positioning ...

Page 41: ...the screws Figure 3 4 displays the rail loosely connected to the rack NOTE When you connect the rails do not fully tighten the screws When you slide the chassis into the rails you may need to reposition the rails to align the flange screws with the rails Figure 3 4 Attaching Rails from the Front ...

Page 42: ...24 11 Screw the top and bottom of the back of the rails to the rack as shown in Figure 3 5 Figure 3 5 Attaching Rails from the Back ...

Page 43: ...25 12 Slide the Topspin 360 onto the rails as shown in Figure 3 6 and Figure 3 7 Figure 3 6 Positioning the Chassis on the Rails Figure 3 7 Sliding the Chassis onto the Rails ...

Page 44: ...stallation Steps on page 13 in the VFrame Evaluation Test Plan Attach a Serial Console Cable to a PC or Terminal 1 Connect the cable from the Topspin serial console to your terminal or management workstation Use the straight through M F serial cable which is provided in the Topspin package NOTE For detailed information on how to connect the serial console cable please see the documentation include...

Page 45: ...ole port of the Controller Card in slot one of your Topspin 360 to a terminal or to a workstation that runs terminal emulation software 2 Launch a terminal session with the following parameters Baud 9600 bps Data Bits 8 Parity None Stop Bits 1 Flow control None 3 Connect a power cord to your Topspin 360 then plug the cord in to an appropriate power source The Topspin 360 boots 4 After the system b...

Page 46: ...and Ethernet port to manage the system Obtain an IP Address with DHCP 1 Enter the enable command Example 2 Enter the configure command Example 3 Enter the interface mgmt ethernet command Example 4 Enter the IP address of the management port followed by the net mask Example Topspin 360 config interface mgmt ethernet Topspin 360 config if mgmt ethernet ip address 10 10 0 22 255 255 255 0 Topspin 360...

Page 47: ...est Plan continue to Step c of Hardware Configuration Steps on page 14 in the VFrame Evaluation Test Plan Connect InfiniBand Hosts This section describes a brief overview for connecting your InfiniBand hosts For more detailed instructions please see the Host Channel Adapter Installation Guide which is included with your HCA s Topspin 360 config if mgmt ethernet no shutdown Topspin 360 config if mg...

Page 48: ... hear feel a click Figure 3 9 Fully Installed IB Cable with Pinch Connector Figure 3 10 Fully Installed IB Cable with Pull Connector NOTE If your host does not provide an ample amount of free space around a given IB port double check that your IB cable connector engages fully Wiggle your connector back and forth to be sure that both sides of the connector have locked firmly into place ...

Page 49: ...31 To remove a cable with a pinch connector pinch both sides of the back of the connector and pull the connector away from the port Figure 3 11 Removing a Pinch Connector ...

Page 50: ...hods Command Line Interface CLI a text based interface accessible through a direct serial connection Telnet over IP or SSH over IP Element Manager GUI A graphical interface installed on a workstation accessible over IP Chassis Manager GUI A graphical interface that you access with a Web browser Refer to the Element Manager User Guide Chassis Manager User Guide and the CLI Reference Guide for more ...

Page 51: ...xample 3 To view all existing boot images that exist on the chassis whether or not they are currently being used use the dir image command A img file is an image file that is not installed Topspin 360 show card inventory Card Resource Inventory Information slot id 1 used memory 77040 kbytes free memory 50272 kbytes used disk space 45048 kbytes free disk space 57331 kbytes last image source Topspin...

Page 52: ... Info to view the version of software installed on the controller Figure 3 13 Software Image Version of the Controller Card Topspin 360 enable Topspin 360 dir image Existing Boot Images on System slot date created size file name 1 Tue Nov 25 18 46 32 2003 30695264 Topspin360 TopspinOS 2 0 0 build212 img 1 Tue Nov 25 19 34 08 2003 19228160 TopspinOS 2 0 0 build211 1 Tue Nov 25 19 32 16 2003 1553920...

Page 53: ...be done through the CLI using FTP and this copy command syntax copy ftp remote login remote passwd remote system filename img slot number of the controller image filename img Example 2 Activate the image After downloading the image file to the chassis controller it must be installed to become active The install command installs the specified image file into the system a In the privileged execute m...

Page 54: ... You can also use the card shutdown and card no shutdown commands or the Element Manager GUI to reboot an individual card if you do not need to update the entire chassis Example 5 Save the system configuration Click Yes when prompted 6 Use the show card inventory command to view the new primary image for all cards Upgrade the Software Image with the GUI 1 Launch the Element Manager GUI 2 Select Ma...

Page 55: ...specified user in the Password field f Enter the path and name of the image file on the FTP server in the File Path and Name field Image file names must include the img extension g Enter the path from the ftp server from which you are copying the file in the Copy To field 4 Click the Copy button to copy the file onto the controller of the switch Wait until the transfer is complete The window will ...

Page 56: ...e from the Image Source for Next Reboot drop down menu c Click the Apply button 7 Reboot the chassis Note you can update the software on an individual gateway by enabling and disabling the gateway a Select Maintenance Boot Config b Click yes to in the Save changes to the system configuration dialog box c Click Ok in the The chassis will now be rebooted dialog box Delete an Image with the CLI You c...

Page 57: ...s not installed Do not delete an installed image file An installed image will have a slash in the name 1 Select Maintenance File Management 2 Click on the img file that you want to delete Figure 3 17 Delete an Image File 3 Click the Delete button 4 Click Yes in the Delete image dialog box Topspin 360 delete 1 image Topspin360 TopspinOS 2 0 0 build488 img Delete file 14 Topspin360 TopspinOS 2 0 0 b...

Page 58: ...40 ...

Page 59: ...pspin 360 has two removable controllers one on each side of the Server Switch Expansion Modules When possible expansion modules should be added before you rack the Topspin 360 However expansion modules can also be added after the Server Switch has been racked Expansion modules refer to the following Ethernet interface gateways Fibre Channel interface gateways For steps for how to install and remov...

Page 60: ... perpendicular to the front panel 3 Insert card until it is fully seated and close the ejector levers 4 Tighten the two captive panel screws on the front panel to secure the card to the chassis Figure 4 1 Removing an InfiniBand switch card Topspin 360 Configuring a New InfiniBand Switch Card When an InfiniBand switch card is added to the chassis the system does not dynamically discover the attribu...

Page 61: ... oper admin oper oper slot type type status status code 5 en4port1G en4port1G up up normal 9 fc2port2G fc2port2G up up normal 14 controller controller up up normal 16 ib12port4x ib12port4x up up normal Card Boot Information boot boot boot slot stage status image 5 done success TopspinOS 1 1 2 build084 9 done success TopspinOS 1 1 2 build084 14 done success TopspinOS 1 1 2 build084 16 done success ...

Page 62: ...hem without removing power from the chassis The powers supplies are located on the front of the chassis When facing the front the power modules are located on right and center of the Topspin 360 chassis To determine the power jack for each power module orient the Topspin 360 chassis as shown in Figure 1 4 below The power jack on the right supplies power to the module on the right and the power jac...

Page 63: ...er Supply To remove the power supply perform the following steps 1 Remove the power cord from the power supply 2 Disengage the power supply by pulling it toward you 3 Slide the power supply out of the chassis 4 Fasten a blanking panel to the empty chassis bay to ensure appropriate cooling NOTE The blanking panel is a flat sheet of metal with the same dimensions as the power module faceplate Power ...

Page 64: ... chassis to replace the fan tray Access the fan tray from the front of the Topspin 360 chassis Installing a Blower Tray To insert a blower tray perform the following steps 1 If a blanking panel is already attached to the module bay remove it 2 Insert the blower tray into an open slot until it is fully seated ...

Page 65: ...hassis 3 Fasten a blanking panel to the empty chassis bay to ensure appropriate cooling The blanking panel is a flat sheet of metal with the same dimensions as the fan tray faceplate It is fastened in the same way as a fan module NOTE Each fan module contains three fans for a total of six fans The system requires at least two fans to remain operational In the event that one fan module fails or you...

Page 66: ...48 ...

Page 67: ...on page 54 Fibre Channel Gateway LEDs on page 55 FC Port LEDs on page 55 Ethernet Gateway LEDs on page 56 Ethernet Port LEDs on page 56 Introduction LEDs on your Topspin 360 and installed components indicate hardware status The sections in this chapter explain the LED indications for the chassis and the components in the chassis LED indicators are appear on the following components power supplies ...

Page 68: ...0 System LED The Topspin 360 system LED appears on the top left hand corner of the front bezel end of the Server Switch You can view the system LED with the bezel on or off Table 5 1 describes system LED indications Table 5 1 System Status LED Indications Activity Indication solid green Chassis runs with no errors solid yellow A module on the chassis has failed off No system power ...

Page 69: ...ays power supply LEDs Figure 5 1 Power Supply LEDs Table 5 2 displays AC LED indications Table 5 3 displays DC LED indications Table 5 2 AC Power Supply LED Activity Indication solid green AC input present off AC input absent Table 5 3 DC Power Supply LED Activity Indication solid green DC outputs from the power supply fall within regulated limits off DC outputs from the power supply exceed limits...

Page 70: ...r LED is a dual color green yellow LED Controller Cards mirror the blower LEDs Figure 5 2 displays the blower LEDs Figure 5 2 Blower Tray LEDs Table 5 4 explains blower tray LED indications Table 5 4 Blower LED Indications Activity Indication solid green Blower runs with no errors solid yellow A blower has failed off No system power ...

Page 71: ...agement Ethernet port LED indications Table 5 5 Controller Card LED Indications LED State Indication off No power to the controller card solid green Controller card runs with no errors solid yellow Controller card problem that requires user intervention Table 5 6 Management Ethernet LED Indications LED State Indication Link LED off No physical link Link LED solid Successful physical link Port Acti...

Page 72: ...manager makes a sweep A logical link must be established if you are to use the port The bottom LED indicates a physical link has occurred A physical link requires that the drivers on the attached InfiniBand host have been installed and are running Table 5 8 explains IB port LED indications Table 5 7 InfiniBand Switch Card LED Indications LED State Indication green off yellow off No power to the sw...

Page 73: ...s Display Indication yellow on green off Auxiliary power has reached the gateway green on yellow off Gateway runs successfully green on and yellow on An error has occurred Table 5 10 Interpreting the Fibre Channel Port Status LEDs Led Description off Optic module or cable is not attached solid yellow A cable is attached but the port is offline slow pulsing yellow 2 second intervals Port is disable...

Page 74: ...ption off No system power or LED failure solid yellow Fan error detected Operator intervention required solid green Fans running with no detected errors Table 5 12 Gateway LED Indications Display Indication yellow on green off Auxiliary power has reached the gateway green on yellow off Gateway runs successfully green on and yellow on An error has occurred Table 5 13 Ethernet Port LED Indications L...

Page 75: ...ees Celsius Operating Temperature Gradient 20C maximum per 60 min Operating Altitude 0 10 000 ft Non Operating Alt 0 35 000 ft Operating Humidity Range 20 to 80 Non condensing Non Operating Humidity Ranges 5 to 95 Non condensing Operating Humidity Gradient Maximum per 60 min 10 Non Operating Humidity Gradient 0 1 maximum per 60 min Operating Shock 5G 11ms half sine wave Non Operating Shock 10G 11m...

Page 76: ...ht justified Power Dissipation 650 W maximum Table 6 3 Certifications Regulatory Certifications EMC Class A Radiated and Conducted Emissions per FCC Part 15 subpart B USA and ICES 003 Canada Safety UL60950 3rd ed USA and CSA 22 2 No 60950 2000 Canada EMC Class A Radiated and Conducted Emissions per EN 55022 Harmonics and Flicker tests per EN 61000 3 2 3 and Radiated and Conducted Immunity tests pe...

Page 77: ...59 Standards used CDRH 21CFR Chapter I 1040 10 IEC IEC60825 1 1994 Table 6 4 Laser Specifications Topspin P N Application Optical Parameters ...

Page 78: ...60 ...

Page 79: ...ler installing removing 41 H high availability 3 I InfiniBand switch cards installing removing 42 installing the chassis in a rack 20 P performance 2 product registration xi R racking the chassis 20 redundancy 3 registration instructions xi S safety information vii system architecture 2 T transparent topology 2 ...

Reviews:

No comments

Brands by name

Popular brands

Load more brands