background image

 

11

Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note

78-17434-01 Rev. A0

  Installing the Cisco SFS 7008P Switch into a Rack

To install the Host Channel Expansion Card for IBM BladeCenter drivers after you have installed the 
HCA Expansion Card, follow these steps:

Step 1

Locate your downloaded software direcory. 

Step 2

Open a terminal or graphic window and access the top-level directory.

Step 3

Execute the command

 ./tsinstall 

in a terminal window. 

# cdmount ./tsinstall

This program automatically detects the available kernel and installs the appropriate drivers as RPM 
packages. By default, the files are saved in the /usr/local/cisco directory.

Step 4

Configure the IPoIB driver by assigning an IP address to interface ib0 and/or ib1, which corresponds to 
the two HCA ports. IPoIB drivers load when the interfaces are used for the first time. To assign ib 
interfaces, enter 

ifconfig ib#

 

ip address

 

netmask

 

netmask

.

 This example configures one HCA:

ifconfig ib0 192.168.0.1 netmask 255.255.255.0

#

ifconfig ib1 192.168.1.1 netmask 255.255.255.0

#

This example configures two HCAs:

ifconfig ib0 192.168.0.1 netmask 255.255.255.0

#

ifconfig ib1 192.168.1.1 netmask 255.255.255.0

ifconfig ib2 192.168.2.1 netmask 255.255.255.0

ifconfig ib3 192.168.3.1 netmask 255.255.255.0

Step 5

Merge ib0 and ib1 for port-to-port redundancy, if desired.

Step 6

(Optional) Configure MPI by following these steps:

Make sure that your connections to the HCA uses port 1 of the first HCA. MPI requires the use of 
HCA 1, port 1. 

Set up rsh or ssh on two nodes so that you can run commands between a remote and local node 
without entering a login or password. This is required to use the MPI protocol. 

Either add paths to your environment PATH:

/usr/local/cisco/mpi/mpich/bin

/usr/local/cisco/bin

or 

Add directories to your PATH variable. For example:

export PATH=$PATH:/usr/local/cisco

Step 7

Configure all other drivers, including SDP. 

Summary of Contents for SFS 7008P

Page 1: ...ll and configure the Cisco SFS 7008P switch This publication contains these sections Safety Overview page 2 Parts List page 2 Required Tools Equipment and Personnel page 2 Before You Install page 3 Installing the Cisco SFS 7008P Switch into a Rack page 6 Troubleshooting page 20 Translated Safety Warnings page 21 Obtaining Documentation page 27 Documentation Feedback page 27 Cisco Product Security ...

Page 2: ...190 01 Required Tools Equipment and Personnel In addition to the accessories provided with the switch you should have the following A 2 Phillips screw driver Screws not provided to attach the mounting brackets to the rack Any associated mounting clips to secure the brackets to your rack two for each rail of the rack A rack with enough clearance for the Cisco SFS 7008P switch and cables Warning IMP...

Page 3: ...away from the switch and pallet Do not cut the packaging as you could damage the switch Save the box and packaging Prepare a management workstation such as a PC or laptop running a terminal program with a rollover M F DB 9 serial cable included Verifying Basic Hardware If you have not purchased a fully loaded chassis with high availability components installed verify that you have the minimum comp...

Page 4: ...odule installed See Figure 1 Step 3 Verify that you have a Fabric Controller installed in the Core slot see slot 11 in Figure 2 A second Fabric Controller module installed in slot 12 is not required for the chassis to function but is required to have a non blocking fabric 144988 Management I O modules Power plug 2 Power plug 1 Chassis ID Main air exhaust 4x copper line interface modules ...

Page 5: ...rify that you have at least one fabric module installed in one of the node slots The node slots are 9 10 13 and 14 See Figure 2 Step 7 Verify that you have two LIMs installed for each fabric module in the node slots See Figure 3 for an example of the connections between the LIMs and the fabric modules in the node slots 154497 System Status LED pp y Status LED Power Supply identity LED Power suppli...

Page 6: ...co SFS 7008 InfiniBand Server Switch Hardware Installation Guide To mount the Cisco SFS 7008P switch chassis in an industry standard rack follow these steps Step 1 Install a shelf for the chassis as shown in Figure 4 if you have not already done so The shelf must support the weight of the chassis which can be up to 106 pounds if all possible components are installed Fabric card in slot 9 LIM card ...

Page 7: ...installedand justified in the rack The direction that the switch will be justified determines which set of mounting brackets need to be removed in the next step Step 4 Remove one set of mounting brackets as shown in Figure 5 If the switch will be justified toward the bezel side in the rack then unscrew the mounting brackets from the port side of the switch If the switch will be justified toward th...

Page 8: ...Step 5 Separate the mounting brackets from the chassis when all screws have been loosened Step 6 With 2 or 3 people working together lift the switch into the rack as shown in Figure 6 Figure 6 Chassis Set onto Shelf Step 7 Push the chassis into the rack until the mounting brackets are flush with the rails Step 8 Use screws that fit your rack to attach both mounting brackets to the rack posts 14496...

Page 9: ...7 Power Supplies and Fans Located in the Front of the Unit with the Bezel Removed Redundant Fan Tray see the fan locations in Figure 7 Install the second fan according to the Fan Module Installation Guide in the package Redundant Management Interface Module see the location of the Management I O Modules in Figure 8 Install the second I O Module according to the directions in the Management Interfa...

Page 10: ... SRP SDP uDAPL and MPI from the Cisco Software Center at this URL http www cisco com public sw center Install the Host Channel Expansion Card for IBM BladeCenter by doing the following Step 1 Power down the host system following proper grounding procedures Step 2 Unpack the HCA module and insert it into an open 64 bit PCI or PCI X slot Step 3 Power on the host system Installing Host Channel Expans...

Page 11: ...st time To assign ib interfaces enter ifconfig ib ip address netmask netmask This example configures one HCA ifconfig ib0 192 168 0 1 netmask 255 255 255 0 ifconfig ib1 192 168 1 1 netmask 255 255 255 0 This example configures two HCAs ifconfig ib0 192 168 0 1 netmask 255 255 255 0 ifconfig ib1 192 168 1 1 netmask 255 255 255 0 ifconfig ib2 192 168 2 1 netmask 255 255 255 0 ifconfig ib3 192 168 3 ...

Page 12: ... operating system version 2 5 0 preloaded DRIVERS TOO OR DOWNLOAD IN STEP 4 THE SDK COMES UP WHERE DID THAT COME FROM To install Windows drivers after you have installed the HCA Expansion Card follow these steps Step 1 Log on to your Windows 2000 host A Found New Hardware alert appears see Figure 9 Figure 9 Found New Hardware Alert Step 2 Ignore the alert The Found New Hardware Wizard window opens...

Page 13: ... SDK Setup Window Step 5 Click Next The End User License Agreement window opens Step 6 Click the I Agree to the terms listed above radio button and then click Next The Product Information window appears Step 7 Click Next The Ready to Install window opens Step 8 Click Next The installation executes The Installation Complete window appears when the installation completes Step 9 Click Finish The syst...

Page 14: ...p www cisco com public sw center To install the Windows 2003 drivers follow these steps Step 1 Log on to your Windows 2003 host Step 2 HOW DID SW GET ON MY COMPUTER HOW DO I START THIS The Product Install window appears see Figure 12 Figure 12 Product Install Window Step 3 Click Next The End User License Agreement appears Step 4 Click the I Agree to the terms listed above radio button and then cli...

Page 15: ...ndows signature Although the drivers are not digitally signed they are tested using the Microsoft HCT suite WHQL submission materials are available per request CAB files etc Step 6 Click Continue Anyway Figure 14 each time the Windows Logo testing dialog box appears Figure 14 Testing Dialog Box The driver installation notice shown in Figure 15 appears for each host channel adapter you have install...

Page 16: ...ithout user intervention This window appears three times twice for the IPoIB and once for SRP Figure 16 Ignore the Found New Hardware Wizard Windows Step 9 Click Finish Step 10 Reboot the server a In Windows click Start Shutdown You see the screen in Figure 17 b Select Restart from the drop down menu see Figure 17 c Optionally enter a reason for the system reboot in the Comment field see Figure 17...

Page 17: ...mentation at http www cisco com THERE IS NOTHING HERE Launching the SFS Chassis Manager Optional SFS Chassis Manager is a web based GUI that can be used to manage a single InfiniBand chassis from a Web browser SFS Chassis Manager supports the following browsers Microsoft Internet Explorer version 6 Netscape Navigator version 6 Mozilla version 1 4 To launch SFS Chassis Manager follow these steps St...

Page 18: ...0 Installing the Cisco SFS 7008P Switch into a Rack Figure 18 SFS Chassis Manager Log In Window Step 2 Enter your username and password in the log in window and click Login SFS Chassis Manager loads in your browser window as shown in Figures 19 and 20 Figure 19 SFS Chassis Manager Opening Rear View ...

Page 19: ...l Element Manager follow these steps Step 1 Ensure that you have sufficient system resources You need the following 32 MB free RAM 50 MB disk space and 50MB additional temporary space during installation 300 MHz processor 800 x 600 screen resolution 16 bit color depth Step 2 Download the Element Manager software To download the latest software access the Cisco Software Center at this URL http www ...

Page 20: ...you do not hold a valid Cisco service contract contact your reseller Cisco Technical Support Website The Cisco Technical Support Website provides online documents and tools for troubleshooting and resolving technical issues with Cisco products and technologies The website is available 24 hours a day 365 days a year at this URL http www cisco com techsupport Access to all tools on the Cisco Technic...

Page 21: ...5 227 EMEA 32 2 704 55 55 USA 1 800 553 2447 For a complete list of Cisco TAC contacts see http www cisco com techsupport contacts Definitions of Service Request Severity To ensure that all service requests are reported in a standard format Cisco has established severity definitions Severity 1 S1 Your network is down or there is a critical impact to your business operations You and Cisco will comm...

Page 22: ...en kuin käsittelet laitteistoa huomioi sähköpiirien käsittelemiseen liittyvät riskit ja tutustu onnettomuuksien yleisiin ehkäisytapoihin Turvallisuusvaroitusten käännökset löytyvät laitteen mukana toimitettujen käännettyjen turvallisuusvaroitusten joukosta varoitusten lopussa näkyvien lausuntonumeroiden avulla SÄILYTÄ NÄMÄ OHJEET Attention IMPORTANTES INFORMATIONS DE SÉCURITÉ Ce symbole d avertiss...

Page 23: ...go Você está em uma situação que poderá ser causadora de lesões corporais Antes de iniciar a utilização de qualquer equipamento tenha conhecimento dos perigos envolvidos no manuseio de circuitos elétricos e familiarize se com as práticas habituais de prevenção de acidentes Utilize o número da instrução fornecido ao final de cada aviso para localizar sua tradução nos avisos de segurança traduzidos ...

Page 24: ...24 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 78 17434 01 Rev A0 Translated Safety Warnings ...

Page 25: ...s Use o número da declaração fornecido ao final de cada aviso para localizar sua tradução nos avisos de segurança traduzidos que acompanham o dispositivo GUARDE ESTAS INSTRUÇÕES Advarsel VIGTIGE SIKKERHEDSANVISNINGER Dette advarselssymbol betyder fare Du befinder dig i en situation med risiko for legemesbeskadigelse Før du begynder arbejde på udstyr skal du være opmærksom på de involverede risici ...

Page 26: ...26 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 78 17434 01 Rev A0 Translated Safety Warnings ...

Page 27: ...documentation that is found on the Cisco website without being connected to the Internet Certain products also have PDF versions of the documentation available The Product Documentation DVD is available as a single unit or as a subscription Registered Cisco com users Cisco direct customers can order a Product Documentation DVD product number DOC DOCDVD or DOC DOCDVD SUB from Cisco Marketplace at t...

Page 28: ...tices and security responses as they are updated in real time you can subscribe to the Product Security Incident Response Team Really Simple Syndication PSIRT RSS feed Information about how to subscribe to the PSIRT RSS feed is found at this URL http www cisco com en US products products_psirt_rss_feed html Reporting Security Problems in Cisco Products Cisco is committed to delivering secure produ...

Page 29: ...bsite The Cisco Technical Support Documentation website provides online documents and tools for troubleshooting and resolving technical issues with Cisco products and technologies The website is available 24 hours a day at this URL http www cisco com techsupport Access to all tools on the Cisco Technical Support Documentation website requires a Cisco com user ID and password If you have a valid se...

Page 30: ... your service request is assigned to a Cisco engineer The TAC Service Request Tool is located at this URL http www cisco com techsupport servicerequest For S1 or S2 service requests or if you do not have Internet access contact the Cisco TAC by telephone S1 or S2 service requests are those in which your production network is down or severely degraded Cisco engineers are assigned immediately to S1 ...

Page 31: ...echnical specifications for many Cisco products that are sold through channel partners It is updated twice a year and includes the latest Cisco offerings To order and find out more about the Cisco Product Quick Reference Guide go to this URL http www cisco com go guide Cisco Marketplace provides a variety of Cisco books reference guides documentation and logo merchandise Visit Cisco Marketplace th...

Page 32: ...t Protocol Journal at this URL http www cisco com ipj Networking products offered by Cisco Systems as well as customer support services can be obtained at this URL http www cisco com en US products index html Networking Professionals Connection is an interactive website for networking professionals to share questions suggestions and information about networking products and technologies with Cisco...

Page 33: ...33 Cisco SFS 7008P InfiniBand Server Switch Installation and Configuration Note 78 17434 01 Rev A0 Obtaining Additional Publications and Information ...

Page 34: ...tal the Cisco Systems logo Cisco Unity Enterprise Solver EtherChannel EtherFast EtherSwitch Fast Step FormShare GigaDrive GigaStack HomeLink Internet Quotient IOS IP TV iQ Expertise the iQ logo iQ Net Readiness Scorecard LightStream Linksys MeetingPlace MGX the Networkers logo Networking Academy Network Registrar Packet PIX Post Routing Pre Routing ProConnect RateMUX ScriptShare SlideCast SMARTnet...

Reviews: