IBM IBM 9077 Get Connected Download Page 336

Page: 336 / 342

318

IBM 9077 SP Switch Router: Get Connected to the SP Switch

config_netstat

csconfig

dev1config

Eannotator

Efence

Efence -autojoin

Eprimary

Estart

101

Eunfence

101

gratm

116

121

grcard

101

109

grconslog

grf_update

301

grifconfig

grreset

109

grrmb

109

grrt

118

132

grsite

grsite --perm

grsnapshot

grstat

119

133

grwrite

107

109

grwrite -vn

ifconfig

iflash

lsdev

168

maint

116

131

pax

perspectives

ping

160

ping -P grid

reboot

route

SDRGetObjects switch_responds

smit

annotator

delete_extadapter

delete_extnode

enter_extadapter

enter_extnode

list_extadapter

list_extnode

manage_extnode

sphardware

splstdata

spmon

sysctl

301

xterm -e telnet

command line interface

see CLI

communications bus

Control Workstation

see CWS

crosspoint switch

CWS

102

165

184

193

203

204

205

224

225

DAS

121

123

129

130

data forwarding

datagrams

dedicated router

dependent node

101

102

architecture

DIX Ethernet

144

DMA engine

DNS

204

domain name service

see DNS

downtime

dual ring

125

dual-speed

105

dump profile

107

108

dynamic routing

210

dynamic routing protocol

EGP

Ethernet

card

107

109

hostname

hub

102

157

media card

161

twisted-pair

102

extended node

extension node

adapter

Exterior Gateway Protocol

see EGP

exterior protocols

external routes

external switch module

125

Summary of Contents for IBM 9077

Page 1: ...IBM 9077 SP Switch Router Get Connected to the SP Switch SG24 5157 00 International Technical Support Organization http www redbooks ibm com Hajo Kitzhöfer Steffen Eisenblätter Uwe Untermarzoner ...

Page 2: ......

Page 3: ...IBM 9077 SP Switch Router Get Connected to the SP Switch November 1998 SG24 5157 00 International Technical Support Organization ...

Page 4: ...with AIX 4 3 1 and Ascend Embedded OS Version 1 4 6 4 Comments may be addressed to IBM Corporation International Technical Support Organization Dept HYJ Mail Station P099 522 South Road Poughkeepsie New York 12601 5400 When you send information to IBM you grant IBM a non exclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you ...

Page 5: ... the GRF 12 2 1 6 Overview of Supported Routing Protocols 15 2 1 7 Media Adapters At a Glance 16 2 1 8 Benefits of the GRF 16 2 1 9 Price Comparison 17 2 2 GRF Software 18 2 2 1 IP Protocol 19 2 2 2 Supported Routing Protocols 20 2 2 3 Filtering 23 2 2 4 System Management 24 2 3 GRF Hardware 24 2 3 1 GRF Block Diagram 24 2 3 2 GRF Features 26 2 3 3 IP Switch and Control Board 31 2 3 4 Memory Guide...

Page 6: ... Cable 80 3 4 3 Procedure for Connecting Cards to the SP Switch 80 3 5 Configuration Required on the SP System 81 3 5 1 Determining the Switch Connection for a Dependent Node 82 3 5 2 Procedure to Get the Jack Number 84 3 6 Multiple Frames for Multiple System Connections 85 3 7 Step by Step Media Card Configuration 86 3 7 1 Configuration Files and Their Uses 86 3 8 Step 1 Check SNMP in the SP Swit...

Page 7: ...ign IP Addresses grifconfig conf 114 4 2 5 Specify ATM Card Parameters 115 4 2 6 Configuring PVCs 115 4 2 7 Some maint Commands for the ATM OC 3c Media Card 116 4 2 8 Using grrt to Display the Route Table 118 4 2 9 Using grstat to Display GRF Statistics 119 4 3 ATM OC 12c Configuration 119 4 3 1 Physical and Logical ATM Interfaces 119 4 3 2 Installing Configurations or Changes 120 4 3 3 Configurat...

Page 8: ...tion and Single SP Switch Router Adapter Card 157 5 1 1 SP Switch Ethernet Connection 157 5 1 2 SP Switch FDDI Connection 162 5 1 3 SP Switch ATM Connection 167 5 1 4 SP Switch FDDI Connection Distinct FDDI Networks 174 5 1 5 SP Switch FDDI Connection in an ADSM Environment 185 5 2 Single SP Partition and Multiple SP Switch Router Adapter Cards 187 5 2 1 Configuration of a Dual SP Switch Router Co...

Page 9: ...f 282 B 11 etc grlamap conf 284 B 12 etc grroute conf 285 B 13 etc hosts 286 B 14 etc inetd conf 286 B 15 etc motd 287 B 16 etc rc local 287 B 17 etc snmpd conf 288 B 18 etc syslog conf 291 B 19 etc ttys 292 Appendix C Hardware and Software Information 295 C 1 The Front Panel of the SP Switch Router Adapter Card Operational 295 C 2 SP Switch Router Adapter Media Card LEDs 296 C 3 SP Switch Router ...

Page 10: ...09 E 1 International Technical Support Organization Publications 309 E 2 Redbooks on CD ROMs 309 E 3 Other Publications 309 How to Get ITSO Redbooks 311 How IBM Employees Can Get ITSO Redbooks 311 How Customers Can Get ITSO Redbooks 312 IBM Redbook Order Form 313 List of Abbreviations 315 Index 317 ITSO Redbook Evaluation 323 ...

Page 11: ...k 55 23 System Partition Aid Perspectives 57 24 System Partition Aid Notebook 58 25 Coexistence 61 26 Partitioning 63 27 The Laboratory Hardware Installation 67 28 Connecting the GRF to the SP Switch and the CWS 69 29 Connecting the GRF to the Frame 73 30 Connecting the GRF Console 74 31 SP System Administrative Ethernet Connections 80 32 Switch Port Assignments in Supported Frame Configurations 8...

Page 12: ...I Connection 175 57 SP Switch FDDI Connection Bridging 180 58 SP Switch Router in an ADSM Environment 185 59 Connecting One SP Switch with Two SP Switch Router Adapter Cards 187 60 Configuration with Dual SP Switch Router SP Switch Connection 190 61 IP Traffic Flow When Issuing ping 192 168 13 1 on Node 6 195 62 IP Traffic Flow When Issuing ping 192 168 13 1 on Node 10 195 63 IP Traffic Flow When ...

Page 13: ...n 191 21 Configuration of a Partition Partition Connection 199 22 Configuration of SP Switch SP Switch Connection 204 23 Configuration of SP Switch ATM SP Switch 212 24 Configuration of SP Switch ATM Bridged SP Switch 216 25 Configuration of SP Switch ATM OC 12c SP Switch 224 26 Configuration of SP Switch HIPPI SP Switch 228 27 Configuration of SP 21 234 28 Configuration of SP 2 235 29 Hard Disk E...

Page 14: ...s Part 14 of 14 252 46 Network Options of CWS and All Nodes Part 1 of 3 253 47 Network Options of CWS and All Nodes Part 2 of 3 254 48 Network Options of CWS and All Nodes Part 3 of 3 255 49 Network Options of 7025 F50 Part 1 of 3 256 50 Network Options of 7025 F50 Part 2 of 3 257 51 Network Options of 7025 F50 Part 3 of 3 258 52 SP Switch Router Adapter Media Card LEDs 296 53 SP Switch Router Ada...

Page 15: ...me routing fundamentals particularly focusing on concepts like IP and switch routing The second part presents sample configurations that were carefully chosen to match frequently occurring customer situations The basic configurations shown are building blocks for more complex networking topologies that include the SP Switch Router and may inspire more sophisticated configurations All configuration...

Page 16: ...ner is an RS 6000 SP Technical Support Specialist with IBM Germany He joined IBM 1989 He has ten years of experience in AIX and five years of experience with the SP mostly in the commercial environment He joined IBM at 1989 His areas of expertise include AIX RS 6000 SP SMP PSSP Networking Performance Tuning and Systems Management Thanks to the following people for their invaluable contributions to...

Page 17: ...redbooks in one of the following ways Fax the evaluation form found in ITSO Redbook Evaluation on page 323 to the fax number shown on the form Use the electronic evaluation form found on the Redbooks Web sites For Internet usershttp www redbooks ibm com For IBM Intranet usershttp w3 itso ibm com Send us a note at the following address redbook us ibm com ...

Page 18: ...xvi IBM 9077 SP Switch Router Get Connected to the SP Switch ...

Page 19: ... Copyright IBM Corp 1998 1 Part 1 Introducing and Installing the GRF ...

Page 20: ...2 IBM 9077 SP Switch Router Get Connected to the SP Switch ...

Page 21: ...he dependent node connects to the RS 6000 SP Switch but not to the earlier High Performance Switch HiPS The SP Switch Router Adapter is the first product to exploit the Dependent Node Architecture 1 2 Limitations of the Dependent Node The following are limitations associated with use of the dependent node To use the dependent node in an RS 6000 SP requires the SP Extension Node SNMP Manager to be ...

Page 22: ...itch s primary node to compute its switch routes Therefore the primary node must have at least PSSP 2 3 installed otherwise the dependent node cannot work with the RS 6000 SP In the RS 6000 SP SP Switch nodes occasionally send service packets from one node to the next to keep track of status and links Sometimes these packets are sent indirectly through another switch node As the dependent node is ...

Page 23: ...he dependent node Some planning considerations which should be considered can found in Section 2 5 Planning for the GRF on page 63 and Section 2 6 Planning for the Dependent Node on page 65 2 1 Overview The purpose of the SP Switch Router Adapter is to allow the GRF goes really fast manufactured by Ascend to forward SP Switch IP traffic to other networks The GRF was known as the High Performance G...

Page 24: ...s an extension node adapter to represent its connection to the SP Switch 2 1 1 Motivation A thin node which has a single microchannel is unable to deliver more than about 30 MB s to or from the SP Switch Using a wide node this number increases to 65 MB s but is still unable to provide full bandwidth to even one HIPPI interface It is also unable to feed 4 FDDI or 4 Ethernet 100BaseTx cards at full ...

Page 25: ...gured in that node and at times a lengthy maintenance procedure Redundancy is not built into the SP node s architecture These facts are illustrated in Figure 2 Figure 2 Functional Comparison SP Node 9077 Bus Shared 1 MCA per thin node 2 MCA per wide node Non blocking Crosspoint Switch 250 ns path setup Route Table Centralized Cache Software Based Cache hits 50 typical Independent lookups per card ...

Page 26: ...to minimize the scope of the changes and the exposure to side effects that dependent nodes may cause if they were represented as standard nodes in the SDR 2 1 3 What is a Router One of the basic functions of the Internet Protocol IP is its ability to connect between different networks This is due its routing algorithm and its flexibility to use almost any physical network below A system that conne...

Page 27: ...e and thereby frees up memory for other work The use of routing reduces network traffic because routers encourage subnetting which creates a smaller network of systems By having smaller networks network traffic congestion is reduced and overall network performance and traffic control are improved A network s routing configuration does not always require a routing protocol In situations where the r...

Page 28: ...ting tables do not adjust to network changes so they work best where routes do not change Figure 4 Table Based Routing Dynamic routing A network with more than one possible route to the same destination should use dynamic routing A dynamic routing table is built from the information exchanged by the routing protocols The protocols are designed to distribute information that dynamically adjusts rou...

Page 29: ... RS 6000 SP nodes 1 By putting an additional IP adapter into every RS 6000 SP node 2 By designating one or two nodes to act as a router as shown in Figure 5 Figure 5 Routing without GRF The first option was usually not chosen because it was too costly for the following reasons For systems with a large number of nodes having multiple IP adapters for each RS 6000 SP node can be expensive The number ...

Page 30: ...e memory on the RS 6000 SP node is typically more expensive than router memory The CPU on a node can only drive the system I O bus at less than 80 megabytes per second which is less than what a high end router can do For these reasons the performance of routers in handling IP traffic from remote systems to the RS 6000 SP nodes was limited 2 1 5 Routing with the GRF The GRF is a dedicated high perf...

Page 31: ...is done at the Layer 3 level see Figure 8 on page 14 and requires a router s CPU to process both the packet and the route information Conventional routers use shared resources which leads to congestion and poor scalability and performance Software based route table lookups can be very slow if the route table is not in cache Media Cards LAN WAN Route Table and Lookup I O Buffering IP Packet Forward...

Page 32: ...t works equally well in large and small networks At each hop where a routing switch is used routes are processed at Layer 3 but the packet is forwarded at Layer 2 see Figure 9 on page 15 In the case of the SP Router the route processing is done through hardware so all processing is done at near wire speed Router Router Router Unswitched Data Switched Data 1 2 3 4 5 Disadvantages Shared data paths ...

Page 33: ...s such it is much more cost effective for routing IP traffic than using dedicated RS 6000 SP node 2 1 6 Overview of Supported Routing Protocols In addition to static routes various routing protocols are available on the GRF as follows RIPRouting Information Protocol Version 1 or 2 RIP 1 or 2 OSPFOpen Shortest Path First IS ISIntermediate System to Intermediate System an OSI gateway protocol Layer ...

Page 34: ... 2 3 8 Other Media Cards on page 39 2 1 8 Benefits of the GRF The crosspoint switch is a nonblocking crossbar This architecture is faster than an RS 6000 SP node in which media adapters communicate through a shared microchannel bus To take advantage of the fast I O provided by the crosspoint switch fast route table access time is required The GRF can store up to 150 000 routes in memory on each me...

Page 35: ...the other GRF media adapters via the SP Switch Note The number of packets that the GRF can route per second depends on the following The type of media adapter The size of the packet 2 1 9 Price Comparison Figure 10 on page 18 shows a price comparison between an RS 6000 SP node solution and a GRF based solution for three sample configurations The SP Switch Router model 04S can support four media ca...

Page 36: ...rd chart focuses on an ATM connection In this case the RS 6000 SP node based solution is the more reasonable solution if you consider only the price But the difference is not that much the growth path with the GRF based offer will be better than the node solution 2 2 GRF Software The software functionality of the GRF is distributed between the Router Manager on the IP Switch Control Board see also...

Page 37: ...witch fabric to the destination media Any difference in MTU size large MTU to smaller MTU is handled by packet fragmentation as specified in the IP standard Logic on the destination media is responsible for any media specific processing of the packet such as producing 53 byte cells for ATM Data Forwarding Individual media cards maintain their own route tables perform lookups and autonomously handl...

Page 38: ...esses can now be assigned from any unused portion of the entire 32 bit address range rather than from within a specific subset of the space previously called a class Since it hides multiple subnets under a single network address this method is called supernetting Classless addressing allows the network administrator to further apportion an assigned address block into smaller network or host segmen...

Page 39: ... router running OSPF shares information about its neighbors with the entire network The entire network means at most a single autonomous system OSPF further defines a hierarchy of routing areas within an autonomous system Areas These are sets of networks within a single autonomous system that have been grouped together The topology of an area is hidden from the rest of the autonomous system and ea...

Page 40: ... Link States Routers go through these steps when they first come up and repeat them in response to the events that occur in the network Each router must perform each of these steps for each network it is connected to except for the calculation of the routing table Each router generates and maintains a single routing table for all networks Multicast IP Multicast The GRF supports IP multicast routin...

Page 41: ...EGP The Exterior Gateway Protocol EGP is the protocol used for exchange of routing information between exterior gateways not belonging to the same autonomous system EGP gateways may only forward reachability information for networks within their autonomous system This routing information must be collected by the EGP gateway usually via an GP BGP Border Gateway Protocol BGP is the leading exterior ...

Page 42: ...ics which can be reported to network management packages via the Router Manager on the IP Switch Control Board In addition to collection statistics and other management information the SNMP agent is also capable of issuing traps For more information see Section 2 4 5 SP Extension Node SNMP Manager on page 58 2 3 GRF Hardware As already mentioned the unique GRF switching architecture is specially d...

Page 43: ...ts on this chassis They are slotted horizontally and are located at the bottom of the chassis IP Switch Control BoardThis board is located at the top of the four media slots and is also slotted horizontally Cooling Fan Drawer IP Forwarding Media Card IP Forwarding Media Card IP Forwarding Media Card IP Forwarding Media Card IP Forwarding Media Card IP Forwarding Media Card IP Forwarding Media Card...

Page 44: ...e 16 media slots and are also slotted vertically Power SupplyThe base of the chassis is reserved for the two power supplies that are required for redundancy The failed power supply can be hot swapped out of the GRF chassis 2 3 2 GRF Features GRF has the following features Redundant power supply Should any power supply fail a message is sent to the control board The power supply will automatically ...

Page 45: ... be unavailable the router fails Crosspoint switch The crosspoint switch is a 16x16 16Gb per second or 4x4 4Gb per second crossbar switch for the GRF 16S and GRF 04S respectively see Figure 12 on page 27 It is the I O path used when the media adapters need to communicate with each other Figure 12 GRF Architecture Some parts in Figure 12 need to be explained User Interface Dynamic Routing Engine Ro...

Page 46: ...ther technique that helps assure linear scalability The router manager on the controller board which also contains the switch fabric maintains the master route table and distributes updates simultaneously to all installed media cards even as the cards continue their forwarding functions 3 On Board Processor 4 Router management takes place on the IP Switch Control Board see Section 2 3 3 2 IP Switc...

Page 47: ...is header contains information for the downstream card to process the packet as well as the next hop found by the QBRT 6 The packet is then transferred to the internal serial interface by the DMA engine 7 A connection to the downstream card is set up through the switch 8 The serial stream is converted back to parallel format by the downstream card 9 The packet is transferred to the transmit buffer...

Page 48: ...ing These are the steps for processing routing packets 1 A routing packet is received by the media card 2 The packet is transferred to the receive buffer by the DMA engine 3 The CPU examines the header and gives the destination address to the route lookup hardware 4 The QBRT finds the next hop in the route table 5 A special header is added to the packet by the CPU This header contains information ...

Page 49: ...aintained for high priority traffic 2 3 3 IP Switch and Control Board The control board also known as the IP Switch Control Board is accessed through Telnet or a locally attached VT100 terminal The IP Switch Control Board is supplied with the GRF and is necessary for its operation The VT100 terminal is not supplied with the GRF It is only needed for the installation of the GRF Using terminal emula...

Page 50: ...f BSD UNIX as its operating system For this reason the GRF administrator is assumed to be proficient in UNIX The IP Switch Control Board is used to install boot and configure the router and its media adapters It is also used for the logging of messages the dumping of memory and status and to perform diagnostic checking of both the GRF and the media adapters 66 3 2 1 0 IP Switch Control Board Slot ...

Page 51: ...rols the media cards issues interrupts and resets to individual media cards and downloads executable programs and connection information 2 3 3 2 IP Switch Control Board Components Let us examine the IP Switch Control Board in more detail Figure 17 shows all the components of the IP Switch Control Board Figure 17 IP Switch Control Board System Bus CPU Pentium 166MHz Flash Memory 85 MB 32MB 32MB 32M...

Page 52: ... Control Board and the GRF As previously mentioned this processor runs a variant of BSD UNIX and so it is useful for the GRF administrator to have UNIX management skills Administrative EthernetThis Ethernet is known to the GRF as de0 This port supports the 10BaseT or the 100BaseT Ethernets and switches between them automatically depending on the type of network used To use 10Base2 or 10Base5 the u...

Page 53: ...g tables and larger numbers of peers for a total of 256 MB 204 MB usable The following table provides guidelines for memory configuration All media cards can hold up to 150 KB route entries The control board depending on memory configuration can hold 35 805 to 521 730 route prefixes Select the amount of memory according to your routing environment Additional memory may be required for higher avera...

Page 54: ...erent transfer rates Each onboard processor has local memory that can contain a local route table with up to 150 000 entries to be used for routing on the media adapter Because these route entries are in local memory access to them is very fast When the media adapter is started up it gets its initial route entries from the IP Switch Control Board 2 3 6 SP Switch Router Adapter The GRF supports a n...

Page 55: ...ination through the GRF The SP Switch Router adapter described here is used for routing IP packets to and from the SP Switch to other systems connected directly or indirectly to the GRF A brief description of the components on the media board follows Receive TBICThis component receives data segments from the SP Switch and notifies the Receive Controller and Processor that there is data to be trans...

Page 56: ...rosspoint switch FIFO 2 This component receives IP packets from the serial daughter card and transfers them to Buffer 2 Buffer 2 This buffer is used to temporarily store the IP packet while its IP address is examined and a proper SP Switch route is set up to transfer the packet through the SP Switch Send Controller and ProcessorThis component is notified when an IP packet is received in the FIFO 2...

Page 57: ...pes of cables require the user to supply the appropriate transceivers ATM OC 3cThe ATM OC 3c media adapter allows the user to connect up to two connections into the ATM network at 155 Mb s ATM OC 12cThe ATM OC 12c media adapter allows the GRF to connect to a single ATM network at speeds of up to 622 Mb per second FDDIThe FDDI media card provides four ports in the card These ports allow the media c...

Page 58: ... in order to minimize the possibility of damage to GRF components 2 4 PSSP Enhancements This section discusses the enhancements made to PSSP to accommodate the Dependent Node Architecture 2 4 1 SDR Enhancements As mentioned in Section 2 1 2 Design Objectives on page 8 the System Data Repository SDR needed to be extended to support the dependent node architecture Two classes have been added to the ...

Page 59: ...he reliable_hostname snmp_community_nameThis field contains the SNMP community name that the SP Extension Node SNMP Manager and the GRF s SNMP Agent will send in the corresponding field of the SNMP messages This value must match the value specified in the etc snmpd conf file If left blank a default name found in the SP Switch Router Adapter documentation is used The following attributes are derive...

Page 60: ...s the node position of an unused SP Switch port to be used by the SP Switch router adapter netaddrThis is the IP address of the SP Switch Router adapter netmaskThis is the netmask of the SP Switch Router adapter 2 4 1 3 Additional Attributes As Table 4 shows additional attributes are added to the Syspar_map_class and the Switch_partition classes Table 4 Additional SDR Attributes Details of these a...

Page 61: ... the Control Workstation The second group can be executed by any user on any standard RS 6000 SP node Table 5 shows a list of commands of the first group Table 5 New Commands root Executable The first four commands all have the same characteristics which are as follows The are part of the ssp basic fileset They must only be executed on the Control Workstation They can only be executed by the root ...

Page 62: ... from the second group executable by any user on any standard node Table 6 New Commands User Executable These commands have the following characteristics They are part of the ssp basic fileset They can be executed on any standard RS 6000 SP node They can be executed by any user They only affect the current active partition unless the G option is used The following sections describe the commands in...

Page 63: ...f left blank a default name found in the SP Switch Router Adapter documentation is used i Extension node This field contains the two digit slot number of the SP Switch Router Adapter on the GRF The value for this field is from 00 15 and is shown on the slots of the GRF s SNMP Agent hostname This field refers to the hostname of the processor running the SNMP Agent for the GRF In the current version...

Page 64: ...cation is no the r option is not part of the command Node number This is the node number the extension node logically occupies in the RS 6000 SP Note that this command only affects the SDR unless the r option is used The r option should be issued only if endefadapter has been executed for the extension node When the GRF is properly configured and powered on with the SP Switch Router Adapter inside...

Page 65: ...extension node r Reconfigure the extension node Specifies if the enadmin command is to be activated after the endefadapter command completes With this option the user does not have to explicitly issue the enadmin command If the specification is yes the r option is part of the command If the specification is no the r option is not part of the command Node number This is the node number the extensio...

Page 66: ...Actions to be performed on the extension node Either reset or reconfigure A reset is sent to the extension node SNMP Agent to change the target node to a down state not active on the SP Switch A reconfigure is sent to the extension node SNMP Agent to trigger reconfiguration of the target node which causes the SNMP Agent to request new configuration parameters from the SP extension node SNMP Manage...

Page 67: ...r value In SMIT this field is known as Sort Attribute t node_type Uses standard to list RS 6000 SP nodes or dependent If none is specified it displays standard and dependent In SMIT this field is known as Node Type N node_grp Restricts the query to the nodes belonging to the node group specified in node_grp If the node_grp specified is a system node group the G flag is implied attr value This oper...

Page 68: ...ibutes in the output p string Uses the string value in the output in place of an attribute that has no value t node_type Uses standard to list RS 6000 SP nodes or dependent If none is specified it displays standard and dependent In SMIT this field is known as Node Type attr value This operand is used to filter the output such that only nodes with attributes that are equivalent to the value specifi...

Page 69: ...nd functions as it does with normal nodes It was enhanced to support the depend node in the RS 6000 SP Efence This command functions as it does with normal nodes in the RS 6000 SP In addition the dependent node can be fenced from the SP Switch with autojoin like any other standard RS 6000 SP node Eunfence This command functions as it does with normal nodes in the RS 6000 SP In addition the depende...

Page 70: ...Figure 20 we show the changes made to Perspectives because of the introduction of the IP Node The changes are restricted to the Hardware and System Partition Aid Perspectives Figure 20 Hardware Perspectives This figure shows the Hardware Perspectives which can be started using the command perspectives and selecting the Hardware icon Alternatively it can be started directly via the command sphardwa...

Page 71: ...node number would be In this figure the IP Nodes are 7 14 and 15 When switch_responds is monitored it shows the IP Node in two states Green when working with the SP Switch Marked with a red cross when fenced or not operating due to hardware or configuration problems In the figure IP Node 7 and 15 are working while IP Node 14 is down 2 4 4 1 Action Menu In Figure 21 on page 54 we see that IP Node 7...

Page 72: ... Fence Unfence This will bring up another window to allow us to either fence or unfence an IP Node If we are fencing the IP Node we can use the option of autojoin Create Node Group This will bring up another window to allow us to add the RS 6000 SP nodes to a Node Group This action does not affect the IP Node even though it is selectable 3 Digit Display 1 2 3 4 ...

Page 73: ...the Icon View In this view the IP Node icons are always located after all the standard RS 6000 SP node icons The results of monitoring the IP Nodes and the icon labels are the same as those of Frame View mentioned in the previous figure 2 4 4 2 Hardware Notebook Figure 22 shows the IP Node hardware notebook This notebook can be triggered by selecting the Notebook icon on the Hardware Perspective t...

Page 74: ...p port Switch partition number Switch responds The All Dynamic Resource Variables tab only shows the state of the Switch Responds and the Monitored Conditions tab only shows the value of the Switch Responds if it is being monitored 2 4 4 3 System Partition Aid Perspectives The System Partition Aid Perspectives window in Figure 23 on page 57 has two panes the Nodes pane and the System partitions pa...

Page 75: ...pt for the System Partition Notebook discussed in the next figure all other actions though selectable do not apply to the IP Node 2 4 4 4 System Partition Aid Notebook Figure 24 on page 58 shows the IP Node System Partition Aid Notebook This notebook can be triggered by selecting the Notebook icon on the Hardware Perspective toolbar 2 or selecting Action Nodes View on the menu bar 1 The notebook o...

Page 76: ...de SNMP manager is an SNMP manager administered by the System Resource Controller The purpose of the SNMP manager is to communicate with the SNMP agent on the GRF The SNMP manager and the agent adhere to Version 1 of the SNMP protocol The SNMP manager sends configuration data for an extension node to the SNMP agent on the GRF The SNMP agent applies the configuration data to the SP Switch Router Ad...

Page 77: ...ns of trap messages sent by the GRF agent to the SP Extension Node SNMP Manager A copy of the MIB is contained in the file usr lpp ssp config spmgrd ibmSPDepNode my on the Control Workstation Other SNMP managers in the network can query this MIB table to validate the configuration and status of the dependent node and GRF However only an SNMP manager using the correct SNMP community name can change...

Page 78: ... the switch node number ibmSPDepConfigStateThe six config states of the dependent node are notConfigured firmwareLoadFailed driverLoadFailed diagnosticFailed microcodeLoadFailed and fullyConfigured for use in configuring the adapter ibmSPDepSysNameThe syspar_name attribute in the Syspar class ibmSPDepNodeStateThe value of nodeUp or nodeDown to show the status of the dependent node ibmSPDepSwChipLi...

Page 79: ...er as the Primary node needs to perform some tasks for the dependent node and these functions are only available in PSSP 2 3 and higher PSSP versions The Primary Backup node of the SP Switch should be PSSP 2 3 or higher so that if the Primary node fails the dependent node can continue to function in the RS 6000 SP when the Backup node takes over PSSP 2 4 or PSSP2 3 and IX70649 on CWS Primary switc...

Page 80: ...e dependent node Only seven nodes are allowed in each partition as a single frame RS 6000 SP has only 16 SP Switch ports and two of them are used for the SP Switch router adapter one for each partition When the Primary switch node fails the Primary Backup Switch node take over as the new Primary switch node The new Primary Backup switch node selected from the current partition can be a node with a...

Page 81: ...se for coexistence with the addition of having at least one free SP Switch port per partition to connect to the SP Switch router adapter 2 5 Planning for the GRF Before acquiring any model of the SP Switch Router ensure that there are SP Switch ports available in the designated partition and that the switch used in the RS 6000 SP is the 8 port or 16 port SP Switch PSSP 2 4 CWS Ethernet Cable RS232...

Page 82: ...n the SP system If left blank a default name found in the SP Switch Router Adapter documentation is used CWS IP addressThe Control Workstation s IP address When a GRF contains multiple SP Switch router adapters that are managed by different SNMP managers on different RS 6000 SP CWS each of the Control Workstation IP addresses should be defined along with a different community name for each Control...

Page 83: ...e that the SP Extension Node SNMP Manager and the GRF s SNMP Agent will send in the corresponding field of the SNMP messages This value must match the value specified in the etc snmpd conf file on the GRF If left blank a default name found in the SP Switch Router Adapter documentation is used SP Extension Node SNMP Manager port The SNMP port number used by the SP Extension Node SNMP Manager to com...

Page 84: ...e of system failure of the primary router In either case each media card is hot swappable and autoconfigured after the initial install has been completed With its high port count on interfaces such as FDDI and Ethernet and its highly scalable performance the SP Switch Router provides a very cost effective solution With each media card you get a nearly linear scaling of performance with very little...

Page 85: ...bed were tested in our laboratory with the available hardware and software We used two RS 6000 SPs each consisting of a control workstation CWS and one frame with an SP Switch and several nodes see Figure 27 All nodes and the CWS were installed with AIX 4 3 1 and PSSP 2 4 Additionally a GRF1600 and a GRF400 running Ascend Embedded OS V1 4 6 4 were used Only static routing was applied in our tests ...

Page 86: ...68 IBM 9077 SP Switch Router Get Connected to the SP Switch ...

Page 87: ... cards The SP system manages the SP Switch Router Adapter card as a dependent node under the control of the SP SNMP Manager running on the SP Control Workstation and the Primary node of the SP Switch To learn more about dependent nodes see Chapter 1 Dependent Node on page 3 Once powered on and started up the SP Switch Router can be configured and managed remotely either via a site s administrative...

Page 88: ...Release 4 GC23 3897 3 1 Initial Configuration When a new unconfigured GRF is powered on an initial configuration script runs automatically You will be asked a series of questions about the configuration as shown in the following screen Next you are prompted to change the local password for root Changing the root password is the end of the configuration script If you need to change these parameters...

Page 89: ...l board Figure 29 on page 73 and Figure 30 on page 74 illustrate correct connections and proper setup The SP Switch Router s basic system parameters such as the IP address and host name were configured during the first power on configuration script You use the terminal or network to log in to the SP Switch Router August 22 14 18 31 grf16 kernel ge027 GRF Ethernet GRIT address 0 2 7 super super ls ...

Page 90: ... appropriate entries as follows Adding secure to a ttypX stanza opens it for Telnet so in this example only two Telnet sessions at a time were allowed Use the following command to connect to the SP Switch Router xterm sb geometry 80x65 e telnet hostname of SP Switch Router This gives you a large window with a scroll bar at the left so that you may retrieve information easier See Appendix B 1 root ...

Page 91: ...e media cards are in this redbook complete information is in the GRF Configuration Guide 1 4 GA22 7367 Standard Switch Cable of 10m Other Switch Cables 5 m f c 9305 10 m f c 9310 15 m f c 9315 20 m f c 9320 IP Switch Control Board Crosspoint Switch 10BaseT SP Switch Cable Grounding Cable PSSP 2 4 CWS Ethernet Cable RS232 Cable SP Switch ...

Page 92: ...nce of steps you have to complete 1 An installation overview of tasks involving the SP Switch Router the SP Switch Router Adapter card and the SP system 2 The configuration procedure for the PCMCIA 520 MB disk which also initiates system logging 3 A description of which cables to attach between the SP Switch Router and the SP control workstation and between the SP Switch Router Adapter card and th...

Page 93: ...aseT SP LAN However it can also be done through a connection to a network external to the SP 3 3 1 Installation Overview IBM support personnel who install the SP Switch Router 9077 perform the physical installation and minimal configuration described below with help from the customer s system administrator The system administrator must complete the following basic configuration steps 1 Locate all ...

Page 94: ...You can install the disk any time after the SP Switch Router is powered on and running Logging is not enabled until you install the disk and complete this configuration procedure Logged messages might be very helpful while you are configuring media cards The configuration is done only once to set up local logs and dumps and is not affected by software updates or system reboots System logs include ...

Page 95: ... mounted on mnt mkdir mnt crash mkdir mnt portcards cd var mv crash crash orig mv portcards portcards orig ln s var log portcards var portcards ln s var log crash var crash grsite perm portcards crash Device dev wd0a mounted on flash Device dev wd0a unmounted cd var log pax rw pe v mnt mnt mnt cron mnt daemon log mnt lastlog mnt maillog mnt messages mnt secure mnt wtmp mnt grclean log mnt mibmgrd ...

Page 96: ...pointing to files in var log The etc grclean conf file entries should look like the following The etc grclean logs conf file entries should look like the following err notice kern debug lpr auth info mail crit var log messages cron info var log cron local0 info var log gritd packets local1 info var log gr console local2 var log gr boot local3 var log grinchd log local4 var log gr conferrs local5 v...

Page 97: ...o the screen To stop grconslog use Ctrl C 3 4 Attaching SP Switch Router Cables Three types of cables must be attached The administrative Ethernet LAN cable The SP Switch Router Adapter card to SP Switch cable s The ground strap to the SP frame 3 4 1 Ethernet Cable Route the Ethernet twisted pair cable between the SP Switch Router unit and the Ethernet hub then connect the cable to the SP Switch R...

Page 98: ... both ends of the cable for bent pins When not connected keep the plastic caps on the ends 3 4 3 Procedure for Connecting Cards to the SP Switch This procedure connects the SP Switch Router Adapter card s to the SP Switch Before the SP Switch Router unit can begin full operation all other router media cards must be configured with appropriate customer configuration information Make sure you have l...

Page 99: ...h ends of the cable are firmly seated by pulling on them lightly At this point the SP Switch Router Adapter card configuration information must be entered on the SP CWS to enable the PSSP code and SP Switch to recognize the adapter These tasks are discussed in Section 3 5 Configuration Required on the SP System on page 81 3 5 Configuration Required on the SP System This section describes the SP Sw...

Page 100: ... node number the system administrator knows which SP frame Switch board and node slot corresponds to a dependent node Given this information you can determine which jack on the Switch board should be used by consulting the Switch Cable Charts for the SP Switch in RS 6000 SP Maintenance Information Volume 1 Installation and Customer Engineer Operations GC23 3903 Do not attempt to connect an SP Swit...

Page 101: ... Switch Frame n No Switch Frame n 1 Switch Frame n No Switch Frame n 1 No Switch Frame n 3 No Switch Frame n 2 Switch Frame n No Switch Frame n 2 No Switch Frame n 1 0 4 8 12 1 5 9 13 3 7 11 15 2 6 10 14 1 5 9 13 2 6 10 14 12 0 2 6 8 10 14 4 12 0 2 6 8 10 14 4 13 1 3 7 9 11 15 5 12 0 2 6 8 10 14 4 13 1 3 7 9 11 15 5 ...

Page 102: ...DRGetObjects DependentNode node_number n switch_node_number where n is the node_number of the dependent node you just got from the previous command This gives the following output 3 From the SP CWS determine the host name of the SP Switch primary node by entering splstdata s grep p primary The output looks like this Switch 3 Frame 4 49 53 57 61 Switch 1 Frame 1 2 10 14 4 8 12 16 1 5 9 13 3 7 11 15...

Page 103: ...the naming standard for RS 6000 SP components 3 6 Multiple Frames for Multiple System Connections SP Switch Router Adapter cards in an SP Switch Router can connect to different switch boards in the same SP system A configuration problem could arise in which the SP Switch Router Adapter cards are assigned the same node number if each card plugs into the same port position on each switch board The u...

Page 104: ...he steps required to configure an SP Switch Router Adapter media card 3 7 1 Configuration Files and Their Uses These are the configuration files found in etc on the SP Switch Router discussed in this chapter grifconfig conf identifies each logical interface on a media card snmpd conf enables SNMP capabilities grdev1 conf configures SP Switch Router Adapter cards Refer to GRF Reference Guide 1 4 GA...

Page 105: ...ostics and dump settings in profiles optional To change the defaults for one card change the settings in the appropriate Card profile to change the defaults for all installed SP Switch Router Adapter cards change the settings in the Dump and Load profiles 4 Run the dev1config command while logged into the SP Switch Router View the etc grdev1 conf file to verify configuration data For the SP Switch...

Page 106: ...P Switch Router s SNMP information Follow the procedure described in Chapter 2 How to configure SNMP of the GRF Configuration Guide 1 4 GA22 7366 Note that you must not remove the ALLOW and COMMUNITY public statements that are already in etc snmpd conf Here are excerpts from our etc snmpd conf file appropriate for the SP Switch Router connected to an SP system This configuration assumes that one S...

Page 107: ...s Remember that if you enter configuration information into SP Switch Router configuration files you will also need to access the SMIT panels and reenter information those panels require Refer specifically to the Managing Extension Nodes chapter in the RS 6000 SP Administration Guide Version 2 Release 4 GC23 3897 for information about setting up SNMP to monitor the SP Switch Router system and conf...

Page 108: ...ative Hostname grf16 msc itso ibm com SNMP Community Name spenmgmt Extension Node Identifier 03 SNMP Agent Hostname grf16 msc itso ibm com Reconfigure the extension node no Node Number 4 COMMAND STATUS Command OK stdout yes stderr no Before command completion additional instructions may appear below The endefnode command has completed successfully Enter Extension Node Adapter Information Type or s...

Page 109: ...structions may appear below The endefadapter command has completed successfully Topology File Annotator Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields Input Topology File Name etc SP expected top 1nsb 0isb 0 Output Topology File Name etc SP expected top annotated Save Output File to SDR yes s 16 1 tb3 3 0 E01 S17 BH J25 to E01 N4 Dependent Node ...

Page 110: ...STATUS Command OK stdout yes stderr no Before command completion additional instructions may appear below enadmin command sending a reconfigure request to the agent managing extension node 03 enadmin command response received from agent indicates requested action accepted for processing command complete root sp21en0 SDRGetObjects switch_responds node_number switch_responds autojoin isolated adapte...

Page 111: ... panels and reenter information those panels require Interface name The SP Switch Router interface name has five components that describe an individual interface in terms of its physical slot location in the chassis and its specific and virtual locations on a media card In the SP Switch Router the SP Switch Router Adapter card interface names look like this gt000 gt030 gt0a0 gt0f0 only the slot nu...

Page 112: ...n be entered in the netmask column or it can be left blank The connection of the SP Switch Router Adapter card to the SP system is point to multipoint When you assign an IP address to a logical interface on a point to point media such as HIPPI or ATM the destination address is entered in the broadcast address field Note that any entry in the broadcast address field for HIPPI or ATM makes it a poin...

Page 113: ...an handle Once discovered the host then sends only packets in sizes matching the reported maximum and so packets are not fragmented 3 10 3 Putting grifconfig conf Additions into Effect Additions made to etc grifconfig conf after first time installation take effect only after the file is reloaded and the media card reset Use the grreset command to reset each configured SP Switch Router Adapter card...

Page 114: ... storage use grwrite vn Note grwrite only saves files in the etc directory If you changed files in different directories use grsite and grsite perm respectively Use reboot i to reset the system 3 13 1 Saving Configuration Files Use the grwrite v command to save the configuration files in the etc directory from RAM to a flash device This preserves the configuration files over a reboot CARD 3 Interf...

Page 115: ... Router Adapter card The grreset command allows you to reset the card Note Output from logs and other system reporting functions refer to the SP Switch Router Adapter card as DEV1 DEV_V1 or dev1 3 14 1 Verify Media Card Operation Using ping Check SP Switch Router Adapter media card viability using the ping command This UNIX command is modified to support SP Switch Router board components This use ...

Page 116: ...h Router Adapter card as DEV1 DEV1_V1 or dev1 Here is a sample of the slot media and state information returned from the grcard command The SP Switch Router Adapter card resides in slot 3 and its state is reported as running Refer to the command descriptions in the GRF Reference Guide 1 4 GA22 7367 for a description of grcard and the meaning of the different media states ping c4 P grid 3 GRID ECHO...

Page 117: ...his prevents some unexpected behavior of the SP primary node Use the following command on the CWS Efence autojoin node_number With the autojoin flag set the SP Switch Router Adapter card is supposed to integrate automatically into the SP Switch network after a grreset command Without the autojoin flag Eunfence or Estart need to be issued Refer to the command section in the GRF Configuration Guide ...

Page 118: ...source addr dst addr 4 ECHOREPLY 192 168 14 1 10 10 1 13 48 UNREACH NEEDFRAG 192 168 14 4 192 168 14 15 3 TIMXCEED INTRANS 192 168 14 4 192 168 14 6 3 15 Bringing the SP Switch Router Adapter Card Online with the SP After the SP Switch Router Adapter media card completes initialization its state machine enters the Configured state The media card sends an up trap request to mib2d mib2d sends the SP...

Page 119: ...uide Version 2 Release 4 GC23 3899 for information on diagnosing extension node configuration problems The SP Switch Router Adapter media card remains in ConfigState FullyConfigured until it is brought online via a switch initialization or unfencing sequence Should the SwitchNodeUp trap message not reach the SP SNMP Manager use the grcard command to check the card s readiness and state The grcard ...

Page 120: ...om the SP CWS to the SP Switch Router administrative Ethernet address 5 Check the status of the SP Switch Router Adapter LEDs Use the tables in the SP Switch Router Adapter LEDs section in Appendix C to determine the state of the card Generally RX ST0 ST1 ERR and TX ST0 ST1 ERR indicate a problem The problem might be due to connection configuration hardware or software To further test the SP Switc...

Page 121: ...tion about configuration as related to the SP see RS 6000 SP Administration Guide Version 2 Release 4 GC23 3897 and RS 6000 SP Command and Technical Reference Version 2 Release 4 GC23 3900 For additional information on troubleshooting your configuration see RS 6000 SP Diagnosis and Messages Guide Version 2 Release 4 GC23 3899 ...

Page 122: ...Installation and Configuration 104 ...

Page 123: ... be best known all over the world and configuring this type of card is really straightforward this will was the easiest way to get interfaces other than switch connected to the GRF 4 1 1 Physical and Logical Interfaces Physical Interfaces The dual speed Ethernet media card provides either four or eight physical interfaces An interface can run in either full duplex or half duplex mode Additionally ...

Page 124: ... Identify each logical interface Edit etc grifconfig conf to identify each logical interface by assigning An IP address The GRF interface name A netmask as required A destination or broadcast address as required A Maximum Transmission Unit MTU if needed 2 Specify Ethernet card parameters in the card profile These are the configurable items in a card profile for an Ethernet media card all but the f...

Page 125: ...tings for one Ethernet card per interface make the change in the Card profile in the dump field For a detailed discussion of these steps refer to GRF Configuration Guide 1 4 GA22 7366 4 1 3 Installing Configurations or Changes In the command line interface CLI which you can recognize by its super prompt use set and write commands to install configuration parameters To save the files in the etc con...

Page 126: ...egotiation or Transfer Rate Set the negotiation or transfer rate in the ports ether field By default the setting for each interface is autonegotiate super read card 7 CARD 7 read super list ports 1 port_num 1 cisco hdlc off on 10 3 fddi single off sonet 1 sonet internal oscillator 0 207 hssi 0 16 bit ether autonegotiate hippi 1 32 no mode 999999 4 incremental 5 300 10 10 03 00 0f c0 disab super li...

Page 127: ...control board and require the card s slot number which you may find with the grcard command Prepare to use maint with the following steps First switch to maint s GR 66 prompt with the grrmb command At the GR66 prompt change to the prompt for the specific card you are interested in For a card in slot 7 this would be the command port 7 As a result the following message along with the changed prompt ...

Page 128: ...x 4 2 1 Physical and Logical ATM Interfaces Figure 37 shows the organization of physical and logical ATM interfaces on the ATM OC 3c media card Figure 37 ATM OC 3c Physical and Logical Interfaces Physical Interfaces The ATM OC 3c media card supports two physical interfaces each of which supports the assignment of 110 logical interfaces out of a range of 128 Logical Interfaces Logical interfaces pr...

Page 129: ...h physical interface The ATM OC 3c media card supports up to 1024 active VCs as defined in the ATM Forum UNI3 0 specification VCs can be divided between the two physical interfaces in any manner required by the site with 512 VCs active at any one time on each interface Each VC has an associated IP address VPI VCIs are assigned to logical interfaces in etc gratm conf and provide the bridge between ...

Page 130: ...tocols These protocols allow ATM devices to create or destroy connections in response to traffic demands The VPI VCI for a given SVC is determined at the time of the connection setup and thus requires no manual configuration in etc gratm conf However it is necessary to specify which of the UNI signaling standards UNI3 0 or UNI3 1 you wish to use and to assign an ARP server Both sides of the ATM li...

Page 131: ...ee GRF Configuration Guide 1 4 GA22 7366 Proceed as follows 1 Identify each logical interface Edit grifconfig conf to identify each logical interface by assigning An IP address The GRF interface name A netmask as required A destination or broadcast address as required An MTU if needed See Section 4 2 4 Assign IP Addresses grifconfig conf on page 114 for the details 2 Specify ATM card parameters in...

Page 132: ...IP Addresses grifconfig conf Edit the grifconfig conf file to assign an IP address to each logical ATM interface You can also provide other information about the logical IP network to which that interface is physically attached or specify a different MTU in the arguments field for example When you configure a logical interface on a point to point media such as ATM enter the destination IP address ...

Page 133: ...meters Changing the following profile is not mandatory You can safely use the defaults Refer to GRF Configuration Guide 1 4 GA22 7366 if you intend to change settings 4 2 6 Configuring PVCs To configure a logical interface that supports PVCs make entries in these configuration files 1 etc grifconfig conf Assign an IP address to the logical interface 2 etc grarp conf Supply IP to physical address m...

Page 134: ...tions we tested will be presented in Section 5 1 3 SP Switch ATM Connection on page 167 and Section 7 1 ATM OC 3c Backbone Connection on page 209 respectively 4 2 7 Some maint Commands for the ATM OC 3c Media Card The maint commands display a range of information about the media card The ATM OC 3c card has individual processors for the transmit and receive sides and two sets of maint commands One ...

Page 135: ...ds for the transmit side enter maint 101 The maint 3 command gives you useful options for looking at a variety of active interfaces To look at media information per port use maint 4 and the port number 0 or 1 Use maint 4 0 to see the information for the card s port 0 To display switch statistics use maint 5 which will give you information about the number of packets to and from the switch in the G...

Page 136: ...5 255 19 0 0 0 0 ga0180 LOCAL 10 10 1 0 255 255 255 0 7 0 0 0 0 bg0 BFWD 10 10 1 13 255 255 255 255 6 0 0 0 0 bg0 BLOCAL 10 10 1 255 255 255 255 255 5 0 0 0 0 bg0 BBCAST 127 0 0 0 255 0 0 0 4 0 0 0 0 inx 0 FWD 127 0 0 1 255 255 255 255 3 127 0 0 1 inx 0 RMS 192 168 4 0 255 255 255 0 10 0 0 0 0 inx 0 RMS 192 168 13 0 255 255 255 0 17 10 1 1 2 ga010 FWD 192 168 14 0 255 255 255 0 13 0 0 0 0 gt030 FW...

Page 137: ... addr dst addr icmpout last last last count type code source addr dst addr 4 3 ATM OC 12c Configuration This section provides information needed to configure the ATM OC 12c media card The GRF can be configured in point to point or point to multipoint ATM topologies with either switches or hosts The ATM OC 12c card is very similar to the OC 3c card introduced in Section 4 2 ATM OC 3c Configuration ...

Page 138: ...urations or Changes In the command line interface CLI use set and write commands to install configuration parameters To save the etc configuration directory use grwrite v Additionally when you enter configuration information or make changes you must also reset the media card with the command grreset slot_number for the change to take place 4 3 3 Configuration Files and Profiles The following steps...

Page 139: ...ve to define new traffic shapes and assign them to the interface and the PVC Hint Use gratm n ga0 slot_the_ATM_card_is_in to check for any errors in etc gratm conf The actual data for the configuration we tested will be presented in Section 7 2 ATM OC 12c Backbone One Port on page 222 4 4 FDDI Configuration This section provides information needed to configure the FDDI media card The card has four...

Page 140: ...red type A the blue type B or the green type M key inserts accordingly An unkeyed connector is of type S A single attach FDDI interface on the GRF is a master port when it directly connects to a workstation As shown in Figure 41 it is a slave port when connected to the master port of an FDDI concentrator which in turn connects to the slave ports of SAS workstations Figure 41 Master Slave Connector...

Page 141: ...o set interfaces 0 and 1 as DAS and do a write at the end to save the changes The following shows the path to change the setting of a port from SAS to DAS You have to exit from the prompt to the super prompt of the GRF and read card slot_number We assume the FDDI card seated in port 0 therefore the command is read card 0 The system responds with CARD 0 read super Now provide the lower number of th...

Page 142: ... super set single dual dual super cd port_num 0 cisco hdlc off on 10 3 fddi dual off sonet 1 sonet internal oscillator 0 207 hssi 0 16 bit ether autonegotiate hippi 1 32 no mode 999999 4 incremental 5 300 10 10 03 00 0f c0 disabled super list fddi single dual dual optical bypass off super super write CARD 0 written super You have to go through the same procedure again and replace references to por...

Page 143: ...GRF to remove itself from the dual ring during a failure or maintenance without causing the ring to wrap at upstream and downstream neighbors Should a GRF failure occur the bypass switch connects upstream and downstream neighbors on both the primary and secondary rings and allows the GRF node to remove itself from the ring gracefully while still retaining ring continuity A node failure without a b...

Page 144: ...s you distinct paths to every network and requires setting up routes If you are running a flat FDDI backbone and have the need to connect all four ports into it you must configure the card s interfaces to use transparent bridging thus bundling up the bandwidth of the four interfaces The actual steps to implement bridging will be covered later refer to Section 4 6 Configuring Bridging on page 142 4...

Page 145: ...ding to its location on the media card it may be from 0 3 Starting at the top of the media card each physical interface is numbered consecutively beginning with 0 as shown in Figure 47 on page 128 FDDI 0 3 2 1 FDDI 0 3 2 1 FDDI 0 3 2 1 FDDI 0 3 2 1 A0 B1 A1 B0 A0 B1 A1 B0 A0 B1 A1 B0 A0 B1 A1 B0 4 single attach 2 dual attach 1 dual 2 single attach 2 single 1 dual attach Card face plate numbers SAS...

Page 146: ... names are case sensitive and that you must use all lowercase Figure 48 GRF Interface Name for FDDI Interfaces The interface name and IP address are specified in the etc grifconfig conf file 4 4 5 Configuration Files and Profiles Following are the steps to configure FDDI cards They are listed here complete although you can bring up an FDDI connection with a subset For detailed information see GRF ...

Page 147: ...ew run time code in every FDDI card If you want to change the run time code in one FDDI card per physical interface make the change in the Card profile 4 Dump profile optional Global dump settings are in the Dump profile These settings are usually changed only for debug purposes The keep count field specifies how many dumps are compressed and stored at one time for each media card The default sett...

Page 148: ...guring SAS versus DAS on page 123 for quick help 4 4 8 Installing Configurations or Changes In the command line interface CLI which is the working environment on the GRF with the super prompt use the set and write commands to install configuration parameters onto the media card If you apply changes to files in the etc directory do not forget to issue grwrite v to have these changes written to flas...

Page 149: ...rompt port to the FDDI media card you are working with For example if you are working with a card in slot 0 enter port 0 at the GR 66 prompt The following message is returned along with the changed prompt Current port card is 0 GR 0 To leave any maint prompt and return to the shell enter quit Following are just a few maint commands we have found useful of course your needs may vary To obtain a lis...

Page 150: ... ga0180 LOCAL 10 10 1 0 255 255 255 0 7 0 0 0 0 bg0 BFWD 10 10 1 13 255 255 255 255 6 0 0 0 0 bg0 BLOCAL 10 10 1 255 255 255 255 255 5 0 0 0 0 bg0 BBCAST 127 0 0 0 255 0 0 0 4 0 0 0 0 inx 0 FWD 127 0 0 1 255 255 255 255 3 127 0 0 1 inx 0 RMS 192 168 4 0 255 255 255 0 10 0 0 0 0 inx 0 RMS 192 168 13 0 255 255 255 0 17 10 1 1 2 ga010 FWD 192 168 14 0 255 255 255 0 13 0 0 0 0 gt030 FWD 192 168 14 4 2...

Page 151: ...r dst addr icmpout last last last count type code source addr dst addr 3 TIMXCEED INTRANS 10 10 1 13 10 10 1 10 4 5 HIPPI Configuration This section provides the steps to configure the High Performance Parallel Interface HIPPI media card of a GRF 4 5 1 Introduction to HIPPI HIPPI poses interesting configuration problems because of the number of ways HIPPI connections can be established Several add...

Page 152: ...host can be transferred to any other IP capable media via IP routing Raw mode is HIPPI to HIPPI and is only used to transfer data from one HIPPI device to another HIPPI device The HIPPI I field tells the media card which type of connection is being requested So the toughest step in the configuration of a HIPPI media card is to compose the correct HIPPI I field 4 5 1 2 Starting a HIPPI Connection T...

Page 153: ...s available and to keep trying to make the connection 4 5 1 5 Path Selection Bits The path selection PS bits have four settings directing the HIPPI media card how to read the 24 bit destination address 00 Source Routing When the path selection is set to 00 that is source routing the HIPPI source has selected the exact route to the destination because the HIPPI host knows the specific path through ...

Page 154: ...s must be used IP connection An I field containing a special logical address and a PS 01 or PS 11 setting is used to establish an IP connection with a GRF HIPPI card In the I field the PS bits are set to 01 or 11 and bits 0 11 contain a designated destination logical address 0xfc0 that is mapped to slot 64 After the IP connection is established the data packets arriving at the GRF are routed to th...

Page 155: ...P connection data coming from a HIPPI I O channel is formatted into standard IP packets Embedded in the front of each IP datagram is the IP header The media card reads the header only if the information in the HIPPI I field indicates an IP connection The header contains the Internet address of the host sending the datagram and the Internet address of the target IP media host for which the datagram...

Page 156: ...o it The output media card just forwards the data unless it is a HIPPI card connected to a HIPPI switch In this case the output HIPPI card needs an I field to forward when it requests a HIPPI connection to the switch You need to supply the I field by editing the etc grarp conf file 4 5 1 11 HIPPI in a Bridging Environment HIPPI does not bridge On the GRF you can route IP to a bridge group from a H...

Page 157: ...nterfaces A logical interface is configured by its entry in the etc grifconfig conf file where it is assigned an IP address and netmask A logical interface is uniquely identified by its HIPPI interface name Interface Name The generic form of a HIPPI interface name is gh0x0 See Figure 50 for the naming conventions on the HIPPI card Figure 50 Components in the HIPPI Interface Name The interface name...

Page 158: ...ings Change run time binaries Change dump variables 4 Load profile optional Global executable binaries are set in the load profile in the hw table field These only change when you want to execute new run time code in every HIPPI card If you want to change the run time code in one HIPPI card per physical interface make the change in the Card profile in the load field 5 Dump profile optional Global ...

Page 159: ... the procedure to configure HIPPI cards and to close this chapter we would like to introduce some of the maint commands we found to be useful 4 5 6 Some maint Commands for the HIPPI Media Card The maint commands operate on the SP Switch control board and require the card s slot number which the grcard command provides Prepare to use maint with the following steps First switch to maint s GR 66 prom...

Page 160: ...ers are on anything other than the directly attached physical media The GRF implementation consists of the transparent bridging function described in 802 1d and does not include any capability for Source Route or Source Route Transparent SRT bridge operation Summary of bridging features Bridging on FDDI Ethernet and ATM OC 3c per the 802 1d standard Participation in 802 1d spanning tree protocol L...

Page 161: ...MAC address for any interface participating in the assigned bridge group the packet is submitted to the bridging engine for forwarding When the MAC address is a GRF MAC address the packet is forwarded to the GRF protocol forwarding engine for routing at the protocol layer 4 6 3 Configuration Options The GRF supports the configuration items specified in IEEE 802 1d A GRF functioning as a bridge wil...

Page 162: ...ckup links The spanning tree controls the bridge s flow of traffic over all potential links to prevent packet storms bridges repeating a packet or packets to each other without end 4 6 6 Bridge Filtering Table Media card bridge interfaces forward new MAC source addresses to the operating system for insertion in the global bridge filtering table that is maintained on the control board Each bridging...

Page 163: ...subsections discuss the various bridging components 4 6 9 1 Bridging Daemon Bridged The bridging daemon bridged is used to configure and manipulate bridging interfaces on the GRF It operates the spanning tree algorithm specified in IEEE 802 1d and ensures interoperability with other 802 1d bridges Bridged reads the etc bridged conf configuration file to build an initial bridging topology Bridged i...

Page 164: ...n Section 7 1 2 ATM OC 3c Backbone Using Two Ports on page 215 4 6 10 Management Tools A set of tools are provided to manage bridging primarily through bridged Brief descriptions are provided here more details are given in the GRF Configuration Guide 1 4 GA22 7366 These tools include the brstat command which displays relevant bridged status and bridging information and the brinfo command which dis...

Page 165: ...ve debugging and other situations where a simple checking of bridge port information is needed The brinfo command prints the list of bridge groups and bridge ports underlying interfaces that are members of the specified groups If no groups are specified all groups are reported on by default Remember that brinfo gets its information directly from the BSD kernel whereas brstat gets its information f...

Page 166: ...file does not exist The bridging daemon bridged will not start without this file The grstart program periodically checks to see if the etc bridged conf file exists when it finds the file grstart then starts bridged The following are the steps to configure bridging For more information refer to GRF Configuration Guide 1 4 GA22 7366 1 Create etc bridged conf A template file for etc bridged conf is p...

Page 167: ...dit command to open bridged conf and edit it bredit NetStar Id Configuration file for Bridge Daemon bridged Note bridged will not start if it finds an error while trying to parse this file Use the d option on the command line with bridged to find proximity of the offending line If you have not already copied etc bridged conf or if grstart cannot find the file you see this message Could not find de...

Page 168: ...51 Interface Name for FDDI Ethernet and ATM OC 3c Interfaces 4 6 11 3 Assign IP Addresses to Bridge Groups Assign an IP address to each bridge group in the etc grifconfig conf file name address netmask broad_dest argument bg0 192 168 1 1 255 255 255 0 bg2 192 168 2 1 255 255 255 0 gf022 222 222 80 2 255 255 255 0 ga030 222 222 02 4 255 255 255 0 Note A netmask entry is required for each bridge gro...

Page 169: ...ure the performance characteristics of ATM Virtual Circuits Traffic_Shape name myown_high_speed_high_quality peak 155000 sustain 155000 burst 2048 qos high 2 To configure a logical interface for bridging you create an Interface entry in the Interface section of the etc gratm conf file This entry must include the intended bridging method Specify it with the bridge_method keyword Here is a sample In...

Page 170: ...an LLC PVC PVC ga030 0 32 proto vcmux_bridge bpdu traffic_shape high_speed_high_quality 2 proto vcmux_bridge yyyy This type of PVC is used only for logical interfaces defined with bridge_method vc_multiplexed The PVC carries bridged traffic of a single type yyyy represents a second protocol qualifier required for the proto parameter This qualifier defines the type of bridged traffic the PVC can ca...

Page 171: ...affic LLC Encapsulated restricted to Ethernet Traffic shape Traffic_Shape name high_speed_high_quality peak 155000 sustain 155000 burst 2048 qos high Logical interface Interface ga030 traffic_shape high_speed_high_quality bridge_method llc_multiplexed broute_to_ether PVC PVC ga030 0 32 proto llc bridging Note Any IP routed traffic transmitted on the PVC will be encapsulated as an Ethernet frame VC...

Page 172: ...ntry would be ifname host hwaddr temp pub trail ga020 172 0 130 111 0 32 4 6 11 6 Installing Configuration Changes When you enter configuration information or make changes you must do a grwrite command to save the etc directory to permanent storage In the CLI or from the UNIX shell enter grwrite v You must also reset the media card for the changes to take place Type grreset slot_number Note We fou...

Page 173: ...he SP was connected to the FDDI switch or router with one or two FDDI adapters thus causing a bottleneck Now with the GRF connecting directly to the SP Switch the FDDI backbones can deliver their data at maximum speed See Section 5 1 4 2 SP Switch FDDI Connection with Bridging on page 179 for the setup 4 6 14 Bridging Ethernet What was discussed for FDDI applies to 100 Mbit s Ethernet backbones al...

Page 174: ...156 IBM 9077 SP Switch Router Get Connected to the SP Switch ...

Page 175: ...ce router See Figure 52 for details Five sample configurations that are common in customer environments were tested 1 SP Switch Ethernet Connection 2 SP Switch FDDI Connection 3 SP Switch ATM Connection 4 SP Switch FDDI Connection distinct backbones 5 SP Switch FDDI Connection ADSM environment Figure 52 One Card One SP Partition Sample Configuration 5 1 1 SP Switch Ethernet Connection This scenari...

Page 176: ...igning IP addresses strongly recommended If ARP is disabled on the SP Switch network the IP addresses assigned to the nodes must be determined by the Switch node numbers Refer to PSSP Planning Volume 2 Control Workstation and Software Environment for details Configuration A RS 6000 model F50 with a PCI Ethernet adapter card is connected to port 1 of an Ethernet media card in the GRF 1600 The GRF 1...

Page 177: ...ia card port 1 10 20 30 1 SP Switch Router Adapter card 1 192 168 14 4 SP processor nodes in SP21 192 168 14 1 192 168 14 15 0 f50 14 ping 10 20 30 50 PING 10 20 30 50 10 20 30 50 56 data bytes 64 bytes from 10 20 30 50 icmp_seq 0 ttl 255 time 13 ms 64 bytes from 10 20 30 50 icmp_seq 1 ttl 255 time 0 ms 64 bytes from 10 20 30 50 icmp_seq 3 ttl 255 time 0 ms C 10 20 30 50 PING Statistics 3 packets ...

Page 178: ...Exp Groups Route Tree for Protocol Family 2 Internet default 9 12 1 30 UG 4 288844 tr0 9 12 1 24 9 12 1 50 U 24 41728 tr0 10 1 1 24 10 1 1 3 U 0 0 at1 10 20 30 24 10 20 30 50 U 1 0 en0 127 8 127 0 0 1 U 5 753 lo0 192 168 14 24 10 20 30 1 UG 0 2889408 en0 1500 Route Tree for Protocol Family 24 Internet v6 1 1 UH 0 0 lo0 16896 0 f50 27 root sp21n01 netstat rn Routing tables Destination Gateway Flags...

Page 179: ...scenario we used ftp to conduct several file transfers of a 300 MB file from the F50 to the chosen nodes in SP21 We sent this file to dev null on the SP21 nodes to eliminate any hard disk influence on the receiver side 0 f50 29 ping 192 168 14 15 PING 192 168 14 15 192 168 14 15 56 data bytes 64 bytes from 192 168 14 15 icmp_seq 0 ttl 254 time 0 ms 64 bytes from 192 168 14 15 icmp_seq 1 ttl 254 ti...

Page 180: ...was installed according to Section 4 4 FDDI Configuration on page 121 and works properly The SP Switch Router Adapter card was installed according to Section 3 7 Step by Step Media Card Configuration on page 86 and works properly The SP Switch Router Adapter card and SP processor node Switch adapters are in the same IP subnet ARP should be enabled on the SP Switch network to provide the most flexi...

Page 181: ...is attached to the SP Switch of SP2 as shown in Figure 54 and Table 15 The netmask for all interfaces is 255 255 255 0 Figure 54 SP Switch FDDI Connection Table 15 shows the IP addresses used in our configuration Table 15 Configuration of an SP Switch FDDI Connection To successfully run this configuration no routes need to be set on the SP Switch Router Node 10 and the processor nodes in SP2 requi...

Page 182: ...gf000 10 2 1 2 255 255 255 0 mtu 4352 root sp21n10 netstat rn Routing tables Destination Gateway Flags Refs Use If PMTU Exp Groups Route Tree for Protocol Family 2 Internet default 192 168 4 137 UG 0 482 en0 10 2 1 24 10 2 1 1 U 1 22 fi0 127 8 127 0 0 1 U 8 894 lo0 192 168 4 24 192 168 4 10 U 8 603782 en0 192 168 13 24 10 2 1 2 UG 0 4985719 fi0 4352 192 168 14 24 192 168 14 10 U 1 576716 css0 Rout...

Page 183: ...witch Router media cards See Section 3 7 Step by Step Media Card Configuration on page 86 and Section 4 4 FDDI Configuration on page 121 and also the network adapters in the nodes Performance To get a rough overview of the data transfer rates that can be achieved in such a scenario we performed the following tests 1 We obtained of tsock program a derivative of the public domain ttcp program develo...

Page 184: ...in the screen shot the slow internal SCSI disks of the nodes in SP2 would not allow the transfer rate to exceed 4 5 MB s So we decided to start four ftp programs on four different nodes in SP2 We expected these four file transfers to sum up to an aggregate throughput of about 18 MB s over the net This would be beyond the throughput of an FDDI adapter so we expected to reach the limits of the FDDI ...

Page 185: ...er Adapter card and SP processor node Switch adapters are in the same IP subnet ARP should be enabled on the SP Switch network to provide the most flexibility in assigning IP Addresses strongly recommended If ARP is disabled on the SP Switch network the IP addresses assigned to the nodes must be determined by the Switch node numbers Note The SP Switch Router Adapter card will not properly forward ...

Page 186: ... lsdev C c adapter you are probably fine 2 To avoid any pitfalls set the signaling protocol for the ATM adapter to UNI3 0 as this is the default for the GRF and was probably not changed in the file etc gratm conf on the GRF You can check and look for a line where Signalling card is not commented with a It escapes our understanding why we had to bother with this anyhow as we could not set up and us...

Page 187: ... the next SMIT screen Change Show Characteristics of an ATM Adapter Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields ATM Adapter atm0 Description IBM PCI 155 Mbps ATM A Status Available Location 30 68 Enable ALTERNATE ATM MAC address no ALTERNATE ATM MAC address 0x0 Software Transmit Queue size 100 Minimum Guaranteed VCs Supported 32 Maximum Number of...

Page 188: ... field Automatically Discover Destination IP Address on its yes default there is no need to fill in the Destination IP Address After smitty is done you should be able to ping the at0 interface on the F50 You should also be able to ping the ga0180 port of the GRF Add a PVC for IP over an ATM Network Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields PVC ...

Page 189: ...0 1 2 1 10 1 2 1 56 data bytes 64 bytes from 10 1 2 1 icmp_seq 0 ttl 255 time 0 ms 64 bytes from 10 1 2 1 icmp_seq 1 ttl 255 time 0 ms 64 bytes from 10 1 2 1 icmp_seq 2 ttl 255 time 0 ms C 10 1 2 1 PING Statistics 3 packets transmitted 3 packets received 0 packet loss round trip min avg max 0 0 0 ms 0 f50 16 0 f50 26 netstat rn Routing tables Destination Gateway Flags Refs Use If PMTU Exp Groups R...

Page 190: ... UG 1 13501009 css0 9180 192 168 14 24 192 168 14 1 U 8 618178 css0 Route Tree for Protocol Family 24 Internet v6 1 1 UH 0 0 lo0 16896 root sp21n01 0 f50 29 ping 192 168 14 1 PING 192 168 14 1 192 168 14 1 56 data bytes 64 bytes from 192 168 14 1 icmp_seq 0 ttl 254 time 0 ms 64 bytes from 192 168 14 1 icmp_seq 1 ttl 254 time 0 ms 64 bytes from 192 168 14 1 icmp_seq 2 ttl 254 time 0 ms C 192 168 14...

Page 191: ...imum data transfer rate of an ATM connection 17 5 MB s 155 Mb s 2 We used ftp to conduct several file transfers of a 300 MB file from the F50 to the chosen nodes in SP21 We sent this file to dev null on the SP21 nodes to eliminate any hard disk influence on the receiver side As you see in the screen shot although the F50 has very fast disks attached they still limit the file transfer rate to 9 4 M...

Page 192: ... page 121 and works properly An SP Switch Router Adapter card has been installed according to Section 3 7 Step by Step Media Card Configuration on page 86 and works properly The SP Switch Router Adapter card and SP processor node Switch adapters are in the same IP subnet ARP should be enabled on the SP Switch network to provide the most flexibility in assigning IP Addresses strongly recommended If...

Page 193: ... interface in node 11 10 4 1 11 FDDI interface in node 12 10 2 1 12 SP Switch Router FDDI media card port A0 10 2 1 15 SP Switch Router FDDI media card port A1 10 3 1 16 SP Switch Router FDDI media card port B0 10 4 1 17 SP Switch Router FDDI media card port B1 10 5 1 18 SP Switch Router Adapter card 1 192 168 14 4 SP processor nodes in SP21 192 168 14 1 192 168 14 15 See Appendix A Laboratory Har...

Page 194: ...route to the SP Switch network of SP21 On node 9 in SP2 add this route route add net 192 168 14 netmask 255 255 255 0 mtu 4352 10 5 1 18 On node 10 in SP2 add this route route add net 192 168 14 netmask 255 255 255 0 mtu 4352 10 3 1 16 On node 11in SP2 add this route route add net 192 168 14 netmask 255 255 255 0 mtu 4352 10 4 1 17 On node 12 in SP2 add this route route add net 192 168 14 netmask ...

Page 195: ... gf003 10 5 1 18 255 255 255 0 mtu 4352 6 On GRF 1600 check whether all four port interfaces are created successfully Use netstat in and look for lines starting with gf000 gf001 gf002 or gf003 They must not have an asterisk beside the interface name If only gf000 appears examine if all IP addresses assigned to the four FDDI ports really from different subnets and change IP addresses or network mas...

Page 196: ...link3 8387 0 8387 0 0 lo0 1536 127 127 0 0 1 8387 0 8387 0 0 lo0 1536 GRIT 0 0x48 0 8387 0 8387 0 0 gf000 4352 link10 00 c0 80 89 2d f2 19 0 20 0 0 gf000 4352 10 2 1 24 10 2 1 15 19 0 20 0 0 gf001 4352 link20 00 c0 80 89 2d f3 12 0 12 0 0 gf001 4352 10 3 1 24 10 3 1 16 12 0 12 0 0 gf002 4352 link11 00 c0 80 89 2d f4 13 0 13 0 0 gf002 4352 10 4 1 24 10 4 1 17 13 0 13 0 0 gf003 4352 link12 00 c0 80 ...

Page 197: ...iminate any hard disk influence on the receiver side The slow internal SCSI disks in two of our four nodes in SP2 would not allow the transfer rate to exceed 4 5 MB s Both remaining nodes in SP2 contain faster SSA hard disks that allowed a transfer rate of 7 5 MB s Nevertheless this would not be enough to exceed the FDDI bandwidth So we decided to start several ftp programs on nodes in SP2 and SP2...

Page 198: ...d on the SP Switch network the IP addresses assigned to the nodes must be determined by the Switch node numbers Note The SP Switch Router Adapter card will not properly forward IP data to nodes assigned with an IP address that is in another subnet Configuration To build this scenario the FDDI interfaces of node 9 node 10 node 11 and node 12 in SP2 is connected to the SP Switch Router FDDI media ca...

Page 199: ...routing and bridging over one interface In this sample configuration no routes need to be set on the SP Switch Router Node 9 12 on SP2 and the processor nodes in SP21 require attention though Additionally the bridge group has to be configured To perform this configuration follow these steps 1 Configure the bridge group on the GRF 1600 Define the bridge group Open the file etc bridged conf with bre...

Page 200: ...er releases The new bridge settings are enabled but the commented interface definitions are not removed from the kernel In this case you will receive error messages because the bridge daemon cannot add the interfaces to the bridge group as long as IP addresses are assigned to them Therefore reboot i is needed 2 Check for correct bridge interface creation on GRF 1600 grf16 root netstat in Name Mtu ...

Page 201: ...ting tables Destination Gateway Flags Refs Use If PMTU Exp Groups Route Tree for Protocol Family 2 Internet default 192 168 3 37 UG 1 212 en0 10 10 1 24 10 10 1 9 U 1 189 fi0 127 8 127 0 0 1 U 8 444 lo0 192 168 3 24 192 168 3 9 U 8 232781 en0 192 168 13 24 192 168 13 9 U 1 169010 css0 192 168 14 24 10 10 1 13 UG 0 0 fi0 4352 Route Tree for Protocol Family 24 Internet v6 1 1 UH 0 0 lo0 16896 root s...

Page 202: ...cabling the configuration of SP the Switch Router media cards See Section 3 7 Step by Step Media Card Configuration on page 86 and Section 4 4 FDDI Configuration on page 121 and also the network adapters in the nodes Performance To get a rough overview of the data transfer rates that can be achieved in such a bridging scenario we again used ftp to transfer several 300 MB files from different nodes...

Page 203: ...that is close to the maximum theoretical transfer rate of 4x12 5 MB s 50 MB s Every node s FDDI interface contributed an overall transfer rate of about 11 MB s sending and receiving The limiting factor once again was the CPU on the four nodes in SP2 that was not able to handle more data simultaneously 100 busy as seen with monitor We could not find any significant influence of bridging on the meas...

Page 204: ...nfiguration The configuration of this scenario is exactly as described in Section 5 1 4 2 SP Switch FDDI Connection with Bridging on page 179 Just one additional step has to be carried out as follows 1 Open usr lpp adsm bin dsm sys 2 Change the parameter TCPServeraddress to the IP address of the Switch interface of node 1 TCPServeraddress 192 168 14 1 Performance To get a rough overview of the dat...

Page 205: ...nded Figure 59 Connecting One SP Switch with Two SP Switch Router Adapter Cards Table 19 shows the IP addresses used in our configuration Table 19 Configuration of a Dual SP Switch Router Connection Configuration To establish this scenario both SP Switch Router Adapter cards have to be configured correctly We installed them according to Section 3 7 Step by Step Media Card Configuration on page 86 ...

Page 206: ...o the following 1 See if the SP Switch Router Adapter cards show up green in perspectives or use SDRGetObjects switch_responds Use Eunfence if needed 2 Issue a ping to both SP Switch Router Adapter cards from any node of SP21 If any errors occur check cabling the configuration of the SP Switch Router Adapter cards especially subnet mask setting and also the network adapters in the nodes root sp21n...

Page 207: ...ossible and existing login sessions do not accept any command The router itself works fine but no changes in router configuration can be made A workaround is to fence one SP Switch Router Adapter card for maintenance work This problem should be solved in Ascend Embedded OS 1 4 8 Nevertheless the possibility to choose which SP Switch Router Adapter card should route outgoing traffic allows a certai...

Page 208: ...ia Card Configuration on page 86 and Section 5 2 1 Configuration of a Dual SP Switch Router Connection on page 187 and both work properly ARP should be enabled on the SP Switch network to provide the most flexibility in assigning IP Addresses strongly recommended The HIPPI connection is correctly installed and works refer to Section 7 3 HIPPI Backbone Connection on page 227 We do not care about HI...

Page 209: ...92 168 14 4 255 255 255 128 SP Switch Router Adapter card 2 192 168 14 129 255 255 255 128 SP Switch Router Adapter card 3 192 168 13 4 255 255 255 0 Node 1 in SP2 192 168 13 1 255 255 255 0 Node 6 in SP21 192 168 14 6 255 255 255 0 Node 8 in SP21 192 168 14 8 255 255 255 0 Node 10 in SP21 192 168 14 130 255 255 255 0 root sp2n01 netstat rn Routing tables Destination Gateway Flags Refs Use If PMTU...

Page 210: ... 255 255 255 0 mtu 65280 192 168 14 129 root sp21n06 netstat rn Routing tables Destination Gateway Flags Refs Use If PMTU Exp Groups Route Tree for Protocol Family 2 Internet default 192 168 4 137 UG 0 14 en0 127 8 127 0 0 1 U 8 402 lo0 192 168 4 24 192 168 4 6 U 6 100681 en0 192 168 13 24 192 168 14 4 UG 0 0 css0 65280 192 168 14 24 192 168 14 6 U 2 9973 css0 Route Tree for Protocol Family 24 Int...

Page 211: ...h interface of node 1 in SP2 for example root sp21n10 netstat rn Routing tables Destination Gateway Flags Refs Use If PMTU Exp Groups Route Tree for Protocol Family 2 Internet default 192 168 4 137 UG 0 19 en0 10 2 1 24 10 2 1 1 U 0 8 fi0 127 8 127 0 0 1 U 8 414 lo0 192 168 4 24 192 168 4 10 U 6 101692 en0 192 168 13 24 192 168 14 129 UG 0 0 css0 65280 192 168 14 24 192 168 14 10 U 3 10936 css0 Ro...

Page 212: ...k at our complex configuration Figure 60 on page 190 What happens when our three chosen nodes in SP21 ping node 1 in SP2 The next three figures take a close look at the IP traffic flow All three figures contain a simplified illustration of our complex configuration Figure 60 on page 190 Figure 61 on page 195 shows the IP traffic flow when issuing the ping 192 168 13 1 on node 6 in SP21 All packets...

Page 213: ... 1 in SP2 The way back follows the same route The SP Switch Adapter card with IP address 192 168 14 129 has no problem delivering IP packets to node 10 that is in the same subnet Figure 62 IP Traffic Flow When Issuing ping 192 168 13 1 on Node 10 192 168 13 1 255 255 255 0 192 168 14 129 255 255 255 128 node 1 node 6 SP Switch Adapter SP Switch Adapter SP Switch Adapter HIPPI HIPPI GRF 400 GRF 160...

Page 214: ... is the only way to IP address 192 168 14 8 Figure 63 IP Traffic Flow When Issuing ping 192 168 13 1 on Node 8 5 2 3 Recovery Procedure for an SP Switch Adapter Card Failure What happens when one of the SP Switch Adapter cards fails A detailed look at Figure 61 Figure 62 and Figure 63 gives an answer 1 When the SP Switch Adapter card with IP address 192 168 14 4 fails neither node 6 nor node 8 can...

Page 215: ...esses for example grf16 root grarp 192 168 14 129 0 192 168 14 129 at 0 0 0 0 0 f 0 192 168 14 4 at 0 0 0 0 0 f Both IP addresses have to show the same physical SP Switch address 5 3 Multiple SP Partition and Multiple SP Switch Router Adapter Cards A partitioned RS 6000 SP has some advantages It is possible to separate production and development systems that is test new software in one partition w...

Page 216: ...ns Although not necessary when you simply partition your SP it is required that every partition in effect form in a single subnet to establish a connection via an SP Switch Router All other subnetting does not work ARP should be enabled on the SP Switch network to provide the greatest flexibility in assigning IP addresses strongly recommended Figure 64 Partition to Partition Connection with an SP ...

Page 217: ...2 168 13 128 netmask 255 255 255 128 mtu 65520 192 168 13 4 Adapter IP Address Netmask SP Switch Router Adapter card 1 192 168 13 4 255 255 255 128 SP Switch Router Adapter card 2 192 168 13 129 255 255 255 128 Node 11 in SP2 192 168 13 130 255 255 255 128 Node 12 in SP2 192 168 13 131 255 255 255 128 Node 15 in SP2 192 168 13 132 255 255 255 128 All other processor nodes in SP2 192 168 13 1 192 1...

Page 218: ... interface of any node in partition 1 in SP2 for example On any node in partition 1 in SP2 ping the SP Switch interfaces of any node in partition 2 in SP2 for example root sp2n01 netstat rn Routing tables Destination Gateway Flags Refs Use If PMTU Exp Groups Route Tree for Protocol Family 2 Internet default 192 168 3 37 UG 0 30 en0 127 8 127 0 0 1 U 8 397 lo0 192 168 3 24 192 168 3 1 U 8 86147 en0...

Page 219: ... the nodes Performance We did no performance measurement for this scenario This setup is rather similar to the one described in Section 6 1 RS 6000 SP Switch RS 6000 SP Switch Connection on page 203 There is no good reason why these scenarios should achieve a different data transfer rate So we expect a data transfer rate of about 80 MB s between the partitions as before root sp2n01 ping 192 168 13...

Page 220: ...202 IBM 9077 SP Switch Router Get Connected to the SP Switch ...

Page 221: ...itch cable length limit of 20m this scenario is only applicable when both SPs have a maximum distance of 40m In all other cases you will need two routers and a corresponding high speed connection refer to Chapter 7 Multiple RS 6000 SPs and Multiple GRFs on page 209 Configuration assumptions Both SP Switch Router Adapter cards have been installed according to Section 3 7 Step by Step Media Card Con...

Page 222: ...disabled on the SP Switch network the IP addresses assigned to the nodes must be determined by the switch node numbers Note The SP Switch Router Adapter card will not properly forward IP data to nodes assigned with an IP address that is in another subnet Configuration To establish this scenario on the GRF 1600 an SP Switch Router Adapter card slot 4 is attached to the SP Switch of SP2 a second car...

Page 223: ...at rn Routing tables Destination Gateway Flags Refs Use If PMTU Exp Groups Route Tree for Protocol Family 2 Internet default 192 168 4 137 UG 0 515 en0 10 1 1 24 192 168 14 4 UG 0 65 css0 10 10 1 24 192 168 14 4 UG 0 2 css0 4352 10 50 1 24 192 168 14 4 UG 0 37 css0 127 8 127 0 0 1 U 8 518 lo0 192 168 4 24 192 168 4 1 U 10 345052 en0 192 168 13 24 192 168 14 4 UG 0 1360145 css0 65280 192 168 14 24 ...

Page 224: ...ved between the SPs we again used ftp to transfer several 300MB files from different nodes in SP2 to several nodes in SP21 We sent these files to dev null to eliminate any hard disk influence on the receiver side The requisites for this test are the same as described in Section 5 1 4 1 SP Switch FDDI Connection without Bridging on page 174 We started ftp transfers on all available nodes of SP2 and...

Page 225: ...tch FDDI Connection on page 162 Section 5 1 3 SP Switch ATM Connection on page 167 and Section 5 1 4 SP Switch FDDI Connection Distinct FDDI Networks on page 174 In an extended network resources are always rare This scenario might help to share these resources between several SPs and at the same time to connect these SPs with a high speed connection see Figure 66 Figure 66 Sharing Network Resource...

Page 226: ...ch Router Get Connected to the SP Switch interference between data transfers from each SP to different SP Switch Router Adapter media cards except the one caused by limited bandwidth of the different network types FDDI ATM ...

Page 227: ... Two SPs with Two SP Switch Routers 7 1 ATM OC 3c Backbone Connection As introduced in Section 4 2 ATM OC 3c Configuration on page 110 an ATM media card has two ports on it So why would one use only one of them to connect two GRFs Remember the GRF is a router and as such expects every port on any media card to be in a different network logical or physical otherwise there would be no need to route ...

Page 228: ...ounds promising and will be covered in Section 7 1 2 ATM OC 3c Backbone Using Two Ports on page 215 Be prepared for a surprise 4 Configure dynamic routing and use the open shortest path first OSPF protocol to use the two ATM ports equivalently They have to be in different subnets but gated will take care of that Configuring gated is said to be a non trivial task and once running it might well turn...

Page 229: ...s port 00 The GRF 400 in turn is attached to the SP Switch of SP2 as shown in Figure 68 and Table 23 on page 212 The netmask for all interfaces is 255 255 255 0 Figure 68 SP Switch ATM SP Switch Connection Table 23 on page 212 shows the IP addresses used in our configuration SP Switch Router 1 GRF 400 SP Switch Router Adapter card 1 SP Switch 1 SP2 SP processor node SP processor node IP 192 168 13...

Page 230: ...155000 burst 2048 qos high Interface ga010 traffic_shape high_speed_high_quality PVC ga010 0 132 proto ip traffic_shape high_speed_high_quality 2 The file etc grifconfig conf has the following entries gt030 192 168 14 4 255 255 255 0 mtu 65520 ga010 10 1 1 1 255 255 255 0 mtu 9180 3 The file etc grroute conf has the following line 192 168 13 0 255 255 255 0 10 1 1 2 This will set the correct route...

Page 231: ...1 the following route needs to be set route add net 192 168 13 netmask 255 255 255 0 mtu 9180 192 168 14 4 6 On the nodes in SP2 the following route needs to be set route add net 192 168 14 netmask 255 255 255 0 mtu 9180 192 168 13 4 The above command should be given in one line the is to show where the line break occurred during printing To avoid any pitfalls set the MTU size explicitly to the si...

Page 232: ...8 14 4 UG 0 12456 css0 9180 sp21n06 192 168 13 24 192 168 14 4 UG 0 15 css0 9180 sp21n07 192 168 13 24 192 168 14 4 UG 0 731470 css0 9180 sp21n08 192 168 13 24 192 168 14 4 UG 0 0 css0 9180 sp21n09 192 168 13 24 192 168 14 4 UG 0 1533484 css0 9180 sp21n10 192 168 13 24 192 168 14 4 UG 0 643863 css0 9180 sp21n11 192 168 13 24 192 168 14 4 UG 0 1460254 css0 9180 sp21n13 192 168 13 24 192 168 14 4 UG...

Page 233: ...ection between two SP systems 7 1 2 ATM OC 3c Backbone Using Two Ports This setup is basically the same as using just one port of the ATM card as described in Section 7 1 1 ATM OC 3c Backbone Using One Port on page 210 To avoid the difficulties regarding the need of different sub networks on the two ports we decided to use the GRF bridging implementation as described in GRF Configuration Guide 1 4...

Page 234: ...nf Remarks The data from bridge_group bg0 used in Section 5 1 4 2 SP Switch FDDI Connection with Bridging on page 179 was commented out for our convenience Up to 16 bridge groups are allowed on a GRF Adapter IP Address SP Switch Router Adapter card 1 192 168 13 4 SP Switch Router ATM media card port 00 in GRF 400 10 1 1 2 SP Switch Router ATM media card port 00 in GRF 1600 10 1 1 1 SP Switch Route...

Page 235: ...needs to be put in The netmask entry is mandatory for bridge_group entries 3 Finally bridging requires these entries in the etc gratm conf file Traffic_Shape name high_speed_high_quality peak 155000 sustain 155000 burst 2048 qos high This entry remains the same as in the basic configuration Interface ga010 traffic_shape high_speed_high_quality bridge_method llc_encapsulated Interface ga0180 traffi...

Page 236: ...be commented out and the line for bg1 bridge_group needs to be put in The netmask entry is mandatory for bridge_group entries 3 Finally bridging requires four entries in the etc gratm conf file Traffic_Shape name high_speed_high_quality peak 155000 sustain 155000 burst 2048 qos high This following entries remains the same as is the basic configuration Interface ga020 traffic_shape high_speed_high_...

Page 237: ...port0 interface before so there was no need to change any routes on the SP2 or SP21 nodes Check for correct routing entry on all nodes in SP21 Check for correct routing entry on all nodes in SP2 root sp21cw0 dsh a netstat rn grep 192 168 13 sp21n01 192 168 13 24 192 168 14 4 UG 1 1020086 css0 9180 sp21n05 192 168 13 24 192 168 14 4 UG 0 12456 css0 9180 sp21n06 192 168 13 24 192 168 14 4 UG 0 15 cs...

Page 238: ...ransfers of a 300 MB file from the nodes in SP2 to one chosen node in SP21 and at the same time used ftp to conduct several file transfers of a 300 MB file from the nodes in SP21 to a chosen node in SP2 We sent the files to dev null on the receiving nodes to eliminate any hard disk influence We saw up to about 14 5 MB s with just one side sending data with all nodes sending and receiving we achiev...

Page 239: ...h a delay of about 10 seconds With port 1 having the same IP address this is fully transparent to any clients See the next screen shot for details grf16 root brstat Bridge Group bg1 Spanning Tree Enabled Designated Root 32768 00 c0 80 84 8c eb Bridge ID 32768 00 c0 80 96 38 68 Root Port ga010 Root Path Cost 10 Topology Change Detected No Root Max Age 20 Hello Time 2 Forward Delay 15 Bridge Max Age...

Page 240: ...Root Path Cost 10 Topology Change Detected No Root Max Age 20 Hello Time 2 Forward Delay 15 Bridge Max Age 20 Hello Time 2 Forward Delay 15 Hold Time 1 Path Desig Desig Desig Interface Port ID Con State Cost Cost Bridge Port ga010 128 1 No Disabled 10 ga0180 128 2 Yes Forwarding 10 0 32768 00 c0 80 84 8c eb 128 2 Dump snapshot finished at Mon Jun 15 20 01 51 1998 grf16 root brstat Bridge Group bg1...

Page 241: ...The SP Switch Router Adapter card will not properly forward IP data to nodes assigned with an IP address that is in another subnet Configuration In this scenario we have the SP Switch of SP21 connected to the GRF 1600 The GRF 1600 has its ATM OC 12c media card s port 00 connected to the GRF 400 ATM OC 12c media card s port 00 The GRF 400 in turn is attached to the SP Switch of SP2 as shown in Figu...

Page 242: ...igh_quality peak 622000 sustain 622000 burst 2048 qos high Interface ga020 traffic_shape bigg_speed_high_quality PVC ga020 0 132 proto ip traffic_shape bigg_speed_high_quality 2 The file etc grifconfig conf has the following entries gt030 192 168 14 4 255 255 255 0 mtu 65520 ga020 10 20 30 1 255 255 255 0 mtu 9180 3 The file etc grroute conf has the following line 192 168 13 0 255 255 255 0 10 20 ...

Page 243: ... the CWS and use Eunfence if needed 2 On the nodes in SP21 the following route needs to be set route add net 192 168 13 netmask 255 255 255 0 mtu 9180 192 168 14 4 3 On the nodes in SP2 the following route needs to be set route add net 192 168 14 netmask 255 255 255 0 mtu 9180 192 168 13 4 To avoid any pitfalls set the MTU size explicitly to the size of the ATM adapter Hint You must not use SMIT t...

Page 244: ... 168 14 4 UG 0 12456 css0 9180 sp21n06 192 168 13 24 192 168 14 4 UG 0 15 css0 9180 sp21n07 192 168 13 24 192 168 14 4 UG 0 731470 css0 9180 sp21n08 192 168 13 24 192 168 14 4 UG 0 0 css0 9180 sp21n09 192 168 13 24 192 168 14 4 UG 0 1533484 css0 9180 sp21n10 192 168 13 24 192 168 14 4 UG 0 643863 css0 9180 sp21n11 192 168 13 24 192 168 14 4 UG 0 1460254 css0 9180 sp21n13 192 168 13 24 192 168 14 4...

Page 245: ...00 MB s duplex connecting two GRFs with HIPPI media cards seems the fastest choice But then HIPPI cables are limited to a length of 25m Ascend provides and guarantees 50m cables Below are the steps to set up the HIPPI backbone connection with two GRF routers Configuration assumptions The SP Switch Router HIPPI media card has been installed according to Section 4 5 HIPPI Configuration on page 133 o...

Page 246: ...iguration a route to the distant SP Switch network has to be set on every SP Switch Router On the nodes of SP2 and SP21 respectively routes to the nodes of the distant SP have to be set Adapter IP Address SP Switch Router Adapter card 1 192 168 13 4 SP Switch Router HIPPI media card in GRF 400 10 50 1 2 SP Switch Router HIPPI media card in GRF 1600 10 50 1 1 SP Switch Router Adapter card 2 192 168...

Page 247: ...wing line 192 168 13 0 255 255 255 0 10 50 1 2 This sets the correct route to the other SP Switch network over the HIPPI interface automatically of course this route can also be set manually every time the GRF is rebooted 5 The SP Switch Router Adapter card is connected to the SP Switch and configured Check with SDRGetObjects switch_responds on the CWS and use Eunfence if needed On the GRF 400 HIP...

Page 248: ...ate etc rc routes shell script that is run only after an Estart or an Eunfence was issued or use some other mechanisms to have this route set only after the css0 interfaces on the SP nodes are up and running Setup is done now and every node in SP2 should now be able to ping every node in SP21 and vice versa 3 Check for correct routing entries on all nodes in SP21 4 Check for correct routing entrie...

Page 249: ...fer rates that can be achieved in this scenario the following test was performed 1 We used ftp to conduct several file transfers of a 300 MB file from the nodes in SP2 to one chosen node in SP21 and at the same time used ftp to conduct several file transfers of a 300 MB file from the nodes in SP21 to a chosen node in SP2 We sent the files to dev null on the receiving node to eliminate any hard dis...

Page 250: ...7 SP Switch Router Get Connected to the SP Switch We saw up to about 48 MB s with just one side sending data With all nodes sending and receiving we achieved a duplex throughput of about 54 MB s on the HIPPI port ...

Page 251: ...on information mentioned there refer to the following section if no other information is given A 1 Node and Control Workstation Configuration This section describes the basic node and CWS configuration used to establish the scenarios Table 27 on page 234 and Table 28 on page 235 contain a summary of all nodes in both RS 6000 SPs their types hostnames built in adapters and generally used IP address...

Page 252: ...ode 6 thin node 66 MHz sp21n06 ent0 css0 192 168 4 6 192 168 14 6 Node 7 thin node 66 MHz sp21n07 ent0 css0 192 168 4 7 192 168 14 7 Node 8 thin node 66 MHz sp21n08 ent0 css0 192 168 4 8 192 168 14 8 Node 9 thin node 66 MHz sp21n09 ent0 css0 192 168 4 9 192 168 14 9 Node 10 thin node 66 MHz sp21n10 ent0 css0 192 168 4 10 192 168 14 10 Node 11 wide node 66 MHz sp21n11 ent0 css0 192 168 4 11 192 168...

Page 253: ... 192 168 13 1 Node5 thin node 66 MHz sp2n05 ent0 css0 192 168 3 5 192 168 13 5 Node6 thin node 66 MHz sp2n06 ent0 css0 192 168 3 6 192 168 13 6 Node7 thin node 66 MHz sp2n07 ent0 css0 192 168 3 7 192 168 13 7 Node8 thin node 66 MHz sp2n08 ent0 css0 192 168 3 8 192 168 13 8 Node9 thin node 66 MHz sp2n09 ent0 css0 192 168 3 9 192 168 13 9 Node10 thin node 66MHz sp2n10 ent0 css0 192 168 3 10 192 168 ...

Page 254: ...0 GB SCSI Disk Drive Node 8 hdisk0 1 0 GB SCSI Disk Drive Node 9 hdisk0 hdisk1 1 0 GB SCSI Disk Drive 1 0 GB SCSI Disk Drive Node 10 hdisk0 hdisk1 1 0 GB SCSI Disk Drive 1 0 GB SCSI Disk Drive Node 11 hdisk0 hdisk1 hdisk2 hdisk3 hdisk4 2 0 GB SCSI Disk Drive 2 0 GB SCSI Disk Drive 2 0GB Serial Link Disk Drive 2 0GB Serial Link Disk Drive 2 0GB Serial Link Disk Drive Node 13 hdisk0 hdisk1 hdisk2 hd...

Page 255: ...7135 Disk Array Device 7135 Disk Array Device Node6 hdisk0 hdisk1 1 0 GB SCSI Disk Drive 1 0 GB SCSI Disk Drive Node7 hdisk0 hdisk1 1 0 GB SCSI Disk Drive 1 0 GB SCSI Disk Drive Node8 hdisk0 hdisk1 1 0 GB SCSI Disk Drive 1 0 GB SCSI Disk Drive Node9 hdisk0 hdisk1 1 0 GB SCSI Disk Drive 1 0 GB SCSI Disk Drive Node10 hdisk0 hdisk1 1 0 GB SCSI Disk Drive 1 0 GB SCSI Disk Drive Node11 hdisk0 hdisk1 hd...

Page 256: ...l Disk Drive SSA Logical Disk Drive SSA Logical Disk Drive Node14 hdisk0 hdisk1 hdisk2 hdisk3 hdisk4 hdisk5 hdisk6 hdisk7 hdisk8 1 0 GB SCSI Disk Drive 1 0 GB SCSI Disk Drive SSA Logical Disk Drive SSA Logical Disk Drive SSA Logical Disk Drive SSA Logical Disk Drive SSA Logical Disk Drive SSA Logical Disk Drive SSA Logical Disk Drive Node15 hdisk0 hdisk1 hdisk2 hdisk3 2 0 GB SCSI Disk Drive 2 0 GB...

Page 257: ... aixterm 4 3 1 0 AIXwindows aixterm Application X11 apps clients 4 3 1 0 AIXwindows Client Applications X11 apps custom 4 3 1 0 AIXwindows Customizing Tool X11 apps msmit 4 3 1 0 AIXwindows msmit Application X11 apps pm 4 3 1 1 AIXwindows Power Management GUI Utility X11 apps rte 4 3 1 0 AIXwindows Runtime Configuration Applications X11 apps util 4 3 1 0 AIXwindows Utility Applications X11 apps xt...

Page 258: ... S English X11 msg en_US Dt rte 4 3 0 0 AIX CDE Messages U S English X11 msg en_US apps aixterm 4 3 0 0 AIXwindows aixterm Messages U S English X11 msg en_US apps clients 4 3 0 0 AIXwindows Client Application Msgs U S English X11 msg en_US apps custom 4 3 0 0 AIXwindows Customizing Tool Msgs U S English X11 msg en_US apps pm 4 3 0 0 AIXwindows Power Mgmt GUI Msgs U S English X11 msg en_US apps rte...

Page 259: ...tm atmle 4 3 1 0 ATM LAN Emulation Client Support bos compat cmds 4 3 1 0 AIX 3 2 Compatibility Commands bos compat links 4 3 1 0 AIX 3 2 to 4 Compatibility Links bos content_list 4 3 1 0 AIX Release Content List bos data 4 3 0 0 Base Operating System Data bos diag com 4 3 1 0 Common Hardware Diagnostics bos diag rte 4 3 1 0 Hardware Diagnostics bos diag util 4 3 1 0 Hardware Diagnostics Utilities...

Page 260: ... Computing System 1 5 1 bos net nfs adt 4 3 0 0 Network File System Development Toolkit bos net nfs cachefs 4 3 1 1 CacheFS File System bos net nfs client 4 3 1 1 Network File System Client bos net nfs server 4 3 1 0 Network File System Server bos net ppp 4 3 1 0 Async Point to Point Protocol bos net tcp adt 4 3 1 0 TCP IP Application Toolkit bos net tcp client 4 3 1 1 TCP IP Client Support bos ne...

Page 261: ... 1 0 Device Driver Messages bos rte diag 4 3 1 0 Diagnostics bos rte edit 4 3 1 0 Editors bos rte filesystem 4 3 1 0 Filesystem Administration bos rte iconv 4 3 1 0 Language Converters bos rte ifor_ls 4 3 1 0 iFOR LS Libraries bos rte im 4 3 1 0 Input Methods bos rte install 4 3 1 1 LPP Install Commands bos rte jfscomp 4 3 1 0 JFS Compression bos rte libc 4 3 1 1 libc Library bos rte libcfg 4 3 1 ...

Page 262: ...r_gui 4 3 1 0 Network Install Manager GUI bos sysmgt nim spot 4 3 1 1 Network Install Manager SPOT bos sysmgt quota 4 3 1 0 Filesystem Quota Commands bos sysmgt serv_aid 4 3 1 1 Software Error Logging and Dump Service Aids bos sysmgt smit 4 3 1 1 System Management Interface Tool SMIT bos sysmgt sysbr 4 3 1 0 System Backup and BOS Install Utilities bos sysmgt trace 4 3 1 0 Software Trace Service Ai...

Page 263: ...es common IBM disk rte 4 3 1 0 Common IBM Disk Software devices common IBM ethernet rte 4 3 1 0 Common Ethernet Software devices common IBM fda diag 4 3 1 0 Common Diskette Adapter and Device Diagnostics devices common IBM fda rte 4 3 1 0 Common Diskette Device Software devices common IBM fddi rte 4 3 1 0 Common FDDI Software devices common IBM ktm_std diag 4 3 0 0 Common Keyboard Mouse and Tablet...

Page 264: ...are devices mca 8ef2 diag 4 3 1 0 Integrated Ethernet Adapter 8ef2 Diagnostics devices mca 8ef2 diag com 4 3 1 0 Common Integrated Ethernet Diagnostics devices mca 8ef2 rte 4 3 1 0 Integrated Ethernet Adapter 8ef2 Software devices mca 8ef3 diag 4 3 1 0 Integrated Ethernet Adapter 8ef3 Diagnostics devices mca 8ef3 rte 4 3 1 0 Integrated Ethernet Adapter 8ef3 Software devices mca 8ef4 diag 4 3 1 0 F...

Page 265: ...Adapter 8f97 Software devices mca 8f98 diag 4 3 0 0 Integrated Ethernet Adapter 8f98 Diagnostics devices mca 8f98 rte 4 3 1 0 Integrated Ethernet Adapter 8f98 Software devices mca 8f9d diag 4 3 1 0 LAN SCSI Adapter Diagnostics devices mca 8f9d rte 4 3 1 0 LAN SCSI Adapter devices mca 8fa2 diag 4 3 1 0 Token Ring High Performance Adapter 8fa2 Diagnostics devices mca 8fa2 rte 4 3 1 0 Token Ring High...

Page 266: ... 3 1 0 RAIDiant Array DA Device Diagnostics devices scsi scarray rte 4 3 1 0 7135 RAIDiant Array DA Device Software Support devices scsi ses diag 4 3 1 0 SCSI Enclosure Services Device Diagnostics devices scsi ses rte 4 3 1 0 SCSI Enclosure Device Software devices scsi tape diag 4 3 1 0 SCSI Tape Device Diagnostics devices scsi tape rspc 4 3 0 0 RISC PC SCSI Tape Device Software devices scsi tape ...

Page 267: ...3 0 0 LUM Compatibility Code Messages U S English ifor_ls msg en_US compat gui 4 3 0 0 LUM Compatibility GUI Messages U S English ipfx msg en_US rte 2 2 0 0 IPF Messages U S English ipfx rte 2 2 0 0 Information Presentation Facility Runtime perfagent server 2 2 31 1 Performance Agent Daemons Utilities perfagent tools 2 2 31 0 Local Performance Analysis Control Commands pkg_gd 4 3 1 0 Package Insta...

Page 268: ...4 3 0 0 IBM Network Color Printer printers ibm4312 rte 4 3 0 0 IBM Network Printer 12 printers ibm4317 rte 4 3 0 0 IBM Network Printer 17 printers ibm4320 rte 4 3 2 0 IBM InfoPrint 20 printers ibm4324 rte 4 3 0 0 IBM Network Printer 24 printers ibmNetColor attach 4 3 0 0 IBM Network Color Printer Attachment printers ibmNetPrinter attach 4 3 1 0 IBM Network Printer Attachment printers lex2380 3 rte...

Page 269: ... ssp css 2 4 0 1 SP Communication Subsystem Package ssp docs 2 4 0 0 SP man and info files ssp gui 2 4 0 1 SP System Monitor Graphical User Interface ssp ha 2 4 0 1 SP High Availability Services ssp ha_clients 2 4 0 0 SP High Availability Services Client ssp jm 2 4 0 0 SP Job Manager Package ssp perlpkg 2 4 0 0 SP PERL Distribution Package ssp pman 2 4 0 0 SP Problem Management ssp public 2 4 0 0 ...

Page 270: ...ager Client Server Support sysmgt websm icons 4 3 1 0 Web based System Manager Icons sysmgt websm rte 4 3 1 1 Web based System Manager Runtime Environment sysmgt websm ucf 4 3 1 0 Web based System Manager Container Framework sysmgt websm widgets 4 3 1 0 Web based System Manager Base Widgets xlC cpp 3 1 4 4 C for AIX Preprocessor xlC msg en_US cpp 3 1 4 2 C for AIX Preprocessor Messages en_US xlC m...

Page 271: ...ns of CWS and All Nodes Part 1 of 3 Parameters Value thewall 16384 sockthresh 85 sb_max 1310720 somaxconn 1024 clean_partial_conns 0 net_malloc_police 0 rto_low 1 rto_high 64 rto_limit 7 rto_length 13 inet_stack_size 16 arptab_bsiz 7 arptab_nb 25 tcp_ndebug 100 ifsize 8 arpqsize 1 ndpqsize 50 route_expire 0 strmsgsz 0 strctlsz 1024 nstrpush 8 strthresh 85 psetimers 20 psebufcalls 20 strturncnt 15 ...

Page 272: ...ts 1 ipforwarding 1 udp_ttl 30 tcp_ttl 60 arpt_killc 20 tcp_sendspace 327680 tcp_recvspace 327680 udp_sendspace 65536 udp_recvspace 655360 rfc1122addrchk 0 nonlocsrcroute 1 tcp_keepintvl 150 tcp_keepidle 14400 bcastping 1 udpcksum 1 tcp_mssdflt 1448 icmpaddressmask 0 tcp_keepinit 150 rfc1323 1 pmtu_default_age 10 pmtu_rediscover_interval 30 udp_pmtu_discover 0 tcp_pmtu_discover 0 ipqmaxlen 100 dir...

Page 273: ...gh I O traffic is expected on the SP Switch To increase both values to 5 MB as applied in all of our scenarios enter usr lib methods chgcss l css0 a spoolsize 5242880 a rpoolsize 5242880 For the changes to take effect the SP nodes must be rebooted Parameters Value ipignoreredirects 0 ipsrcroutesend 1 ipsrcrouterecv 1 ipsrcrouteforward 1 ip6srcrouteforward 1 ip6_defttl 64 ndpt_keep 120 ndpt_reachab...

Page 274: ...oftware level information refer to Table 32 on page 239 but note that no PSSP file sets are installed Table 49 contains the network options applied for the sample configurations Table 49 Network Options of 7025 F50 Part 1 of 3 Parameter Value thewall 16384 sockthresh 85 sb_max 1310720 somaxconn 1024 clean_partial_conns 0 net_malloc_police 0 rto_low 1 rto_high 64 rto_limit 7 rto_length 13 inet_stac...

Page 275: ...e 1 subnetsarelocal 1 maxttl 255 ipfragttl 60 ipsendredirects 1 ipforwarding 0 udp_ttl 30 tcp_ttl 60 arpt_killc 20 tcp_sendspace 327680 tcp_recvspace 327680 udp_sendspace 9216 rfc1122addrchk 0 nonlocsrcroute 0 tcp_keepintvl 150 tcp_keepidle 14400 bcastping 0 udpcksum 1 tcp_mssdflt 512 icmpaddressmask 0 tcp_keepinit 150 rfc1323 1 pmtu_default_age 10 pmtu_rediscover_interval 30 udp_pmtu_discover 0 ...

Page 276: ... Depending on the scenario several SP Switch Router media cards were installed including Ethernet FDDI ATM OC 3c ATM OC 12c and HIPPI media cards Parameter Value ipqmaxlen 100 directed_broadcast 1 ipignoreredirects 0 ipsrcroutesend 1 ipsrcrouterecv 0 ipsrcrouteforward 1 ip6srcrouteforward 1 ip6_defttl 64 ndpt_keep 120 ndpt_reachable 30 ndpt_retrans 1 ndpt_probe 5 ndpt_down 3 ndp_umaxtries 3 ndp_mm...

Page 277: ...ware Configuration 259 The applied IP addresses vary with the scenario and are specified in the corresponding chapter For specific SP Switch Router sample configuration files refer to Appendix B GRF Configuration Files on page 261 ...

Page 278: ...260 IBM 9077 SP Switch Router Get Connected to the SP Switch ...

Page 279: ...d line interface CLI because most of the time when you log onto the GRF you will be working with a shell anyway CLI can be started with the command ncli Because the file root profile is not located in the etc directory it must be saved with the grsite command to be there after system reboot If you want the modified file to survive even software updates use grsite perm instead NOTE This file is con...

Page 280: ...ISUAL gimme a meaningful prompt UU export PS1 take care the following is a command substitution so this is a backtick that is a aingle quote host hostname s export host PS1 host PWD Look for a local profile local file owned by root and source it in if such a thing exists NOTE Do NOT put an exit statement in the profile local file Because we source it in an exit statement in profile local will caus...

Page 281: ...pt to see the information that pops up if you start sh within super cat etc motd or run sh within super UU NCLI usr nbin ncli if x NCLI then NCLI STATUS if STATUS eq 0 then exit 0 fi echo NCLI exited status STATUS continuing with SHELL elif f NCLI then echo Warning NCLI is not executable using SHELL else echo Warning NCLI is not found using SHELL fi end of commenting out the call to CLI UU fi B 2 ...

Page 282: ...the port This is the normal case multiple lines are ok eg port gf070 port gf041 gf072 port gf080 port gf000 gf001 gf002 gf003 If you need to set specific values for a port in this bridge group then use the structure below port gf040 priority port priority allows the network manager to influence the choice of port when a bridge has two ports connected in a loop priority 5 valid states are blocking ...

Page 283: ...t portion of a bridge ID A lower numerical value for bridge priority makes the bridge more likely to become the root priority 128 hello_time Interval between the transmission of configuration BPDUs by a bridge that is attempting to become the root bridge or is root bridge It is the timer that elapses between generation of configuration messages by a bridge that assumes itself to be the root Shorte...

Page 284: ...is too large the network will take longer then necessary to adjust to a new spanning tree after a topological event such as restarting or crashing of a bridge or link The recommended value is 20 sec maximum_age 20 seconds route_maximum_age This parameter determines how often routes will be aged out of the learnt route table Default 300 seconds route_maximum_age 300 seconds And last hardwiring the ...

Page 285: ... wd3a var log ufs rw 0 2 Example line to mount a remote file system in such a way that it will try to mount for a long time and is interuptable nfs_host home home nfs rw bg intr 0 0 B 5 etc grarp conf This file holds ARP information for distant interfaces that do not support inverse ARP NetStar Id grarp conf v 1 2 22 1 1997 05 09 17 35 00 jim Exp Template grarp conf file This file contains any har...

Page 286: ...o configure GigaRouter ATM interfaces Statements in this file are used to configure ATM PVC s signalling protocols arp services and traffic shapes gratm 8 uses this file as input when it is run by grinchd 8 whenever an ATM media card boots to configure the card gratm conf is divided into five sections The Service section is where ATM ARP services are defined entries defined in this section are ref...

Page 287: ... info Lines beginning with the keyword Service define virtual services which may or may not be present on an ATM network attached to a GigaRouter Each Service entry the ATM configuration file has the following format Service name value type arp bcast addr value addr value The name field is a unique name to identify this ATM service The type field specifies the type of ATM service being configured ...

Page 288: ... the value for burst is in cells maximum of 2048 The qos Quality of Service field specifies which rate queues to use A value of high corresponds to high priority service which uses the high priority rate queues and a value of low corresponds to low priority service which uses the low priority rate queues The peak rate is the only parameter which is mandatory If ommitted the sustain and burst rates...

Page 289: ...gnalling card 9 connector top protocol UNI3 1 Signalling card 9 connector bottom protocol NONE Signalling card a connector top protocol UNI3 1 Signalling card a connector bottom protocol NONE Interfaces Lines beginning with the keyword Interface define GigaRouter logical ATM interfaces The format of a logical interface definition is Interface ifname service service_name traffic_shape shape_name br...

Page 290: ...ce ga090 service arp0 traffic_shape high_speed_high_quality Interface ga0980 service net20 traffic_shape low_speed_high_quality Interface ga0a0 service arp0 traffic_shape high_speed_high_quality Interface ga0a80 service net20 traffic_shape low_speed_high_quality Interface ga091 traffic_shape high_speed_high_quality bridge_method llc_encapsulated broute_to_ether PVC s Lines beginning with the keywo...

Page 291: ...n VPI VCI the input_aal parameter may be used to specify the adaptation layer input_aal 3 specifies AAL 3 4 input_aal 5 specifies AAL 5 The optional traffic_shape parameter allows a traffic shape to be defined for this logical interface the shape_name must be a named defined as a Traffic_Shape above If no traffic shape is specified a default shape of 155Kbps high quality of service is used PVC ga0...

Page 292: ...80 0 148 proto ip OC 12c Interface ga020 traffic_shape bigg_speed_high_quality PVC ga020 0 132 proto ip traffic_shape bigg_speed_high_quality B 7 etc grclean conf This file contains the specifications on how to handle log file management on the GRF It includes the file etc grclean logs conf where the location of the log files in the filesystem is handled See Appendix B 8 etc grclean logs conf on p...

Page 293: ... keyword default what is it include filename name of another config file to act on hold 7 of archives kept local no keep arch in same place as logfile remove no remove logfile after archival arch none archive name ash none command to execute after archival bsh none command to execute before archival nsh none command to execute if no archival zip usr contrib bin gzip zip compress command zap usr co...

Page 294: ...le var log ftp log size 10000 logfile var log kerberos log size 10000 logfile var log lpd errs size 10000 logfile var log gritd packets size 150000 logfile var log gr console size 11000 logfile var log gr boot size 150000 logfile var log grinchd log size 10000 logfile var log gr conferrs size 25000 logfile var log mib2d log size 25000 logfile var tmp gated rip size 25000 logfile var log mibmgrd lo...

Page 295: ...ARD 0 Interface 0 2 21 1 1 1 1 00 Node Name 2 21 1 1 1 2 1 Node Number 2 21 1 1 1 3 00 00 00 00 00 00 00 00 00 00 Switch Token 2 21 1 1 1 4 2 Switch ARP 2 21 1 1 1 5 0 Switch Node Number 2 21 1 1 1 6 x0 0 0 0 IP Address 2 21 1 1 1 7 x0 0 0 0 Net Mask 2 21 1 1 1 8 1024 Max Link Pckt Len bytes 2 21 1 1 1 9 0 IP Host Offset 2 21 1 1 1 10 1 Configuration State 2 21 1 1 1 11 no name System Name 2 21 1 ...

Page 296: ... 06 00 01 Switch Token 2 21 4 1 1 4 2 Switch ARP 2 21 4 1 1 5 3 Switch Node Number 2 21 4 1 1 6 x192 168 14 4 IP Address 2 21 4 1 1 7 x255 255 255 128 Net Mask 2 21 4 1 1 8 1024 Max Link Pckt Len bytes 2 21 4 1 1 9 1 IP Host Offset 2 21 4 1 1 10 1 Configuration State 2 21 4 1 1 11 sp21en0 System Name 2 21 4 1 1 12 2 Node State 2 21 4 1 1 13 1 Switch Chip Link 2 21 4 1 1 14 31 Node Delay 2 21 4 1 1...

Page 297: ...1 no name System Name 2 21 7 1 1 12 2 Node State 2 21 7 1 1 13 0 Switch Chip Link 2 21 7 1 1 14 64 Node Delay cycles 2 21 7 1 1 15 1 Admin Status CARD 7 Interface 0 2 21 8 1 1 1 07 Node Name 2 21 8 1 1 2 1 Node Number 2 21 8 1 1 3 00 00 00 00 00 00 00 00 00 00 Switch Token 2 21 8 1 1 4 2 Switch ARP 2 21 8 1 1 5 0 Switch Node Number 2 21 8 1 1 6 x0 0 0 0 IP Address 2 21 8 1 1 7 x0 0 0 0 Net Mask 2 ...

Page 298: ...0 00 00 Switch Token 2 21 11 1 1 4 2 Switch ARP 2 21 11 1 1 5 0 Switch Node Number 2 21 11 1 1 6 x0 0 0 0 IP Address 2 21 11 1 1 7 x0 0 0 0 Net Mask 2 21 11 1 1 8 1024 Max Link Pckt Len bytes 2 21 11 1 1 9 0 IP Host Offset 2 21 11 1 1 10 1 Configuration State 2 21 11 1 1 11 no name System Name 2 21 11 1 1 12 2 Node State 2 21 11 1 1 13 0 Switch Chip Link 2 21 11 1 1 14 64 Node Delay cycles 2 21 11...

Page 299: ...e System Name 2 21 14 1 1 12 2 Node State 2 21 14 1 1 13 0 Switch Chip Link 2 21 14 1 1 14 64 Node Delay cycles 2 21 14 1 1 15 1 Admin Status CARD 14 Interface 0 2 21 15 1 1 1 14 Node Name 2 21 15 1 1 2 1 Node Number 2 21 15 1 1 3 00 00 00 00 00 00 00 00 00 00 Switch Token 2 21 15 1 1 4 2 Switch ARP 2 21 15 1 1 5 0 Switch Node Number 2 21 15 1 1 6 x0 0 0 0 IP Address 2 21 15 1 1 7 x0 0 0 0 Net Mas...

Page 300: ...h entry in this file has the following format name address netmask broad_dest arguments The name of a GigaRouter interface encodes the hardware type GigaRouter cage number slot number and interface number The first character must be g to specify a GigaRouter interface The second character is the hardware type of the interface a for ATM e for ETHERNET f for FDDI h for HIPPI p for PPP s for HSSI l i...

Page 301: ...ad notation An entry of a single hyphen may be specified for any of these fields as a place holder This may be useful e g if no netmask is desired but a broadcast or destination address must be specified in the next field For this release the broad_dest field specifies the broadcast IP address for Ethernet FDDI interfaces and the destination of a point to point ATM or HIPPI interface The arguments...

Page 302: ...68 4 72 255 255 255 0 mtu 1500 ge073 192 168 4 73 255 255 255 0 mtu 1500 ge074 192 168 4 74 255 255 255 0 mtu 1500 ge075 192 168 4 75 255 255 255 0 mtu 1500 ge076 192 168 4 76 255 255 255 0 mtu 1500 ge077 192 168 4 77 255 255 255 0 mtu 1500 gh080 10 50 1 1 255 255 255 0 mtu 65280 ga020 10 20 30 1 255 255 255 0 mtu 9180 B 11 etc grlamap conf This file contains the mapping of logical addresses to de...

Page 303: ...p procedures of the SP Switch Router NetStar Id grroute conf v 1 3 1995 03 15 22 09 07 knight Exp grroute conf configuration file for GigaRouter static remote routes This file should only contain routes to remote networks and hosts i e networks and hosts not directly attached to a GigaRouter interface Routes for networks directly attached to the GigaRouter are created as part of configuring the Gi...

Page 304: ...e etc hosts contains the correlation between IP addresses and hostnames Host Database This file should contain the addresses and aliases for local hosts that share this file It is used only for ifconfig and other operations before the nameserver is started 127 1 localhost 10 200 160 3 install1 venus 192 168 4 4 grf16 msc itso ibm com grf16 192 168 4 137 sp21en0 msc itso ibm com sp21cw0 B 14 etc in...

Page 305: ...oot usr libexec rlogind rlogind k eklogin stream tcp nowait root usr libexec rlogind rlogind k x kshell stream tcp nowait root usr libexec rshd rshd k Services run ONLY on the Kerberos server krbupdate stream tcp nowait root usr libexec registerd registerd kpasswd stream tcp nowait root usr libexec kpasswdd kpasswdd B 15 etc motd This file contains the greeting message of the system and within thi...

Page 306: ...tem startup echo n starting local daemons An example of starting a local daemon Uncomment replicate and modify as needed for your local daemons echo n local_daemon usr local bin local_daemon Terminate the pretty print list of local daemons we started echo Put other local customizations here Have to put this in here on demand See README for 1 4 6 4 sysctl w net inet ip fwdirbcast 1 Exit with a succ...

Page 307: ...CONTEXT oid USES SOURCE PARTY oid DESTINATION PARTY oid AND CONTEXT oid VIEW viewName INCLUDE EXCLUDE SUBTREE oid MASK bitmask ALLOW op op OPERATIONS sugar SOURCE PARTY partyName DESTINATION PARTY partyName AND CONTEXT contextName partyDefinition LOCAL PARTY name ON TRANSPORT transport AT addr AuthPriv AS oid transport snmpUDPDomain snmpCLNSDomain snmpCONSDomain snmpDDPDomain snmpIPXDomain rfc1157...

Page 308: ...ostname is defined in etc host portid PORT full ip ip ip traplist trap trap trap trap_name op ALL GET SET TRAP encrypt NO name rfc1449addr tcp_ip_addr osi_addr tcp_ip_addr ip osi_addr nsap tsel nsap hexes tsel hexes hexes hexbyte hexbyte ALLOW SUBAGENT 1 3 6 1 4 1 1080 1 1 1 WITH OTHER PASSWORD USE 15 SECOND TIMEOUT COMMUNITY public ALLOW GET OPERATIONS USE NO ENCRYPTION MANAGER 192 168 4 137 SEND...

Page 309: ...n grwrite v command to save your changes to etc syslog conf and etc hosts add the following lines to the etc syslog conf on your log server do not include the from the first column of this file ie add local5 var log mib2d log not local5 var Syslog configuration for syslog server systems GRF specific log files from GRF systems over the network local0 info var log gritd packets local1 info var log g...

Page 310: ... the log files can easily fill the RAM file system To uncomment remove disk from each line in this section Log messages to Disk err notice kern debug lpr auth info mail crit var log messages cron info var log cron local0 info var log gritd packets local1 info var log gr console local2 var log gr boot local3 var log grinchd log local4 var log gr conferrs local5 var log mib2d log local6 var log fred...

Page 311: ...own off tty02 usr libexec getty t9600 hf vt100 on secure tty03 usr libexec getty std 9600 unknown off ttyp0 none network secure ttyp1 none network secure ttyp2 none network secure ttyp3 none network secure ttyp4 none network secure ttyp5 none network secure ttyp6 none network ttyp7 none network ttyp8 none network ttyp9 none network ttypa none network ttypb none network ttypc none network ttypd non...

Page 312: ...network ttyre none network ttyrf none network ttys0 none network ttys1 none network ttys2 none network ttys3 none network ttys4 none network ttys5 none network ttys6 none network ttys7 none network ttys8 none network ttys9 none network ttysa none network ttysb none network ttysc none network ttysd none network ttyse none network ttysf none network ...

Page 313: ... provided for a quick reference in helping you to find out the correct Switch port numbers or the correct jack You will get some information about updating the IBM 9077 software and how to get updates C 1 The Front Panel of the SP Switch Router Adapter Card Operational Figure 72 shows the front panel of the Switch Router adapter Figure 72 Front Panel of the SP Switch Router Adapter Card with LEDs ...

Page 314: ...0 SP Switch SW XMIT This amber LED turns on when data is sent to the crosspoint switch through the serial daughter board TX HB This green LED blinks to show the heartbeat pattern for the transmit side CPU MD XMIT This amber LED turns on when data is transmitted from its media port RS 6000 SP Switch SW RCV This amber LED turns on when data is received from the crosspoint switch through the serial d...

Page 315: ...ter Media Card LEDs During Bootup RX TX HB green RX TX ST0 green RX TX ST1 amber RX TX ERR amber Description on on on on All LEDs are lit for 0 5 seconds during reset as part of onboard diagnostics off off off on Error condition checksum error is detected in flash memory on off on off Error condition SRAM fails memory test on off off on During loading HB and ST1 flash as each section of the code l...

Page 316: ...ielded tab connector ATM OC 3c Multimode Two 62 5 125 micron fiber optic cables Duplex SC transceiver ATM OC 3c Singlemode Two 9 125 micron fiber optic cables Duplex SC transceiver ATM OC 12c Multimode One 62 5 125 micron fiber optic cables Duplex SC transceiver ATM OC 12c Singlemode One 9 125 micron fiber optic cables Duplex SC transceiver 10 100 Base T Four Eight STP or UTP CAT5 cable RJ 45 FDDI...

Page 317: ...alling new operating software hereafter referred to as machine code for the SP Switch Router C 6 1 The SP Switch Router as an IBM Product As is noted in this Redbook the SP Switch Router is based on a product from Ascend Communications Inc IBM customers order and receive the SP Switch Router from IBM IBM provides all support for this product for IBM customers ...

Page 318: ...ned from the Ascend FTP site on the SP Switch Router Instructions on how to download new releases from the FTP site and install them are included in the Release Notes provided with each release Be sure to use the binary file transfer type C 6 3 Support for Code Installation The Release Notes are posted on the SP Service and Support web site when a new release becomes available As this is written t...

Page 319: ...o verify the installation use this command to check that the directed broadcast setting is now one of the sysctl executables sysctl net inet ip fwdirbcast net inet ip fwdirbcast 1 Note Be prepared that grf_update will reboot the SP Switch Router C 6 5 Sample Execution of grf_update Script Here is a sample transcript of a session in which the grf_update script first upgrades a GRF 1600 system testb...

Page 320: ...remote 1 4 6 ibm root gz 226 Transfer complete get Addendum pdf local Addendum pdf remote Addendum pdf 226 Transfer complete get RN1_4_6 pdf local RN1_4_6 pdf remote RN1_4_6 pdf 226 Transfer complete Performing grwrite Please wait Performing grfins Please wait Device dev wd0a mounted on flash Device dev wd0a unmounted The next release version after rebooting will be 1 4 6 ibm default Patch File cu...

Page 321: ...M GRF upgrade testbox site com is up to date testbox site com will be upgraded to Next Revision 1 4 6 ibm Version default Patch Revision 1 4 6 4 ibm WARNING testbox site com will now be REBOOTED to complete the upgrade 10 9 8 7 6 5 4 3 2 1 Continuing Shutdown NOW shutdown pid 5524 FINAL System shutdown message from netstar testbox site com System going down IMMEDIATELY System shutdown time has arr...

Page 322: ...304 IBM 9077 SP Switch Router Get Connected to the SP Switch ...

Page 323: ...rty rights may be used instead of the IBM product program or service Information in this book was developed in conjunction with use of the equipment specified and is limited in application to those specific hardware and software products and levels IBM may have patents or pending patent applications covering subject matter in this document The furnishing of this document does not give you any lice...

Page 324: ... may vary significantly Users of this document should verify the applicable data for their specific environment Reference to PTF numbers that have not been released through the normal distribution process does not imply general availability The purpose of including these reference numbers is to alert IBM customers to specific information relative to the implementation of the PTF when it becomes av...

Page 325: ... registered trademarks of Intel Corporation in the U S and other countries UNIX is a registered trademark in the United States and other countries licensed exclusively through X Open Company Limited Other company product and service names may be trademarks or service marks of others ...

Page 326: ...308 IBM 9077 SP Switch Router Get Connected to the SP Switch ...

Page 327: ...ther Publications These publications are also relevant as further information sources RS 6000 SP Administration Guide Version 2 Release 4 GC23 3897 RS 6000 SP Installation and Migration Guide Version 2 Release 4 GC23 3898 CD ROM Title Subscription Number Collection Kit Number System 390 Redbooks Collection SBOF 7201 SK2T 2177 Networking and Systems Management Redbooks Collection SBOF 7370 SK2T 602...

Page 328: ...00 RS 6000 SP Maintenance Information Volume 1 Installation and Customer Engineer Operations GC23 3903 RS 6000 SP Maintenance Information Volume 2 Volume 3 GC23 3904 RS 6000 SP Planning Volume 1 Hardware and Physical Environment GA22 7280 GRF Configuration Guide 1 4 GA22 7366 GRF Reference Guide 1 4 GA22 7367 GRF 400 1600 Getting started 1 4 GA22 7368 SP Switch Router Adapter Guide for 1 4 GA22 73...

Page 329: ...ommands TOOLCAT REDPRINT TOOLS SENDTO EHONE4 TOOLS2 REDPRINT GET SG24xxxx PACKAGE TOOLS SENDTO CANVM2 TOOLS REDPRINT GET SG24xxxx PACKAGE Canadian users only To get BookManager BOOKs of redbooks type the following command TOOLCAT REDBOOKS To get lists of redbooks type the following command TOOLS SENDTO USDIST MKTTOOLS MKTTOOLS GET ITSOCAT TXT To register for information on workshops residencies an...

Page 330: ...0 1420 Dutch 45 4810 1540 English 45 4810 1670 Finnish 45 4810 1220 French long distance charges apply 45 4810 1020 German 45 4810 1620 Italian 45 4810 1270 Norwegian 45 4810 1120 Spanish 45 4810 1170 Swedish IBM Publications Publications Customer Support P O Box 29570 Raleigh NC 27626 0570 USA IBM Publications 144 4th Avenue S W Calgary Alberta T2P 3N5 Canada IBM Direct Services Sortemosevej 21 D...

Page 331: ...ent by credit card not available in all countries Signature mandatory for credit card payment Title Order Number Quantity First name Last name Company Address City Postal code Telephone number Telefax number VAT number Invoice to customer number Country Credit card number Credit card expiration date Signature Card issued to ...

Page 332: ...314 IBM 9077 SP Switch Router Get Connected to the SP Switch ...

Page 333: ...e EMCDB Event Management Configuration Database EMD Event Manager Daemon EPROM Erasable Programmable Read Only Memory FIFO First In First Out GB Gigabytes GL Group Leader GPFS General Purposes File System GRF Goes Real Fast GS Group Services GSAPI Group Services Application Programming Interface GVG Global Volume Group hb heart beat HiPS High Performance Switch HPGN High Performance Gateway Node h...

Page 334: ...OFS Professional Office System PSSP Parallel System Support Programs PTC Prepare To Commit PTPE Performance Toolbox Parallel Extensions PTX 6000 Performance Toolbox 6000 PVC Permanent Virtual Circuit RAM Random Access Memory RCP Remote Copy Protocol RM Resource Monitor RMAPI Resource Monitor Application Programming Interface RPQ Request for Product Quotation RSI Remote Statistics Interface RVSD Re...

Page 335: ...e2 34 10Base5 34 A address mapping 115 Address Resolution Protocol 19 administrative Ethernet 31 34 64 65 ADSM client 186 ADSM environment 157 174 185 advanced terminal emulation see ATE arbitration logic 28 ARP 19 60 112 115 138 149 158 162 167 169 180 186 190 204 217 223 227 ARP table 110 ATE 31 ATM 14 18 94 110 112 114 143 150 157 167 173 209 212 LAN Emulation 168 media card 209 220 OC 12 225 O...

Page 336: ...manage_extnode 48 92 sphardware 52 splstdata 84 spmon 3 sysctl 301 xterm e telnet 72 command line interface see CLI communications bus 28 Control Workstation see CWS crosspoint switch 13 16 27 37 38 39 CWS 31 43 59 61 64 65 69 74 75 76 81 84 88 99 102 165 184 193 203 204 205 224 225 D DAS 121 123 129 130 data forwarding 19 datagrams 19 dedicated router 15 dependent node 3 4 5 8 41 43 44 51 60 61 6...

Page 337: ...ckbone 227 camp on bit 135 device 135 direction bit 137 H0 138 I field 133 134 135 136 137 138 interface 139 interface name 139 IP routing 137 IPI 3 138 media card 135 227 MTU 138 path selection bit 135 hop 14 hostname 65 hot plug capabilities 7 hot swappable 66 hot pluggable 16 hot swappable 15 HPGN 5 HSSI 16 39 66 69 80 hw table 107 I I O bus 12 ICMP 23 106 129 140 IDRP 23 IEEE 802 3 144 IGMP 23...

Page 338: ...board 37 media card 16 18 24 26 28 31 36 73 80 81 86 89 93 96 97 98 99 100 107 125 127 184 212 media card slots 25 media statistics 109 MIB 59 mib2d 100 microchannel 6 microchannel bus 16 microcode lookup 28 mrouted 22 MTU 95 113 114 115 121 129 130 138 140 145 148 191 213 default 94 discovery 95 size 19 87 N NBMA 94 114 netmask 94 107 113 121 129 139 140 148 network interface 10 network statistic...

Page 339: ...te table 9 12 13 16 19 28 routed 21 router management 33 Router Manager 18 19 23 24 Routers 8 routing configuration 9 dynamic routing 10 11 metrics 21 minimal routing 10 static routing 10 table 9 10 19 21 22 Routing Information Protocol see RIP routing protocol 9 routing protocols 11 15 20 routing table 137 S SAS 121 122 123 126 129 130 SCSI 166 179 185 SDR 8 46 47 49 50 58 segments 20 send buffer...

Page 340: ...g 20 SVC 112 113 121 169 switch board 82 85 switch cable 80 switch fabric 28 Switch node 4 Switch port 75 76 Switch port number 82 switch statistics 110 switchcontrol protocol 8 Switched virtual circuits 112 Synchronous Optical Network protocol see SONET System Data Repository see SDR system monitoring 28 system partition 58 T table lookups 28 TCP 23 terminal emulation 31 thin node 6 topology data...

Page 341: ...l Access Code 1 914 432 8264 Send your comments in an Internet note to redbook us ibm com Which of the following best describes you _ Customer _ Business Partner _ Solution Developer _ IBM employee _ None of the above Please rate your overall satisfaction with this book using the scale 1 very good 2 good 3 average 4 poor 5 very poor Overall Satisfaction __________ Please answer the following quest...

Page 342: ...Printed in the U S A SG24 5157 00 IBM 9077 SP Switch Router Get Connected to the SP Switch SG24 5157 00 ...

Search results

Summary of Contents for IBM 9077

Reviews:

Related manuals for IBM 9077

Brands by name

Popular brands

IBM IBM 9077, Get Connected

Search results

Summary of Contents for IBM 9077

Reviews:

Related manuals for IBM 9077

Brands by name

Popular brands