Mellanox Technologies sRB-20210G User Manual Download

Page: 6 / 205

Version 2.0

Contents

Mellanox Technologies

Setting up a Network/Interface via the CLI ........................................................................... 82

7.2.1

Viewing Networks ................................................................................................... 82

7.2.2

Adding Networks ..................................................................................................... 82

7.2.3

Removing Networks ................................................................................................ 83

7.2.4

Setting the IP and Broadcast Address .................................................................... 83

7.2.5

Setting the Default Gateway ................................................................................... 83

Chapter 8.

Traffic Flow Management ..................................................................................... 85

8.1

Overview ............................................................................................................................... 85

8.2

Setting TFM .......................................................................................................................... 85

8.2.1

Setting TFM via the GUI ......................................................................................... 85

Chapter 9.

Static Route Configuration .................................................................................. 98

9.1

Overview ............................................................................................................................... 98

9.2

Routing Configuration ........................................................................................................... 98

9.2.1

Setting Routing via the GUI .................................................................................... 98

9.2.2

Routing Configuration via the CLI ......................................................................... 100

Chapter 10.

Logs and Statistics ............................................................................................. 102

10.1

Using ’exportLog’ ................................................................................................................ 102

10.2

Viewing Port Counters Statistics ........................................................................................ 102

10.2.1

Viewing Port Counters Statistics via the GUI ....................................................... 102

10.2.2

Viewing Port Status and Statistics via the CLI ...................................................... 104

10.3

Statistics Logs ..................................................................................................................... 107

10.4

Viewing Traps/Events ......................................................................................................... 108

10.4.1

Viewing Events ..................................................................................................... 110

10.4.2

Viewing Traps ....................................................................................................... 110

Chapter 11.

Multicast Settings ............................................................................................... 111

11.1

Overview ............................................................................................................................. 111

11.2

Definitions ........................................................................................................................... 111

11.3

Multicast Settings................................................................................................................ 111

11.4

MC-Table Session .............................................................................................................. 112

Chapter 12.

Mellanox Fabric Manager (VFM) ........................................................................ 113

12.1

Overview ............................................................................................................................. 113

12.2

Viewing I/O System Information via the GridVision Fabric Manager ................................. 113

12.3

I/O System Overview Parameter Description ..................................................................... 114

12.4

Viewing an I/O via the CLI .................................................................................................. 114

12.5

Connecting to an I/O Device via the CLI ............................................................................ 115

12.6

Viewing I/O Port Properties ................................................................................................ 115

12.7

Viewing I/O Network (Partitioning) Information .................................................................. 117

Summary of Contents for sRB-20210G

Page 1: ...www mellanox com Mellanox Technologies 10 GbE Gateway sRB 20210G Module User Manual Version 2 0...

Page 2: ...NY DIRECT INDIRECT SPECIAL EXEMPLARY OR CONSEQUENTIAL DAMAGES OF ANY KIND INCLUDING BUT NOT LIMITED TO PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES LOSS OF USE DATA OR PROFITS OR BUSINESS I...

Page 3: ...5 Technical Specifications 14 1 5 1 General 14 1 5 2 10 Gigabit Ethernet GbE 14 1 5 3 InfiniBand 15 1 5 4 IETF Protocols 15 1 5 5 Management Interfaces 15 1 5 6 Physical 15 1 5 7 Environmental 15 1 5...

Page 4: ...nformation 37 4 1 Getting Started with the sRB 20210G Device Manager 37 4 2 Device Information via the CLI 39 4 3 sRB 20210G Port Information 40 4 4 Viewing the System Time and Date CLI only 41 4 5 Vi...

Page 5: ...ation via the CLI 61 6 5 Configuring I O Interfaces 62 6 6 Cluster Configuration 63 6 6 1 Configuring a Cluster via the GUI 63 6 6 2 Configuring a Cluster via the CLI 65 6 6 3 Cluster Mode sRB 20210G...

Page 6: ...ing exportLog 102 10 2 Viewing Port Counters Statistics 102 10 2 1 Viewing Port Counters Statistics via the GUI 102 10 2 2 Viewing Port Status and Statistics via the CLI 104 10 3 Statistics Logs 107 1...

Page 7: ...election for Partitioning Configuration 128 13 6 Setting Partitioning via the CLI 129 13 6 1 Quick Steps to set up a Network and Perform Partitioning 129 13 6 2 Creating a Network 129 13 6 3 Deleting...

Page 8: ...Options 173 14 6 6 Remote Options 177 14 6 7 Route Options 183 14 6 8 Security Options 184 14 6 9 SNMP Options 186 14 6 10 Traffic Flow Manager TFM 192 14 7 Safe Mode CLI Commands 200 14 8 Software U...

Page 9: ...are familiar with the fundamentals of IP based networking but might not be familiar with the specifics of Mellanox products or the routing protocols supported by Mellanox products System administrato...

Page 10: ...virtual Ethernet and storage networks on from same director class switch IMPORTANT The sRB 20210G module is used as a bridge in the system It does not run on several subnets However it can be used to...

Page 11: ...rpose LED for management use Blinking OFF Sets the Info LED on a desired module When you enable this LED through the GUI or CLI you can go on site and immediately physically locate the module System g...

Page 12: ...side This allows the gateway to work in a Jumbo frame environment on the Ethernet side It also reduces the burden of decreasing the default MTU of all IB hosts in the fabric from 2 Kbytes to 1 5 Kbyte...

Page 13: ...ut with the lowest possible latency Management traffic is handled in software by the CPU Software Ethernet InfiniBand Silicon Fast Path S l o w P a t h S l o w P a t h Figure 1 3 sRB 20210G Conceptual...

Page 14: ...hese packets This processing includes Forwarding the packet is forwarded to a destination host either on the Ethernet side or the InfiniBand side Drop the packet is discarded The CLI add and remove CL...

Page 15: ...ing IEEE 802 1q up to 64 VLANS IP multicast IETF RFC 3171 and IGMPv2 up to 4000 multicast groups SNMP v2c IETF RFC190x 1 5 5 Management Interfaces Full management access is available via the Grid Dire...

Page 16: ...port must be physically separated from the GbE network and InfiniBand fabric The management interface of the sRB 20120G smb mng must be configured with a unique IP address on the same network with the...

Page 17: ...y set ISR2004 3200 config if ip address show Example ISR2004 3200 config if ip address show port selection Ethernet ip 172 28 1 223 mask 255 255 0 0 broadcast 172 28 255 255 DHCP client disabled defau...

Page 18: ...the same subnet the sRB 20210G is now ready for operation 2 2 2 Handling Different Subnets This section explains how to set the sRB 2021G when the switch and the host are in different subnets IMPORTAN...

Page 19: ...f the management as shown in the following examples This will add the default gateway to the Static Route Table IMPORTANT If you are setting the management through fast Ethernet interface out of band...

Page 20: ...ileged mode The default password for the admin user is 123456 Note When connecting to the sRB 20210G via the switch using the io connect command you are already in admin mode and do not need a passwor...

Page 21: ...f the interface mask Subnet mask of the interface To configure the PKey refer to Partitioning in Chapter 13 2 4 Setting Time and Date The time of the sRB 20210G is synchronized with the switch Setup i...

Page 22: ...via the switch CLI and applied to the sRB 2021G Guest and Admin user passwords are used to access the Ethernet management interface via the CLI NOTE The factory default passwords to enter the CLI are...

Page 23: ...7 Verifying the Configuration Verify the system parameters using the steps below Table 2 2 Verifying the Configuration Commands Procedure Step 1 guest a Enter the guest mode The default password for t...

Page 24: ...ock You can now start working with the basic functions by accessing the sRB 20210G via the Switch VFM or via the CLI Advanced sRB 20210G features are detailed further in this manual If you wish to add...

Page 25: ...stalled Refer to the GridVision User Documentation Part 1 for details on how to perform initial GUI installation and configuration 3 2 Device Manager Description VDM is an embedded application with a...

Page 26: ...ger application starts as shown in Figure 3 2 Figure 3 2 GridVision Login Dialog Box The Login dialog box fields are detailed in Table 3 2 Table 3 2 Login Dialog Box Fields Description Field Descripti...

Page 27: ...n window opens NOTE The password is case sensitive 3 4 The Switch Device Manager Main Window The Main Window provides access to all functions of the GridVision Device Manager It also provides a graphi...

Page 28: ...x Technologies Figure 3 4 Front of the Chassis The figure below shows the rear of the chassis in the GridVision Integrated Device Manager Main Window The ISR 2004 was used for the example below Figure...

Page 29: ...of view configuration operation simply click one of the items in the navigation tree The information area of the Device Manager main window displays different information depending on your selection Y...

Page 30: ...Gateway Graphical Representation The following GUI graphical representation of the sRB 20210G provides a view of the sRB 20210G front panel with two 10 GbE ports and 22 InfiniBand ports Figure 3 7 sh...

Page 31: ...s such In this particular example it is Line Board Number 2 as shown on top of the sRB 20210G Reset the 10GbE Gateway Choosing reset 10 GbE Gateway gray area allows you to reset the unit Reset All All...

Page 32: ...1 sRB 20210G 10 GbE Port Right Click Menu Remote Management Settings The Remote Management Settings window enables you to set the SNMP Manager path in the SNMP tab and to provide general details for t...

Page 33: ...resentation only Clicking the blue area of the sRB 20210G graphical returns to the rear view of the switch in which the sRB 20210G is installed as shown in Figure 4 2 3 5 Color Coding Table The GUI Co...

Page 34: ...the event alarm occurrence Source Displays the GUID and the module name of the source of the event alarm Category Displays the source of the event Possible values are SA for events that occurred in th...

Page 35: ...rap Table right click a specific alarm and choose Acknowledge Event To acknowledge all events On the Trap Table right click a specific alarm and choose Acknowledge All 3 6 5 Displaying Additional Data...

Page 36: ...elow details the fields of the Events Data window Table 3 6 Events Data Fields Parameter Description Node GUID Global unique identification number GUID of the device Platform Switch platform on which...

Page 37: ...20210G and describes the Gateway s basic functions and operations Device Manager All the features are available via both the Graphics User Interface and the CLI To access a larger view of the Mellanox...

Page 38: ...cking the column headings The following parameters are displayed Table 4 1 sRB 20210G Device Information Serial Number Serial number of the module Hardware Version The hardware version of the module T...

Page 39: ...port number 1 22 State Indicates the physical state of the port Up Link is active Down Link is down or disconnected LID Port Local ID Width Displays the width data of the link Speed Displays the supp...

Page 40: ...showing the sRB 20210G installed in the chassis as shown in Figure 3 5 Step 2 Click a port on the sRB 20210G The port Information area right panel shows the specific port information Clicking an Infin...

Page 41: ...he example above the status bar of the Information Area shows the information of the 10 GbE gateway s port 1 4 4 Viewing the System Time and Date CLI only To view sRB 20210G system time run the follow...

Page 42: ...210G temperature thresholds are as follows Degrees Celsius Fahrenheit Normal 55 131 Warning 60 140 Alarm 65 149 4 6 Setting the Uptime The Uptime is the date at which the node was activated or deactiv...

Page 43: ...ager version of the Switch The software version of the 10 GbE Gateway The software version of the switch You can also view the sRB 20210G hardware version information in the field under the sRB 20210G...

Page 44: ...gh the Ethernet or through InfiniBand This includes IP settings remote management settings user settings setting remote configuration SNMP 5 1 2 Setting the I O IP via the GUI The I O Panel window is...

Page 45: ...ssis io show command to see if the address is configured This shows the Gateways installed inside the switch This command is available from both the Admin menu as well as the config chassis menu Examp...

Page 46: ...ing the 10 GbE Gateway Step 3 Click Yes to reset the I O The I O is reset 5 2 2 Resetting the I O via the CLI To reset the sRB 20210G from the CLI run the following command sRB 20210G 70b0 reload Rebo...

Page 47: ...urations and more The default password is 123456 The Guest level enables you to view configurations only The default password is voltaire To Configure Authorization Passwords Step 1 From the Main Menu...

Page 48: ...user is 123456 OR admin Enter directly the privileged mode The default password for the admin user is 123456 Note When connecting to the sRB 20210G via the switch using the io connect command you are...

Page 49: ...pdate sRB 20210G software perform the following steps Step 1 Make sure that the FTP server is active and located in the same subnet as the sRB 20210G management port subnet Step 2 Copy the new version...

Page 50: ...the remote mode run a remote show command to check the Remote configuration If the configuration is satisfactory skip to step 6 Step 5 config remote ser ver ip address Power up the sRB 20210G if neede...

Page 51: ...pgrade the VDM is automatically updated and no action is required When the GUI is open during the upgrade the following warning message is displayed Figure 6 1 Warning Message The user must then exit...

Page 52: ...r reactivate the existing IP address Click the relevant SNMP Manager check box and then type in the relevant IP address Step 3 Click OK Step 4 Click the General tab Figure 6 3 Remote Management Settin...

Page 53: ...ired Optional Set the SNMP community get string using the following command Syntax snmp community get string The default get community string is public default set community string is private Updating...

Page 54: ...nfig snmp snmp community set private Expected Result 10G config snmp snmp show snmp functionality enable snmp get enable snmp set enable get community public set community private trap community trap...

Page 55: ...Voltaire Optional Set the SNMP description using the following command Syntax snmp description set description Note that the description is a string set by the user Example 10G config snmp snmp descri...

Page 56: ...on description Optional Disable the SNMP set commands using the following command Syntax SNMP set commands enable disable This disables the SNMP set commands and prevents connection to the GridVision...

Page 57: ...uration parameters Table 6 3 Setting Remote Server Parameters Steps GUI Remote Configuration Window feature CLI Command Privileged Mode Description Setting the Remote Configuration parameters Step 1 C...

Page 58: ...guration via the GUI and the CLI Backing up the configuration Step 1 In the File Name field set file repository file name or view the existing name This field defines the file name in the repository t...

Page 59: ...e name running config This restores the backup configuration This command retrieves the repository configuration from a file stored in the Flash restores it and saves it in the switch repository datab...

Page 60: ...zoom view right click the 10G gray area and select Link Aggregation Configuration from the menu The Link Aggregation Configuration dialog box is displayed as shown below Figure 6 6 Link Aggregation Co...

Page 61: ...G config if prompt run the following command lag mode set full separate Example 10G config if lag mode set full NOTE When setting to link aggregation make sure that sRB 20210G ports on the Ethernet Sw...

Page 62: ...t75 75 75 75 75 255 255 255 0 75 75 75 255 75 0x75 P1 2 Note that the Trunk LAG mode is set to P1 2 This command is available from both the 10G admin or config menus Step 2 View the LAG mode status by...

Page 63: ...lower Multiple algorithms are available for distributing traffic between multiple sRB 20210G Gateways in Cluster Mode The traffic can be balanced between the sRB 20210G Gateways according to the load...

Page 64: ...er Useful when connecting two separate Ethernet subnets to one IB network or vice versa Manual Blocks all traffic between 10 GbE gateways that have the same cluster ID Used for back to back configurat...

Page 65: ...configured in auto mode default It is highly recommended not to change the auto mode nor to use the disable feature cluster mode set disable auto 6 6 3 Cluster Mode sRB 20210G High Availability The 10...

Page 66: ...G 75 75 75 75 6 6 4 Setting sRB 20210G Algorithms To set the 10 GbE algorithms Step 1 At the 10 GbE config cluster prompt enter the following commands Command Description cluster hash table algorithm...

Page 67: ...g to the load balancing algorithm Options active active master standby Default active active active active means that all sRB 20210G Gateways in the cluster transfer packets master standby means that...

Page 68: ...Mode None means that loop prevention is disabled This mode is not recommended and should never be used when 10 GbE gateways are installed in any kind of cluster It is applicable only when a single 10...

Page 69: ...prevention mechanism is automatically updated by adding any new 10 GbE gateway that joined the cluster to the gateway blocking list and by removing any gateway that left the cluster Since such change...

Page 70: ...ster has a unique priority Each two gateways connected over the Ethernet direct links have the same priority in the figure above the two upper gateways may have their priority set to 10 and the two lo...

Page 71: ...Click Apply apply the changes without closing the dialog box or OK apply the changes and close the dialog box Figure 6 12 Policy Table Dialog Box The following table summarizes the events for which y...

Page 72: ...severity level of this event The possible severity levels Normal Minor Warning Critical NOTE The Set Alarm Auto Correction and Trap Consolidation columns are ISR switch related and are not functional...

Page 73: ...via the GUI You can set the MTU of each Ethernet and InfiniBand port individually via the Port Configuration dialog box To set the MTU for individual ports Step 1 On the unit s sRB 20210G graphic ima...

Page 74: ...ing OK or Apply a reboot confirmation dialog box appears The changes take effect only after the device reboot is complete 6 8 2 Setting the MTU via the CLI To set the port MTU via the CLI 1 Type port...

Page 75: ...r to manage all agents as is being done via the GUI Supported Protocols and Standards Mellanox supports the following standards and protocols SNMPv2c protocol Standard Mibs including mib 2 system mib...

Page 76: ...y setting You will need to enter the new SNMP community string settings when logging into the GUI session To disable SNMP Use the following table to enter the desired commands Command Description gues...

Page 77: ...e ftpd status as follows Example 10G config security ftpd show ftpd disable 6 10 2 3 Disabling Telnet Access The telnet daemon provides the server function for the telnet protocol The telnet feature e...

Page 78: ...s Table The following parameters are displayed Table 7 1 Networks Parameters Table Parameter Description Index number that the Device Manager automatically attaches to each network It is incremented b...

Page 79: ...etworks Table and select New Network from the menu The New Network dialog box is displayed as shown in the Figure below Figure 7 3 New Network Dialog Box Step 2 Enter edit the parameters as required T...

Page 80: ...ation To view Network information Step 1 Right click inside the Networks Table and select View Network from the menu The View Network dialog box is displayed Figure 7 4 Update Network Dialog Box Step...

Page 81: ...way Dialog Box Step 2 Enter the following information Table 7 3 Update Default Gateway Parameters Parameter Description Interface Name Enter the name of the interface the on which the default gateway...

Page 82: ...et mask and Broadcast IP VLAN assigned to the interface Pkey Partition key which is the VLAN on the InfiniBand side and the interface Trunk full LAG separate Example 10G config if interface show all e...

Page 83: ...switch you will get the following message Error This interface will not be joined until its PKey is added to the switch s PKey table 7 2 3 Removing Networks To remove a desired Interface Step 1 From...

Page 84: ...ample shows how to configure the default gateway of the sRB 20210G 10G config route default gw set 2 smb mng 192 168 60 254 NOTE smb mng is the sRB 20210G managing interface though which the Switch ac...

Page 85: ...Management item in the main window s navigation tree left panel to display the TFM Table Figure 8 1 TFM Table The following parameters are displayed Table 8 1 TFM Table Parameters Parameter Descriptio...

Page 86: ...nage the TFM rules defined in the gateway The following table lists the icons and the actions that they trigger Table 8 2 TFM Table Icons Icon Action Move up Select the rule in the TFM Table and click...

Page 87: ...he source IP address Enter a value of any when you wish to apply the rule to all packets regardless of the source IP address Source Mask The source subnet mask To specify a range of IP addresses e g i...

Page 88: ...t the packet will be forwarded Discard means the packet will be dropped Log These logs are counters to which you associate a rule Whenever a hit occurs on a rule its log counter is increased In the CL...

Page 89: ...also accessible from the Services dialog box Figure 8 5 Adding a New Service Enter the following information Table 8 4 New Service Parameters Parameter Description Service Name Enter the name logical...

Page 90: ...Services Table The following parameters are displayed Table 8 5 Services Table Parameters Parameter Description Serial number of the service It is incremented by one for each new entry Service Name Us...

Page 91: ...table and select Refresh from the menu The TFM table is updated with the latest changes 8 2 1 8 Setting TFM via the CLI When a TCP IP packet arrives at the sRB 20210G its header is compared with and...

Page 92: ...ol type of the packet and port numbers in case of UDP TCP packets or service type in case of ICMP packets Each TFM rule is applied to packets of a specific service only Each rule should be associated...

Page 93: ...aces 10G statistic Changes to statistic mode 10G statistic Log show Displays all the statistics 8 2 1 10 Adding a New Service via the CLI When adding a TFM rule the service matching the new TFM rule m...

Page 94: ...5 KLL2 TCP 112 112 8 2 1 11 Updating Services via the CLI NOTE Note that you cannot changes the items under service any To update the services Command name Description Step 1 guest a Enter the guest m...

Page 95: ...ort Modifies the service source port Relevant only to TCP or UDP services This command modifies the service and all the tfm rules that are using this service 10G ipr 20 config tfm service update Dport...

Page 96: ...0 6 udp1 UDP any 5023 7 udp2 UDP 5040 5020 Step 5 Service show Shows services Example 10G ipr 20 config tfm service show Total number of entries 7 entry name protocol Sport Dport type 1 any any any an...

Page 97: ...ervice Optionally enter the service name for which the rule is to be applied Enter a value of any when you wish to apply the rule to all packets regardless of the service tunneling discard Action take...

Page 98: ...static route mechanism the user can set rules that can create new default gateways in the sRB 20210G The Static Route table enables to define interface static routing rules and add and remove static...

Page 99: ...1 Right click the Static Route table and select add static route from the menu The Add Static Route dialog box opens The gateway must be on the same subnet as the interface Figure 9 2 Adding a Static...

Page 100: ...defined when packets must be transferred outside the boundaries of the IP or InfiniBand subnets using the Static Routing commands Static routing provides a means of explicitly defining the next hop f...

Page 101: ...interface 1 172 25 0 0 255 255 0 0 172 28 0 1 smb mng 10G ipr 20 config route static route set static route set static route set row 1 10 subnetDestination netmas k Gateway Iface 10G ipr 20 config ro...

Page 102: ...and exportLog Description Uploads the log files to the Remote server using previously defined server name user name and password Syntax exportLog remote path Example 10G config remote exportLog pub 10...

Page 103: ...s table contains statistics of transmit port counter information Port Index that identifies the port that transmits the packets Total Total packets of transmitted messages per port VLAN VLAN packets o...

Page 104: ...ers to the direction from the IP to the InfiniBand side Table 10 3 Port Status and Statistics Prompt Command name Description 10G config port port ethernet set enable Make sure the Ethernet port is en...

Page 105: ...escription type Port number port Statistic type total tx Total packets transmitted vlan tx Transmitted packets that are associated with a VLAN frag tx Number of transmitted IP fragments ip option tx N...

Page 106: ...2 copper down 1500 1 enable 10G config port port ethernet show port type status mtu speed Gbps enable disable 1 copper active 1500 10 enable 2 none disconnected 1500 10 enable The following details t...

Page 107: ...values 1500 9198 Example 10G config port port ethernet set mtu 1 9198 Prompt Command name Description IB port port ib set mtu Configure the MTU of an IB port Possible values 1500 2048 Example 10G conf...

Page 108: ...unter Resets the rx received packets counters of the specific log 10G statistic tx reset counter Resets the tx transmitted packets counters of the specific log The following is an example of a Statist...

Page 109: ...0 config policy policy event show 1002 Event Id 1002 Event Name Infiniband Link Change Event Type IB port change Issue Alarm log trap Severity critical sRB 20210G 6050 config policy sRB 20210G 6050 co...

Page 110: ...ed above The trap log file can be viewed after exporting the log files via the config remote menu to a remote host 10 4 2 Viewing Traps The Trap Table is displayed at the bottom of the VDM main window...

Page 111: ...icast Step 3 Set the multicast group IP address 224 0 0 10 Step 4 Run a default multicast group show command to view the results sRB 20210G 6060 config multicast default multicast group ip is 224 0 0...

Page 112: ...mc table sRB 20210G 1 sRB 20210G 6230 mc table show IP address MLID PKEY STATE 225 6 6 6 0xC00C 0xFFFF Join In following example the mc table displays only the single group that it is handling sRB 20...

Page 113: ...ation via the GridVision Fabric Manager To view I O Information Step 1 On the subnet tree left panel in the main window expand the switch option to view the various switches Expand more to see the sRB...

Page 114: ...ndow The Node Properties Window also shows the Operational State as being down and the time and date the node was disconnected More explanations on these windows can be found in the Switch User Docume...

Page 115: ...2 position 1 I O Type 10 GbE Gateway IP 172 30 106 60 Mask 255 255 0 0 GetCommunity public SetCommunity private This shows that a sRB 20210G 10 GbE Gateway is installed in slot 2 of the Switch To con...

Page 116: ...The most critical alarm severity that was reported for the port Normal Warning Minor Critical State I O Port state Active Disconnected Port Type I O port type 10G 1G MTU Maximum Transmission Units 15...

Page 117: ...ng Information You can view the I O Network Partitioning Information per gateway To view the port information via the GUI Right click an I O port in the Site Topology Window and choose Port Info from...

Page 118: ...n Fabric Manager facilitates a centralized network configuration The fabric administrator can utilize the Fabric Manager GUI application to Define networks Assign server ports to one or more networks...

Page 119: ...Hosts 1 2 and 3 and is connected to VLAN Y Ethernet Hosts via the sRB 20210G Partition B PKey B is shared between InfiniBand Hosts 4 5 and 1 Note that InfiniBand Host 1 belongs to both Partition A an...

Page 120: ...IP the PKey and the VLAN Tag 4 Go to the subnet tree and click Site Topology 5 Select the host to which you want to add to the partition 6 Right click the host and select Partitioning 7 Select the ne...

Page 121: ...ager GUI NOTE It is currently recommended to perform partitioning via the GUI and not via the CLI The GridVision Fabric Manager enables you to Define create networks Attach assign server ports to a ne...

Page 122: ...1 In the main window under the Subnet Tree select Networks Step 2 Right click the main window Subnet Networks and select Create Network from the menu Figure 13 2 Creating a Network The Create Network...

Page 123: ...embership types Full Members with Full membership may communicate with all hosts members within the network partition Step 7 Check VLAN Tagged if you wish to configure a VLAN to be part of the InfiniB...

Page 124: ...VLAN 13 5 2 Viewing Network Information To view information for a specific network Step 1 Right click the desired network Step 2 Select View Network The View Network Information dialog box is displaye...

Page 125: ...e port with the network The network Bob is added to the lower section Networks accessed by selected port s Note that when adding or deleting a network the Add Delete buttons are disabled once you adde...

Page 126: ...sired Step 3 Click Update Members Step 4 Click Apply and OK to save your changes The changes will only be effective if you click Apply Alternatively you can change the default membership from the Netw...

Page 127: ...ht click the desired 10 GbE10 GbE port that you want to attach to a partition The 10 GbE Gateway ports can only be selected individually Figure 13 9 Selecting the Port of an 10 GbE Gateway NOTE In Ful...

Page 128: ...anges The VLAN network is now connected to the InfiniBand fabric via the sRB 20210G InfiniBand port that was previously selected 13 5 7 Multiple Selection for Partitioning Configuration Under the Port...

Page 129: ...netdiscover command from the Utilities Menu Refer to the CLI config sm partition menu in the CLI Reference Guide for a full list of commands on partitioning and networks 13 6 1 Quick Steps to set up...

Page 130: ...network from the Network Table Syntax network remove network name str Example ISR2012 1770 config sm partition network remove John ISR2012 1770 config sm partition Expected results Removed the specifi...

Page 131: ...command Command interface guid add Description Binds the GUID and its specific membership to the network A GUID can be any string containing a hexadecimal number Note that the system does not check w...

Page 132: ...isting GUID to a new network Switch config sm partition interface guid add 0x8f10001011301 br5 full Expected Results Pkey Table for the specific GUID Switch config sm partition interface guid show 0x8...

Page 133: ...part Run the following command to change the membership to full Switch config sm partition interface guid add 0x8f10001011456 br1 full Expected results Switch config sm partition interface guid show...

Page 134: ...ohn 2 0x8f10001011302 Bob full NewHCA 1 0x8f10001011456 management full NewHCA 1 0x8f10001011456 br1 partial Note that port GUID 0x8f10001011301 was removed from the Bob network and was deleted from t...

Page 135: ...ame network name membership 0x8f10001011301 management full 0x8f10001011301 br1 full 0x8f10001011301 br3 full 0x8f10001011301 br4 full 0x8f10001011301 br2 full 0x8f10001011301 Bob full To view all the...

Page 136: ...Ports The Network Table is the exact same table displayed after running the network show command The Pkey Table is the exact same table displayed after running the interface show command Table 13 1 d...

Page 137: ...ble Ports Ports Port Fields Description System System Node Name Subsystem Name of the module contained in the system e g sRBD sLB Location Module physical location for example slot number in which the...

Page 138: ...rtitionError txt file for encountered warnings Expected results You can view the list of partition errors by entering the path of the PartitionError txt file in your browser for example http 172 25 7...

Page 139: ...er name admin or guest and password at the logon prompt Note that the password is represented by stars guest a Enter the guest mode The default password for the guest user is voltaire b Enter the Priv...

Page 140: ...s described in the following table Table 14 1 CLI Key Functions Key Function Tab Completes a partial command name entry When you enter a unique set of characters and press the Tab key the system compl...

Page 141: ...ayed at the CLI prompt Ctrl T Transposes the character to the left of the cursor with the character located at the cursor Ctrl X Moves the cursor to the beginning of the command line Ctrl W Deletes th...

Page 142: ...in the command 14 3 3 Case Sensitivity CLI commands must be entered using the same case as shown in this manual User defined strings such as names or descriptions may appear in any case including mixe...

Page 143: ...he commands available to the user at any given time depend on the current mode Entering a question mark at the system prompt allows the user to obtain a list of commands available for each command mod...

Page 144: ...SNMP properties static route show Shows the static route uptime Displays the current time how long the system has been running how many users are currently logged on and the system load averages versi...

Page 145: ...0xD 0xFFFF 0x404 if0 172 28 0 1 00 08 F1 04 00 40 32 01 0x1 0xFFFF 0x2 if0 Note that the first two addresses are on the side of the InfiniBand Network and may not have the same LID for two different...

Page 146: ...wever Mellanox does not recommend working in this back to back mode Parameter Description State Active Active State sRB 20210G Gateways detect each other automatically Auto default and only option thi...

Page 147: ...y means that only the master sRB 20210G in the cluster transfers packets the others are in Standby Mode Active Node Table Shows the Active sRB 20210G Gateways that are interconnected and sorted accord...

Page 148: ...ddress MLID PKEY STATE 225 7 7 7 0xC00D 0xFFFF Join 225 5 5 5 0xC00A 0xFFFF Join node port info show Description Displays the GUID and MAC addresses of node and ports Syntax node port info show Exampl...

Page 149: ...Log 1 200 20 0 0 255 255 0 0 200 10 0 0 255 255 0 0 if0 UDP discard active 8 2 182 24 56 0 255 255 255 0 195 23 12 0 255 255 255 0 if0 TCP discard active 2 3 any any any any if0 any tunneling active...

Page 150: ...nt time how long the system has been running how many users are currently logged on and the system load average Syntax uptime Example 10G uptime 13 04 14 up 3 days 13 24 load average 0 40 0 40 0 36 ve...

Page 151: ...in the Privileged Mode NOTE The prompt shows that you are in Privileged Mode 10G Card command Displays the command s usage string Displays the list of available commands arp table show Displays the A...

Page 152: ...ides of the network on the InfiniBand side and on the Ethernet side The InfiniBand ARP Table is used to show the connection between the IP address virtual the LID local ID and the destination QP The L...

Page 153: ...ve multi cast ip address 224 0 0 77 time to learn seconds 30 active node table pkey vlan master s n router s n router prio if name router name advertised ip 0x7fff 0 647 647 100 if0 sRB 20210G 287 192...

Page 154: ...FF Join node port info show Description Displays the node and ports GUID and MAC address Syntax node port info show Example 10G Card node port info show Node Guid 00 08 f1 00 01 06 03 c0 IB Port Guid...

Page 155: ...sRB 20210G Syntax reload remote show Description Shows the name of the Remote server and the user name used by the sRB 20210G to log on to the server The password is not displayed for security reasons...

Page 156: ...14 5 1 of commands available in this menu Syntax statistics update software Description Updates the software version using the software located in the specified directory of the designated Remote serv...

Page 157: ...0_0 47 Apr 17 2008 02 53 51 IPR Board Version 0x1 IPR FirmWare Version 0xE IPR CPLD Version 0x5 14 5 1 Statistics Mode The following are the commands available under the Statistic sub menu sRB 20210G...

Page 158: ...a log counter n In the above example this shows the number of bytes sent from Infiniband to Ethernet one way or sent between InfiniBand and Ethernet and matching the two TFM rules with log counter 1 r...

Page 159: ...ands in the Config mode sRB 20210G 61f0 config command Displays the command s usage string Displays the list of available commands cluster Changes to Cluster configuration mode diagnostics Changes to...

Page 160: ...gateway back to factory default and reboots the system Refer to Section 14 6 3 for a list of commands available in this menu Syntax factory default interface Description Changes to Interface Configura...

Page 161: ...snmp Description Changes to SNMP Configuration mode Refer to Section 14 6 9 for a list of commands available in this menu Syntax snmp system name set Description Sets the system name of this gateway T...

Page 162: ...r infiniband eth infiniband ethernet cluster join Allows the I O Gateway to automatically join the cluster cluster join now Automatically joins the cluster cluster load balance algorithm set Sets the...

Page 163: ...any Ethernet address Ethernet IP address of the Ethernet Host for any InfiniBand address Syntax cluster hash table algorithm set xor infiniband eth infiniband ethernet Example sRB 20210G 61f0 config...

Page 164: ...t75 sRB 20210G 61f0 75 75 75 75 0x103 2 0x62880 0x62880 100 CP2 sRB 20210G 61f0 13 11 11 2 cluster join now Description Allows the user to manually add the gateway to the cluster if the gateway is in...

Page 165: ...2880 100 if0 sRB 20210G 61f0 192 168 2 2 cluster loop prevention set Description This feature prevents loops between multiple gateways in a cluster setup NOTE When gateways are connected in parallel t...

Page 166: ...nable loop prevention full priority 100 join cluster automatically yes load balancing algorithm active active hash table algorithm xor infiniband eth multicast ip address 224 0 0 77 cluster id 1 clust...

Page 167: ...nable Loop prevention full priority 1 join cluster automatically yes load balancing algorithm active active hash table algorithm xor infiniband eth multicast ip address 224 0 0 77 cluster id 1 active...

Page 168: ...ry and CPU utilization Syntax system utilization show Example sRB 20210G 61f0 config diagnostics system utilization show Total memory 235916 kbytes Free memory 58056 kbytes Memory utilization 24 61 CP...

Page 169: ...e is set using the LAG mode set command By default LAG Mode is set to Full LAG Full LAG mode adds an interface with a trunk P1 2 Separate LAG mode adds an interface with ports P1 P2 For more details o...

Page 170: ...0 103 117 255 255 0 0 172 30 255 255 no 0x7fff No port 2 if0 192 168 20 107 255 255 255 0 192 168 20 255 no 0x7fff P1 42 interface vlan set Description Updates the VLAN of an interface Syntax interfac...

Page 171: ...onfigure NTP Network Time Protocol The NTP menu allows sRB 20210G clock synchronization with a managing Switch The following commands are available under the NTP menu 10G Card config ntp command Displ...

Page 172: ...mple 10G Card config ntp time zone list show 1 Jamaica 2 Libya 3 MST7MDT 4 Chile EasterIsland 5 Chile Continental 6 Turkey 7 Portugal 8 Pacific Guadalcanal 9 Pacific Johnston 10 Pacific Fakaofo 11 Pac...

Page 173: ...tral 56 Canada Yukon 57 Asia Seoul 58 Asia Kuala_Lumpur time zone set Description Sets the switch time zone Syntax time zone set location number refer to time zone list Example 10G Card config ntp tim...

Page 174: ...port ib set mtu 1500 2048 port ib show port ib show port statistics reset port statistics reset port 1 2 port statistics show port statistics show port ethernet show port ethernet show The following d...

Page 175: ...enable disable 1 copper disconnected 1500 1000000 enable 2 copper disconnected 1500 1000000 enable port ib set mtu Description port ib set mtu Syntax port ib set mtu 1500 2048 Example sRB 20210G 61f0...

Page 176: ...al number of UDP packets sent to Ethernet port n pause frame tx Total number of pause frames sent to Ethernet port n total rx Number of packets received from Ethernet port n vlan rx Total number of VL...

Page 177: ...o set FTP and SCP protocols to transfer files to and from remote hosts You can also use this to backup export the repository to the Remote Server or saves a back to flash In addition you can upload th...

Page 178: ...rver name user name and password flash delete Deletes specific file from flash flash show Shows the configuration files in flash password Sets the user password to access remote FTP server protocol se...

Page 179: ...ile name The new values will be applied on reboot Syntax copy remote file name running config Example sRB 20210G 61f0 config remote copy remote home avia repository_sRB 10G_15_34_2008 01 23_IP_172 30...

Page 180: ...sh in the path will be used as a user defined file name Syntax copy running config remote remote path Example 1 In this example the system will upload the configuration to the remote server and will n...

Page 181: ...ote flash delete JohnDoe Expected result sRB 20210G 61f0 config remote flash show Name Modification_date repository_10G_7_43_2008 01 21_IP_172 30 106 32 new Mon Jan 21 07 43 07 2008 flash show Descrip...

Page 182: ...the protocol used to access the remote server Syntax remote show Example sRB 20210G 61f0 config remote remote show remote configuration remote server 172 25 5 152 username johnb protocol FTP server De...

Page 183: ...static route set row 1 10 subnetDestination netmask Gateway Iface static route show static route show The following details the commands available in Route Mode default gw set Description Sets the de...

Page 184: ...3 192 73 0 0 255 255 0 0 172 30 0 1 smb mng static route show Description Shows all static routes Syntax static route show Example sRB 20210G 61f0 config route static route show entry Destination Net...

Page 185: ...how The following details the commands available in Security mode console set Description Changes the status of the console Syntax console set disable enable Example sRB 20210G 61f0 config security co...

Page 186: ...ttings information via the GUI A list of the commands available and their descriptions in the SNMP mode are listed below sRB 20210G 61f0 config snmp command Displays the command usage string Display t...

Page 187: ...ion set snmp description set description snmp description show snmp description show snmp functionality set snmp functionality set enable disable snmp get snmp get enable disable snmp location set snm...

Page 188: ...cluster monitor show Example sRB 20210G 61f0 config snmp snmp cluster monitor show cluster monitor is 125 25 7 11 snmp community get Description Sets the SNMP get community string Syntax snmp communi...

Page 189: ...ion Sets the SNMP trap community Syntax snmp community trap string Example sRB 20210G 61f0 config snmp snmp community trap 172 25 2 243 Expected results sRB 20210G 61f0 config snmp snmp community show...

Page 190: ...scription show Example sRB 20210G 61f0 config snmp snmp description show description is H1 snmp get Description Enables disables the SNMP get functionality Syntax snmp get enable disable Example sRB 2...

Page 191: ...functionality enable snmp get enable snmp set enable get community public set community private trap community trap location description contacts snmp trap port show Description Shows the SNMP agent...

Page 192: ...ves the service service show Shows services service update Dport Modifies the service destination port service update Sport Modifies the service source port service update name Modifies the service na...

Page 193: ...eling discard log no 1 15 Note that Source ip mask and Dest ip mask must be bitwise masks Example rules add 6 192 168 3 1 255 255 255 0 192 168 3 200 255 255 255 0 if0 any tunneling 3 In the above exa...

Page 194: ...34 1 47 255 0 0 0 any any if0 any discard active 15 11 4 1 1 47 255 0 0 0 any any if0 any discard active 8 12 3 1 1 47 255 0 0 0 any any if0 any discard active 1 rules update destination Description...

Page 195: ...ny 1 any any any if0 any tunneling active 1 2 any any 2 2 2 2 255 255 0 0 if1 MyUDP discard active 2 rules update service Description Updates the TFM service rules Syntax rules update service row 1 10...

Page 196: ...MP message types Please note that the type entry only has meaning in ICMP services The name is the user defined ICMP service name Syntax service add ICMP type any name Example sRB 20210G 61f0 config s...

Page 197: ...entry name protocol Sport Dport type 1 any any any any any 2 aviTcp TCP 80 30 service add UDP Description Sets a UDP service Sport and Dport are respectively the source and destination ports Thus if o...

Page 198: ...at you can only change the Sport or Dport of the row of a UDP or TCP protocol The rules matching the updated service will be updated accordingly Syntax service update Dport row Dport Example sRB 20210...

Page 199: ...TCP2 Expected results sRB 20210G 61f0 config service service show entry name protocol Sport Dport type 1 any any any any any 2 icmp8 ICMP 8 3 icmp0 ICMP 0 4 TCP2 TCP 5 10 service update type Descripti...

Page 200: ...ands A list of the commands available and their descriptions in Safe Mode are listed below Description Displays the usage string of the specified command Syntax command ip address Description Sets the...

Page 201: ...dir user pwd file i Where ip ip address of ftp server dir directory with iso image on ftp server user username pwd password file package filename on ftp server i switch that define interactive burning...

Page 202: ...packets 0 errors 0 dropped 0 overruns 0 carrier 0 collisions 0 txqueuelen 1000 RX bytes 22200084 21 1 MiB TX bytes 0 Interrupt 74 IB DEV ib0 Link encap UNSPEC HWaddr 00 00 00 02 FE 80 00 00 00 00 00 0...

Page 203: ...Mode CLI Step 1 Open an SSH session from the Ethernet or the InfiniBand side to the gateway Step 2 Type admin at the logon prompt Password 123456 Step 3 Issue the appropriate CLI commands to complete...

Page 204: ...ntrol Adaptor IB InfiniBand ICMP Internet Control Message Protocol IGMP Internet Group Management Protocol IP Internet Protocol IPR IP Router gateway IPoIB Internet Protocol IP over InfiniBand LAG Lin...

Page 205: ...es SNMP Simple Network Management Protocol sRBD Router Blade Drawer sRB 20210G Mellanox InfiniBand to 10 GbE Gateway 10G 10 GbE router TCP Transmission Control Protocol TFM Traffic Flow Management TX...

Search results

Summary of Contents for sRB-20210G

Reviews:

Related manuals for sRB-20210G

Brands by name

Popular brands

Mellanox Technologies sRB-20210G, User Manual

Search results

Summary of Contents for sRB-20210G

Reviews:

Related manuals for sRB-20210G

Brands by name

Popular brands