background image

Appendix B. Performance Tools and Optimization

NetXen, Inc.

Intelligent NIC Getting Started Guide — NDA Required

41

„

net.ipv4.tcp_rmem 

- memory reserved for TCP receive buffers (reserved memory per 

connection default).

„

net.core.rmem_default

 - TCP receive window default size

„

net.core.rmem_max

 - maximum TCP receive window size

The tunable parameters for the TCP transmit buffers are:

„

net.ipv4.tcp_wmem

 - memory reserved for TCP send buffers (reserved memory per 

connection default).

„

net.core.wmem_default

 - TCP send window default size

„

net.core.wmem_max

 - maximum TCP send window size

Other Linux tunable parameters are:

„

net.ipv4.tcp_mem

 - default memory reserved.

„

net.core.optmem_max

 - increase optional max memory to a higher value

„

net.core.netdev_max_backlog

 - increase number of incoming connections backlog

„

net.core.somaxconn

 - increase number of incoming connections backlog

The optimal values for these tunable parameters are typically workload-specific (and 
sometimes system-specific). A thorough familiarity with the affects of these parameter 
values, as well as an understanding of the target workload and system configuration 
(amount of memory, etc), will help in determining the optimal values for these parameters.

Summary of Contents for Mezanine

Page 1: ...NetXen Inc Intelligent NIC Getting Started Guide Version 1 8 February 2 2007 NetXen Inc 3965 Freedom Circle Fourth Floor Santa Clara CA 95054 Telephone 408 330 0010 Web Site http www netxen com...

Page 2: ...obtain the latest revision of this document Trademarks NetXen the NetXen logo and Intelligent NIC are trademarks of NetXen Inc Third Party brands and names are the property of their respective owners...

Page 3: ...tes to Windows Installation section 4 Throughout section 5 updated the NX_NIC case and added footnote on page 16 accordingly Updated command sequence in Section 5 2 Steps for Flashing on Windows Added...

Page 4: ...NetXen Inc...

Page 5: ...en Flash Utility 19 5 2 Windows Firmware Update 21 5 3 Linux Firmware Updates 21 5 3 1 Linux Firmware Update TAR Format 21 5 4 Updating the Flash on Multiple Cards 22 5 5 Disabling the Device in Windo...

Page 6: ...4 9 2 Linux 34 10 Linux TCP Offload Engine TOE 35 Appendix A CD Content Organization 36 A 1 Driver Updates 36 Appendix B Performance Tools and Optimization 37 B 1 Windows Performance Tools 37 B 1 1 NT...

Page 7: ...All of the NIC products support Windows Linux and other operating systems Check the release notes for an updated list 1 3 Currently Supported Features Note Check with NetXen periodically for software...

Page 8: ...Systems Intel Xeon AMD Athlon 64 AMD Opteron 64 Minimum Memory Requirements Windows 2 Gbytes Linux 1 Gbyte Slot Type PCI Express x8 x4 Cable and Interface Specifications Table 1 NXB 10GXSR NXB 10GSLR...

Page 9: ...ting Started Guide NDA Required 3 2 2 Software Requirements Supported OS Versions NetXen supports both Windows and Linux operating systems Check with NetXen for an updated list of supported OS and ker...

Page 10: ...xt window click Install from a list of specific location and then click Next 5 Select Search for the test driver in these locations Select Include this location in the search 6 Provide the path to the...

Page 11: ...n the same directory from where the Flash command will be executed nxflash exe phantom_obj bootld 4 Run the following commands nxflash i NX_NIC u Writing of the flash requires a few minutes Please do...

Page 12: ...in step 2 5 Connect the appropriate cables to the board and replace the cover 6 Power on the system 4 2 Windows Installation The following Windows iNIC driver related files are included nxp2nic inf NX...

Page 13: ...ates the software that will be installed Click Install from a list or specific location Advanced and click Next as follows 4 Next select Search for the best driver in these locations check the Include...

Page 14: ...d 64 bit operating systems The type of operating system can be specified by clicking Browse in the above window This causes the following window to appear on the screen The x86 directory indicates a 3...

Page 15: ...6 To verify that the driver was properly installed Right click on My Computer then select Manage This opens the Computer Management window shown below Double click on Device Manager A listing of devic...

Page 16: ...ion and Configuration Instructions 7 In the above window right click on the NetXen NIC ADAPTER and select Properties The General tab will be displayed as shown 8 There are four tabs General Advanced D...

Page 17: ...Default 1500 corresponds to 1514 bytes on the wire 4 bytes of CRC Max 8000 Min 1500 Maximum Receive buffers in K This is packet buffers used by the driver for receive DMA memory and indicated to stac...

Page 18: ...s window shown below the device can be uninstalled by clicking Uninstall Clicking Uninstall performs the same operation as described in Section 5 6 1 Transmit IP Checksum Offload This parameter is for...

Page 19: ...the installation of the NetXen NIC software Refer to the next section for information on configuring the NIC 4 2 3 Configuring the Network Interface Card 1 Configure the network connections by opening...

Page 20: ...omatically using DHCP the NetXen NIC adapter entry above will say Limited or no connectivity In this case the address must be entered manually as described in Step 3 below If a red X appears in the Ne...

Page 21: ...elligent NIC Getting Started Guide NDA Required 15 2 Right click on the NIC Adapter button and select Properties In the Local Area Connection Properties window which appears see below single click on...

Page 22: ...ter icon and highlight Status If the installation was successful a device is working properly message will be displayed Using the ping utility verify connectivity with another card or switch 4 3 Linux...

Page 23: ...g command rpm i nx_nic version 1 src rpm The version is the numbered release that came with the package A sample version number would be 3 4 1 Create the Binary To create the binary RPM for Redhat sys...

Page 24: ...the interface from the command line For example 1 Identify the Ethernet interface eth1 eth2 etc and the nx_nic driver cat proc modules grep i nx ifconfig a ethtool i eth2 2 Assign an IP Address and a...

Page 25: ...vailable commands are listed in Table 6 The following are some examples of how the nxflash tool may be used to modify the contents of the Flash Modify MAC address Update firmware image Update boot are...

Page 26: ...llowing nxflash i NX_NIC u for Windows nxflash i eth n u for Linux This will display the firmware version number of the installed image and the firmware version number of the image that is being insta...

Page 27: ...d will be executed nxflash exe phantom_obj bootld 4 Run the following commands nxflash i NX_NIC u Writing of the flash requires a few minutes Please do not interrupt or reboot during this time as it m...

Page 28: ...ath is usr local src nx 3 4 4 bin phantom_obj Currently in flash Firmware version 3 4 2 Bios version 255 255 65535 MAC Addr 0 00 0E 1E 00 03 78 MAC Addr 1 00 0E 1E 00 03 79 Subsys ID 0x11223344 From I...

Page 29: ...ms 5 6 1 Uninstalling the NetXen NIC Driver Software in Windows To uninstall the NetXen NIC adapter driver software in Windows perform the following steps 1 Right click on My Computer and click on Man...

Page 30: ...exe Windows event viewer dmesg Linux Use the NetXen diagnostics utility for further testing 6 2 Unable to ping the NIC Installed on Linux Host Type lspci v and look for vendor ID 4040 Is the NIC visi...

Page 31: ...5 2 and 6 0 6 4 1 MSI Interrupts for Linux The Linux OS version supports MSI and is used by the Intelligent NIC driver if available On the Linux host type cat proc interrupts to check that PCI MSI is...

Page 32: ...e that test generates only a simple pass fail indication and not an actual error code 7 2 Test Descriptions 7 2 1 Control Registers Test In this test the user diagnostic utility reads the values store...

Page 33: ...t lanes to the four corresponding receive lanes This module must contain all of the associated handshake signals required to redirect the four transmit lanes to the four receive lanes In this test the...

Page 34: ...cluded in the NetXen driver package or it can be downloaded directly from Microsoft Microsoft Visual C Redistributable Package The Microsoft Visual C 2005 Redistributable Package x86 installs runtime...

Page 35: ...e displayed as shown below 6 Click on the Have Disk button in the Select Network Protocol window above This displays the Install From Disk window as shown below 7 In the Install From Disk window open...

Page 36: ...ble click this icon to launch the Network Configuration GUI Alternatively you can open the NetXen NIC adapter properties and click the Properties button to launch the NetXen Network Configuration Util...

Page 37: ...es window contains all the configuration options to setup the teaming properties for the iNIC and its ports Double click on the NetXen Network Team 1 entry to display the Team Properties window shown...

Page 38: ...32 Intelligent NIC Getting Started Guide NDA Required NetXen Inc 8 Teaming Driver 8 2 Linux...

Page 39: ...On Ethernet 802 3 networks an unmarked packet is the same as a packet that is marked with the best effort priority value appended to it Not marking packets ensures backward compatibility with devices...

Page 40: ...gured VLAN ID for the NIC Any value or not present Fail to send Nonzero Not present Does not match the configured VLAN ID for the NIC Fail to send Any Non zero Non zero Fail to send because the VLAN I...

Page 41: ...10 Linux TCP Offload Engine TOE NetXen Inc Intelligent NIC Getting Started Guide NDA Required 35 10 Linux TCP Offload Engine TOE...

Page 42: ...tion The CD contains the latest driver files for Windows and Linux for the versions specified in the System Requirements section A 1 Driver Updates The CD ships with the latest versions of the Windows...

Page 43: ...nfiguration ntttcpr m 16 0 rcv ipaddr n of tcp segs for snd rcv a 16 For transmit a should be a value less than 8 The more threads the lower the number should be Note The send and receive side NTTTCP...

Page 44: ...2 168 20 2 n 300000 a 6 p 5002 Receive Side ntttcpr m 1 1 192 168 20 2 n 300000 a 16 rb 512000 p 5001 ntttcpr m 1 1 192 168 20 2 n 300000 a 16 rb 512000 p 5002 B 1 2 nttcps and ntttcpr Command Line Op...

Page 45: ...size may be used The TCP window size field controls the flow of data and is limited to 2 bytes or a window size of 65 535 bytes Since the size field cannot be expanded a scaling factor is used TCP wi...

Page 46: ...TCP IP connection lower so that more connections can be handled by time on the TCP IP protocol The following parameters help to Decrease the amount of time the Linux OS requires to close a connection...

Page 47: ...window default size net core wmem_max maximum TCP send window size Other Linux tunable parameters are net ipv4 tcp_mem default memory reserved net core optmem_max increase optional max memory to a hi...

Page 48: ...Loopback LB_TEST_OK Loopback test has passed LB_UCOPY_PARAM_ERR Error copying parameters LB_UCOPY_DATA_ERR Error copying user data LB_NOMEM_ERR No memory error LB_TX_NOSKB_ERR No SKB for transmit erro...

Page 49: ...ted HW_IFQ_W_PAUSE IFQ write pause previously detected HW_IFQ_W_FULL IFQ write full previously detected HW_MEN_BP_TOUT Memory backpressure timeout previously detected HW_DOWN_BP_TOUT Downstream backpr...

Page 50: ...44 Intelligent NIC Getting Started Guide NDA Required NetXen Inc Appendix C Diagnostic Error Codes...

Reviews: