background image

Summary of Contents for 10-Gigabit Ethernet Network Adapter

Page 1: ...SGI 10 Gigabit Ethernet Network Adapter User s Guide 007 4669 002 ...

Page 2: ...c in the United States and or other countries worldwide Intel is a registered trademark of Intel Corporation Linux is a registered trademark of Linus Torvalds used with permission by Silicon Graphics Inc UNIX is a registered trademark of The Open Group in the United States and other countries FCC WARNING This equipment has been tested and found compliant with the limits for a Class A digital devic...

Page 3: ...or radio noise emissions from digital apparatus as set out in the Radio Interference Regulations of the Canadian Department of Communications Attention Cet appareil numérique n émet pas de perturbations radioélectriques dépassant les normes applicables aux appareils numériques de Classe A préscrites dans le Règlement sur les interferences radioélectriques etabli par le Ministère des Communications...

Page 4: ......

Page 5: ...New Features This guide contains the new Chapter 4 Performance Tuning on page 15 007 4669 002 v ...

Page 6: ......

Page 7: ...Record of Revision Version Description 001 May 2004 Initial publication 002 August 2005 Revision 007 4669 002 vii ...

Page 8: ......

Page 9: ...es of the SGI 10 Gbit Ethernet Network Adapter 1 Features 2 Cabling 2 Configuration Limits 3 Tools 3 2 Connecting the Adapter to a Network 5 Installing the Adapter 5 Connecting to the Network 5 3 Operating the Adapter 7 Verifying Functionality 7 Using LEDs to Determine Functionality 7 Verifying Adapter Recognition 8 IRIX Adapter Recognition Verification 8 Linux Adapter Recognition Verification 9 0...

Page 10: ...inux Configuration 12 MTU Size Settings 12 4 Performance Tuning 15 IRIX Performance Tuning 15 Jumbo Frames and IRIX 15 Read Write Size and IRIX 16 Socket Buffer Size and IRIX 16 Multibuffer Mode and IRIX 16 SGI ProPack 3 Performance Tuning 17 Socket Read and Write Buffer Sizes for SGI ProPack 3 17 Jumbo Frames and SGI ProPack 3 17 Read Write Size and SGI ProPack 3 17 TCP IP Socket Buffer Size and ...

Page 11: ...rnet networks and the system in which the adapter is installed Important Information Warning Never look into the end of a fiber optic cable to confirm that light is being emitted or for any other reason Do not use any type of magnifying device such as a microscope eye loupe or magnifying glass Such activity causes cause a permanent burn on the retina of the eye Optical signal cannot be determined ...

Page 12: ...formance and how to set configuration parameters Related Publications This guide is part of a document set that fully supports the installation operation and service of the adapter For more information about installing and servicing the adapter see the user s guide for the system in which the adapter is installed Also see the following IRIX Admin Networking and Mail Linux Configuration and Operati...

Page 13: ...lease notes by entering either grelnotes or relnotes at a command line On Linux systems you can view release notes on your system by accessing the README txt file for the product This is usually located in the usr share doc productname directory although file locations may vary You can view man pages by typing man title at a command line Conventions The following conventions are used throughout th...

Page 14: ...Comments If you have comments about the technical accuracy content or organization of this publication contact SGI Be sure to include the title and document number of the publication with your comments Online the document number is located in the front matter of the publication In printed publications the document number is located at the bottom of each page You can contact SGI in any of the follo...

Page 15: ...twork Adapter User s Guide Send mail to the following address Technical Publications SGI 1500 Crittenden Lane M S 535 Mountain View California 94043 1351 SGI values your comments and will respond to them promptly 007 4669 002 xv ...

Page 16: ......

Page 17: ...s The 10 Gbit Ethernet technology is targeted at backbone networks and interserver connectivity It provides an upgrade path for high end workstations that require more bandwidth than Gigabit Ethernet can provide The adapter is supported in the following systems Silicon Graphics Prism SGI Altix 3000 SGI Altix 350 SGI Origin 350 Silicon Graphics Onyx 4 Silicon Graphics Onyx 350 SGI Origin 3000 with ...

Page 18: ...ance with PCI Local Bus Specification Revision 2 3 and PCI X Addendum to the PCI Local Bus Specification Revision 1 0a standards Optical cabling 850 nm 10GBASE SR Cabling The adapter is an LC connector and uses a 10GBASE SR transceiver at 850 nm It is connected to the network using a multimode fiber MMF cable of 50 micron The cable which is not included in the shipment must have a quality in the r...

Page 19: ...ed maximum for your configuration Tools The SGI 10 Gbit Ethernet network adapter product contains the following IRIX tools xg 7F driver xgcmd 1M diagnostic tool to interrogate and control both the driver itself and the interfaces under its control The following standard Linux commands are useful with any Ethernet device ethtool 8 ifconfig 8 ip 8 For more information see the man page associated wit...

Page 20: ......

Page 21: ...The adapter must be installed by an SGI certified service provider Origin 350 Onyx 350 and Altix 350 See the instructions for installing a PCI card in the user s or owner s guide that came with the system Silicon Graphics Tezro See the instructions for installing a PCI card in the user s or owner s guide that came with the workstation Connecting to the Network To connect the adapter to a network d...

Page 22: ...ts to an Ethernet switch consult the operating manual for the switch to ensure that the switch port is enabled and configured correctly and as the correct adapter type 10GBASE SR 3 Insert the connector on the other end of the fiber optic cable into the connector on the Ethernet switch or another computer system as appropriate Figure 2 1 shows the connector Fiber optic connector Figure 2 1 Fibre Op...

Page 23: ... 12 Verifying Functionality This section explains the following Using LEDs to Determine Functionality Verifying Adapter Recognition on page 8 Enabling the Adapter on page 10 Verifying that the Adapter is Properly Configured and Enabled on page 10 Using LEDs to Determine Functionality The SGI 10 Gbit Ethernet network adapter has light emitting diodes LEDs that indicate whether the adapter is config...

Page 24: ...or the SGI 10 Gbit Ethernet network adapter is xgN where N is the number of the adapter 1 for the first adapter 2 for the second adapter if installed and so on Use the commands in the examples below to display the network interface names Note IRIX uses etc ioconfig conf to keep adapters and unit numbers consistent between reboots and new hardware installs As a result if a adapter is removed it s i...

Page 25: ...nt before the module is loaded the proc net dev file will not display the device On SGI ProPack 3 systems you can also use the hinv command to display device information 2 Load the s2io module root linux root insmod s2io The device will now appear in the proc net dev file root linux root cat proc net dev grep eth1 eth1 0 0 0 0 0 0 0 0 root linux root The device also appears in ifconfig output as w...

Page 26: ...abled IRIX Adapter Configuration Verification To verify that the network interface is configured properly and is enabled on enter the following on an IRIX system irix usr etc netstat ia Columns with the following headings should appear Name Mtu Network Address In the Name column the xg number should appear If it is followed by an asterisk the interface is disabled In the Mtu column the size of the...

Page 27: ...that the MAC address is 00 0C FC 00 01 24 the IP address is 10 2 2 2 the card is up and the MTU is 9600 root linux root ifconfig a eth1 Link encap Ethernet HWaddr 00 0C FC 00 01 24 MAC address inet addr 10 2 2 2 Bcast 10 2 2 255 Mask 255 255 255 0 IP address UP BROADCAST RUNNING MULTICAST MTU 9600 Metric 1 the card is up MTU RX packets 5 errors 0 dropped 0 overruns 0 frame 0 TX packets 5 errors 0 ...

Page 28: ...ation of your adapter use the ethtool 8 command For more information see the ethtool 8 man page MTU Size Settings The maximum transmission unit MTU size is controlled by the mtu mtu_size switch of the ifconfig command The most common MTU sizes are 1500 bytes standard size Ethernet frames and 9000 jumbo Ethernet frames The adapter supports an MTU size of up to 9600 bytes Configuring the adapter to ...

Page 29: ...mmand where N is the number of the adapter ifconfig xgN down 3 To change the MTU size of the 10 Gbit Ethernet adapter enter the following command where Nis the number of the adapter ifconfig xgN mtu 9600 4 To restart the adapter enter the following ifconfig xgN up 5 Enter the following command to verify that the MTU size has been changed netstat i The output should look similar to the following Na...

Page 30: ......

Page 31: ...IX on page 15 Read Write Size and IRIX on page 16 Socket Buffer Size and IRIX on page 16 Multibuffer Mode and IRIX on page 16 There is no one tuning configuration that is best for all environments This section gives guidelines for the following cases A point to point configuration in which IRIX is transmitting to or receiving from IRIX A multiclient configuration in which an IRIX system is connect...

Page 32: ...ize 1500 bytes 2048 KB 9000 bytes 4096 KB In a multiclient configuration use a socket buffer size of 2048 KB regardless of the MTU size tcp_delwake_count is a tunable parameter used to delay the wakeup of the receiving process for TCP input segments until a certain amount of data has been placed on the socket queue This count is the number of bytes to be accumulated in the socket receive buffer be...

Page 33: ...mem_max Jumbo Frames and SGI ProPack 3 Using a large maximum transmission unit MTU is necessary for the best 10 Gbit Ethernet performance Generally the bigger the MTU the better The driver supports MTUs as large as 9600 bytes Using a standard 1500 byte MTU will result in 10 Gbit Ethernet performance that is at best only about 50 higher than Gigabit Ethernet Read Write Size and SGI ProPack 3 Applic...

Page 34: ...d SGI ProPack 3 In SGI ProPack 3 proc sys net core rmem_max and proc sys net core wmem_max are both set to 524288 bytes which is usually large enough to provide good performance If you to adjust the socket buffers use sysctl 8 command 18 007 4669 002 ...

Page 35: ... of 2 30 bits per second host Any system connected to the network hostname The name that uniquely identifies each host system on the network IP address A number that uniquely identifies each host system on a TCP IP network LED Light emitting diode a light on a piece of hardware that indicates status or error conditions MAC Medium access control also called the physical layer MAC address The physic...

Page 36: ...h that fans out to multiple clients via 1 Gbit Ethernet NIS Network Information Service a distributed database mechanism for user accounts host names mail aliases and so on PCI Peripheral Component Interconnect a bus specification The PCI bus is a high performance local bus used to connect peripherals to memory and a microprocessor Many vendors offer devices that plug into the PCI bus point to poi...

Page 37: ...onf 8 F features 1 fiber connection 2 fibre optic connections 6 fibre type 2 frame sizes 2 frames 12 functionality verification 7 H hinv 8 I IEEE standards 2 ifconfig 10 12 installation 5 interface names 8 IP address 10 IRIX performance tuning 15 J jumbo frames IRIX performance tuning 15 MTU sizes supported 12 SGI ProPack 3 performance tuning 17 sizes supported 2 L LC connector 2 6 LC fiber connec...

Page 38: ...ore wmem_max 19 R read write size IRIX performance tuning 16 SGI ProPack 3 performance tuning 17 resetting the adapter 11 rmem_max 19 S SGI ProPack 3 performance tuning 17 signaling 2 socket buffer size IRIX performance tuning 16 SGI ProPack 3 performance tuning 17 standard size Ethernet frames 12 supported systems 1 sysctl 18 T TCP IP and tuning 18 Tezro systems 1 tools 3 troubleshooting with LED...

Reviews: