background image

Sun Microsystems, Inc.
www.sun.com

Submit comments about this document at:

http://www.sun.com/hwdocs/feedback

Sun

10-Gigabit Ethernet PCI-X

Adapter Installation and User’s

Guide

Part No. 819-0938-12
December 2005, Revision A

Summary of Contents for Ethernet PCI-X Adapter

Page 1: ...systems Inc www sun com Submit comments about this document at http www sun com hwdocs feedback Sun 10 Gigabit Ethernet PCI X Adapter Installation and User s Guide Part No 819 0938 12 December 2005 Re...

Page 2: ...VALID Copyright 2005 Sun Microsystems Inc 4150 Network Circle Santa Clara Californie 95054 Etats Unis Tous droits r serv s Sun Microsystems Inc a les droits de propri t intellectuels relatants la tech...

Page 3: ...Adapter 6 To Install the Optical Transceiver 7 To Verify the Hardware Installation 9 Rebooting the System 10 Installing the Adapter With Dynamic Reconfiguration 11 Using the Installation Script 11 To...

Page 4: ...e ndd Utility 24 Noninteractive and Interactive Modes 24 To Use the ndd Utility in Noninteractive Mode 24 To Use the ndd Utility in Interactive Mode 25 Setting Parameters Using the ixge conf File 26 T...

Page 5: ...re Manually 49 To Install the Driver Software Manually 49 D Installing the Sun 10 Gigabit Ethernet Device Driver on Linux Platforms 53 Setting Up the Driver in a Linux Platform 53 To Set Up the Driver...

Page 6: ...vi Sun 10 Gigabit Ethernet PCI X Adapter Installation and User s Guide December 2005...

Page 7: ...egister for Alias Read 21 TABLE 3 4 accept jumbo Parameters 22 TABLE 3 5 Read Only ixge Device Capabilities 29 TABLE 3 6 Receive and Transmit Parameters 30 TABLE A 1 Performance Specifications 43 TABL...

Page 8: ...viii Sun 10 Gigabit Ethernet PCI X Adapter Installation and User s Guide December 2005...

Page 9: ...PCI X Adapter with Optical Transceiver Installed 2 FIGURE 1 2 Sun 10 Gigabit Ethernet PCI X Adapter Fiber Optic Channels 3 FIGURE 4 1 Example of Servers Supporting Multiple VLANs With Tagging Adapter...

Page 10: ...x Sun 10 Gigabit Ethernet PCI X Adapter Installation and User s Guide December 2005...

Page 11: ...AC Line Gnd 1 kV AC Line Line and Outdoor Signal Lines 0 5 kV Indoor signal Lines 10m EN61000 4 6 3 V EN61000 4 11 Pass As Information Technology Equipment ITE Class A per as applicable EN55022 1998...

Page 12: ...xii Sun 10 Gigabit Ethernet PCI X Adapter Installation and User s Guide December 2005...

Page 13: ...your system verify that it is correctly installed and install the driver software using the automated script Chapter 3 describes how to configure the driver parameters used by the Sun 10 Gigabit Ethe...

Page 14: ...ch as shutting down the system booting the system and configuring devices Refer to the following for this information Software documentation that you received with your system Solaris Operating System...

Page 15: ...lleged damage or loss caused by or in connection with the use of or reliance on any such content goods or services that are available on or through such sites or resources Typeface The settings on you...

Page 16: ...nt go to http www sun com service contacting Sun Welcomes Your Comments Sun is interested in improving its documentation and welcomes your comments and suggestions You can submit your comments by goin...

Page 17: ...atures on page 3 Product Description The Sun 10 Gigabit Ethernet PCI X adapter is a low profile 133 MHz 10 gigabit Ethernet card utilizing the Intel 82597EX PCI X MAC controller with XFP based 10 giga...

Page 18: ...he supported hardware and software for Sun SPARC systems Note The preceding information is up to date as of the printing of this manual Visit Sun on the World Wide Web at http www sun com for the late...

Page 19: ...MHz compliant Uses the Intel 82597EX PCI X MAC controller Uses XAUI to XFI Serdes Dynamic reconfiguration DR and redundancy failover support kstat and snoop support Support for promiscuous and multica...

Page 20: ...4 Sun 10 Gigabit Ethernet PCI X Adapter Installation and User s Guide December 2005...

Page 21: ...page 11 Using the Installation Script on page 11 Verifying the Software Installation on page 14 Configuring the Network Host Files on page 15 Note If you are installing the Sun 10 Gigabit Ethernet PC...

Page 22: ...an antistatic surface 6 Using a No 2 Phillips screwdriver remove the PCI filler panel from the slot in which you want to insert the PCI adapter Save the filler panel screw for Step 9 7 Insert the adap...

Page 23: ...le from Sun Microsystems 1 Pull the white locking handle into the full horizontal position You will feel the handle click into position when it is fully opened 2 Holding the optical transceiver by the...

Page 24: ...lace 5 Detach the wrist strap Caution If you pull the locking handle down when the optical transceiver is installed remove the optical transceiver entirely and reinstall it The handle operates an inte...

Page 25: ...the OpenBoot ok prompt 2 List the network devices on your system The output from this command is extensive Look for ethernet and network to see the network devices In this example the ethernet 1 devi...

Page 26: ...onfiguration boot on your system ok cd pci 9 600000 ethernet 1 ok properties assigned addresses 83000810 00000000 00100000 00000000 00008000 81000820 00000000 00000300 00000000 00000020 reg 00000800 0...

Page 27: ...it Ethernet CD provides automated installation for the Sun 10 Gigabit Ethernet PCI X driver software In most cases you can use the following procedure and execute the installation script If you have a...

Page 28: ...Gigabit path Sun_10 Gigabit_Ethernet_Driver if you downloaded the driver from the Sun download center 4 Execute the installation script Note After the installation script runs you see a summary of the...

Page 29: ...installed patches Verifying sufficient filesystem capacity dry run method Installing patch packages Patch number 114600 04 has been successfully installed See var sadm patch 114600 04 log for details...

Page 30: ...the modinfo command to verify that you have the current driver v1 30 or later installed If you type grep IXGE using uppercase letters you will get only the specific driver information Installation com...

Page 31: ...instance is from a Sun 10 Gigabit Ethernet PCI X adapter For clarity the instance number is in bold italics 2 Use the ifconfig command to set up the adapter s ixge interface Use the ifconfig command t...

Page 32: ...e 0 is the number of the ixge interface If the instance number were 1 the filename would be etc hostname ixge1 Do not create an etc hostname ixgenumber file for a Sun 10 Gigabit Ethernet adapter inter...

Page 33: ...g the Adapter 17 3 Create an appropriate entry in the etc hosts file for each active ixge interface For example cat etc hosts Internet host table 127 0 0 1 localhost 129 144 10 57 zardoz loghost 129 1...

Page 34: ...18 Sun 10 Gigabit Ethernet PCI X Adapter Installation and User s Guide December 2005...

Page 35: ...arameters The ixge device driver controls the Sun 10 Gigabit Ethernet PCI X adapter The ixge driver is attached to the UNIX pci name property pci8086 1048 for the Sun 10 Gigabit Ethernet PCI X adapter...

Page 36: ...ansmit rate The ixge device is capable of sourcing flow control frames by requesting the link partner to slow down provided that the link partner supports this feature By default the driver advertises...

Page 37: ...0 If adv_asmpause_cap 1 while adv_pause_cap 1 pauses are received If adv_asmpause_cap 1 while adv_pause_cap 0 pauses are transmitted If adv_asmpause_cap 0 while adv_pause_cap 1 pauses are sent and rec...

Page 38: ...u want to configure Jumbo Frames on 2 Kill any snoop or netstat processes running over the interface to be configured 3 Set the instance number In this example the instance number set is 0 4 Set the i...

Page 39: ...To set parameters so they remain in effect after you reboot the system create a platform sun4u kernel drv ixge conf file and add parameter values to this file when you need to set a particular parame...

Page 40: ...ity 2 Use the instance number to select the device The device remains selected until you change the selection Noninteractive and Interactive Modes You can use the ndd utility in two modes Noninteracti...

Page 41: ...eter name and omit the value When you omit the set option the utility queries the named driver instance retrieves the value associated with the specified parameter and prints it To Use the ndd Utility...

Page 42: ...em The parameters you can set are the read and write parameters listed in 10 Gigabit Ethernet Driver Parameter Values and Definitions on page 20 Note Configuring the parameters by putting ndd commands...

Page 43: ...k the etc driver_aliases file to identify the name associated with a particular device Note ixge pci8086 1048 108e 7036 is used by the Sun 10 Gigabit Ethernet adapter b Locate the path names and the a...

Page 44: ...ent name and the unit address for the device Refer to the pci 4 man page for more information about the PCI device specification 2 Set the parameters for the above devices in the platform sun4u kernel...

Page 45: ...Mbit sec full duplex capable 1 10000 Mbit sec full duplex capable cap_10ghdx Local interface half duplex capability 0 Not 10000 Mbit sec half duplex capable 1 10000 Mbit sec half duplex capable cap_1...

Page 46: ...er rx_hdr_drops Number of times an entire page of packets less than 256 bytes each was dropped because the driver was unable to map a new page to replace it rx_hdr_pkts Number of packets received that...

Page 47: ...t time in seconds trunk_mode A value of 1 indicates that a link is aggregated tx_allocb_fail Number of times driver failed to duplicate a packet on transmit tx_ddi_pkts Number of packets that used DDI...

Page 48: ...nsceiver SERDES which is always PCS 3 CODE EXAMPLE 3 1 Output from kstat Command kstat ixge 1 module ixge instance 1 name ixge1 class net brdcstrcv 0 brdcstxmt 0 cap_1000fdx 0 cap_1000hdx 0 cap_100fdx...

Page 49: ...r 0 pcix_bus_mode 1 promisc off qos_mode 0 rbytes 0 rbytes64 0 remote_faults 1 rev_id 28726 rx_allocb_fail 0 rx_hdr_drops 0 rx_hdr_pkts 0 rx_inits 0 rx_jumbo_pkts 0 rx_len_mm 0 rx_msgdup_fail 0 rx_mtu...

Page 50: ...di_pkts 0 tx_dma_bind_fail 0 tx_dvma_pkts 0 tx_hdr_pkts 0 tx_inits 0 tx_jumbo_pkts 0 tx_max_pend 0 tx_msgdup_fail 0 tx_nocanput 0 tx_no_desc 0 tx_starts 0 tx_uflo 0 xcvr_addr 0 xcvr_id 0 xcvr_inits 1...

Page 51: ...Ethernet header maximum payload and crc This value is consistent with the definition of MTU presented by switch vendors Use the following command to get the information Layer 3 Configuration Checking...

Page 52: ...36 Sun 10 Gigabit Ethernet PCI X Adapter Installation and User s Guide December 2005...

Page 53: ...in which case no further configuration is necessary Note If you change any of the VLAN configuration parameters you must reboot the system before the changes take effect If you make changes and do not...

Page 54: ...Example of Servers Supporting Multiple VLANs With Tagging Adapters The example network has the following features The physical LAN network consists of a switch two servers and five clients The LAN is...

Page 55: ...d media hub that is then connected to the switch They belong to VLAN 2 only and are logically in the same IP subnet as the Main Server and Client 5 The switch port connected to this segment has taggin...

Page 56: ...ame broadcast domain just as if there were no VLANs at all VLAN tagging for the switch port turned off Note If you configure a VLAN virtual device for an adapter all traffic sent or received by that a...

Page 57: ...tagging and ports ifconfig ixge123000 plumb up ifconfig ixge4000 plumb up ifconfig a lo0 flags 1000849 UP LOOPBACK RUNNING MULTICAST IPv4 mtu 8232 index 1 inet 127 0 0 1 netmask ff000000 hme0 flags 1...

Page 58: ...42 Sun 10 Gigabit Ethernet PCI X Adapter Installation and User s Guide December 2005...

Page 59: ...r Requirements on page 44 Performance Specifications TABLE A 1 Performance Specifications Feature Specification PCI X clock 66 to 133 MHz max PCI clock 66 MHz PCI I O voltage 3 3V PCI data burst trans...

Page 60: ...ments TABLE A 2 Physical Characteristics Dimension Measurement Length 6 6 inches 167 64 mm Width 2 536 inches 64 61 mm Height Height on component side 0 57 inches 14 48 mm Height on back side 0 105 in...

Page 61: ...and devices The SunVTS software operates primarily from a graphical user interface enabling test parameters to be set quickly and easily while a diagnostic test operation is being performed Note SunV...

Page 62: ...nVTS configuration To Update SunVTS to Recognize the Adapter 1 Plug in a loopback cable 2 Ensure that the SunVTS software and the ixge driver are installed on your system 3 Add the following lines to...

Page 63: ...evice be configured offline before running the test Use the ifconfig 1M command to bring the Ethernet device down before running netlbtest To Use the netlbtest 1 Ensure that the SunVTS software and th...

Page 64: ...48 Sun 10 Gigabit Ethernet PCI X Adapter Installation and User s Guide December 2005...

Page 65: ...hat shipped with the Solaris Supplement CD ROM for a listing of the available network drivers Install the Sun 10 Gigabit Ethernet driver for your updated version of the Solaris Operating System To Ins...

Page 66: ...04 update the VLAN Utility software by installing the 114600 04 patch mkdir cdrom mkdir cdrom cdrom0 mount F hsfs o ro dev dsk c0t6d0s2 cdrom cdrom0 TABLE C 1 Files and Directories on the CD ROM File...

Page 67: ...ackages by typing the following at the command line replacing the OS_VER with your version of the Solaris operating system If your system is running Solaris 9 or 10 software type the following where O...

Page 68: ...ed that they are already present on your system See TABLE C 1 to identify the optional packages pkgadd d Solaris_9 i386 Packages The following packages are available 1 SUNWixgea Sun 10 Gigabit Etherne...

Page 69: ...er Parameters in a Linux Environment on page 56 Setting Up the Driver in a Linux Platform If your system uses the Linux operating system you will need to perform the following procedure to be sure the...

Page 70: ...erver use the following command 4 Install the 10 Gigabit Ethernet rpms using the same command for both RedHat and Suse 5 Use the depmod command to register the Sun 10 Gigabit Ethernet module 6 Load ix...

Page 71: ...ean ipv6 285176 1 autoclean key 78344 0 autoclean ipv6 st 31380 0 autoclean unused sr_mod 16812 0 autoclean unused cdrom 34664 0 autoclean ide cd sr_mod sg 40384 0 autoclean joydev 7136 0 unused evdev...

Page 72: ...the driver parameters can only be set at the time the driver is loaded If you have already loaded the driver and have not set the parameters at the same time Remove the driver and reinstall it ethtoo...

Page 73: ...1 Remove the Sun 10 Gigabit Ethernet PCI X device driver if it is already loaded 2 Load the Sun 10 Gigabit Ethernet PCI X device driver or you can use the insmod command where VAL1 applies to the fir...

Page 74: ...size is 1500 or less the receive buffer size is 2048 bytes When the MTU is greater than 1500 the receive buffer size will be either 4056 8192 or 16384 bytes The maximum MTU size is 16114 RxIntDelay V...

Page 75: ...Plumb the Sun 10 Gigabit Ethernet PCI X interface where xxx xxx xx xxx the IP address of the interface 3 Insert the vlan module 4 Add vlan instance VID 5 Configure ixge vlan eth2 in this example where...

Page 76: ...reated mode specifies the bonding policies miimon is the frequency in milliseconds that MII link monitoring will occur Refer to Linux documentation for more information 2 Load the bonding driver 3 Con...

Page 77: ...50 flow control keywords 21 H hardware requirements 2 I ifconfig a 41 ifconfig command 15 installing the adapter with DR 11 installing the adapter without DR 6 ixge driver parameter status and descri...

Page 78: ...62 Sun 10 Gigabit Ethernet PCI X Adapter Installation and User s Guide December 2005...

Reviews: