background image

Sun Dual 10GbE SFP+ PCIe

ExpressModule

User’s Guide

Part No. 820-4979-12
May 2010, Revision A

Summary of Contents for Sun Dual 10GbE SFP+ PCIe ExpressModule

Page 1: ...Sun Dual 10GbE SFP PCIe ExpressModule User s Guide Part No 820 4979 12 May 2010 Revision A...

Page 2: ...intellectuelle Ils sont conc d s sous licence et soumis des restrictions d utilisation et de divulgation Sauf disposition de votre contrat de licence ou de la loi vous ne pouvez pas copier reproduire...

Page 3: ...on the ExpressModule 3 Hardware and Software Requirements 5 Patches and Updates 6 2 Installing and Setting Up the Device Driver Software 7 Verifying Installing and Removing the Driver on a Solaris Pla...

Page 4: ...r Off 16 Verifying the Installation 19 To Verify the Installation on a Solaris System 19 To Verify the Installation in a Linux System 20 To Verify the Installation in a Microsoft Windows System 20 4 N...

Page 5: ...Aggregations 32 To Display Information About Link Aggregations 33 To Delete Link Aggregations 33 7 Configuring VLANs 35 VLAN Overview 35 Configuring VLANs 38 To Configure Static VLANs in a Solaris Env...

Page 6: ...vi Sun Dual 10GbE SFP PCIe ExpressModule User s Guide May 2010 Index 49...

Page 7: ...comply with the limits for a Class A digital device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference when the equipment is o...

Page 8: ...lowing statement is applicable to products shipped to Taiwan and marked as Class A on the product compliance label CCC Class A Notice The following statement is applicable to products shipped to China...

Page 9: ...the Restriction of Hazardous Substances RoHS directive 2002 95 EC Compliance Model Number 5945532 Product Family Name Sun Dual 10GbE SFP PCIe ExpressModule As Information Technology Equipment ITE Clas...

Page 10: ...x Sun Dual 10GbE SFP PCIe ExpressModule User s Guide May 2010 Santa Clara CA 95054 U S A Tel 650 786 3255 Fax 650 786 3723...

Page 11: ...njury if touched Caution Hazardous voltages are present To reduce the risk of electric shock and danger to personal health follow the instructions Depending on the type of power switch your device has...

Page 12: ...Evitez tout contact Les surfaces sont br lantes Vous risquez de vous blesser si vous les touchez Attention Tensions dangereuses Pour r duire les risques de d charge lectrique et de danger physique obs...

Page 13: ...g Achtung Gefahr von Verletzung und Ger teschaden Befolgen Sie die Anwei sungen Achtung Hei e Oberfl che Nicht ber hren da Verletzungsgefahr durch hei e Oberfl che besteht Achtung Gef hrliche Spannung...

Page 14: ...que se produzcan lesiones personales y da os en el equipo Siga las instrucciones Precauci n Superficie caliente Evite todo contacto Las superficies est n calientes y pueden causar lesiones personales...

Page 15: ...ver software for the ixgbe driver for Solaris Linux and Microsoft Windows Server 2003 operating systems These instructions are designed for enterprise system administrators with experience installing...

Page 16: ...un com support Training http www sun com training Documentation Feedback Submit comments about this document by clicking the Feedback link at http docs sun com Include the title and part number of you...

Page 17: ...and Updates on page 6 Shipping Kit Contents The carton in which your Sun 10GbE XFP SR PCI Express Card was shipped should contain the following items Sun 10GbE XFP SR PCI Express Card Sun Dual 10GbE S...

Page 18: ...ndard and supports standards for system manageability and power management FIGURE 1 1 Sun Dual 10GbE SFP PCIe ExpressModule shown unpopulated See also FIGURE 3 1 and FIGURE 3 2 which show a populated...

Page 19: ...form factor transceivers RoHS compliant lead free technology Intel PROSet Utility for Windows Device Manager Indicator Lights on the ExpressModule On the front panel of the ExpressModule shown in FIG...

Page 20: ...Lights and Attention Switch on a transceiver shown unpopulated See also FIGURE 3 1 and FIGURE 3 2 which show a populated transceiver TABLE 1 1 Indicator Lights for Each Port on the ExpressModule Label...

Page 21: ...te Meaning Action Green Off Power off Insertion or removal of add in cards is permitted All supply voltages except Vaux have been removed from the slot if required for add in card removal Green On Pow...

Page 22: ...ported Products Hardware SPARC based Sun SPARC Enterprise X6300 Server Sun SPARC Enterprise X6340 Server Sun SPARC Enterprise X6450 Server Hardware other Sun Blade X6240 Server Module Sun Blade X6250...

Page 23: ...st recommended patch clusters and security patches at http sunsolve sun com pub cgi show pl target patchpage Search for keyword ixgbe In addition Check the product site at http www sun com products ne...

Page 24: ...laris Platform on page 7 Downloading Installing and Removing the Driver on a Linux Platform on page 8 Downloading Installing and Removing the Driver on a Microsoft Windows Platform on page 11 Verifyin...

Page 25: ...driver comes bundled with the Solaris OS However check for and install the latest patches Apply the necessary patch to get the latest driver See patchadd 1M To Remove the Driver for a Solaris Platfor...

Page 26: ...ion Download Network Adapter Driver for 10 GbE PCI E Based Network Connections for Linux The download begins The file named ixgbe x x x x tar gz is saved in the Desktop directory of your system Note T...

Page 27: ...lowing 7 Check the ixgbe driver version with this modinfo command For example the output might be the following To Remove the Driver From a Linux Platform Use the rmmod command cd temp ixgbe 1 3 16 1...

Page 28: ...F SR Dual Port ExpressModule 4 Select this option Download drivers and software 5 Select one of the following as the operating system For a 64 bit driver Windows Server 2003 Standard x64 Edition For a...

Page 29: ...exe For a 32 bit driver PRO2KXP exe 10 Follow the instructions in the installation wizard 11 If the Found New Hardware Wizard screen is displayed click Cancel The autorun automatically runs after you...

Page 30: ...Installing an Optical Transceiver The Sun 10GbE XFP SR PCI Express Card requires a short range optical transceiver in at least one port to create an Ethernet connection The short range optical transc...

Page 31: ...optical transceiver by the edges align the transceiver with the slot in the ExpressModule and slide the transceiver into the opening 3 Applying even pressure at both corners of the transceiver push t...

Page 32: ...all the second optical transceiver Caution If you pull the locking handle down when the optical transceiver is installed remove the optical transceiver entirely and reinstall it The handle operates an...

Page 33: ...Module in your chassis all ExpressModule slots must be filled with either operating ExpressModules or filler panels To Install the ExpressModule With the Power Off 1 Halt and power off your system 2 P...

Page 34: ...xpressModule Latch 6 Align the ExpressModule with the vacant ExpressModule slot 1 in the following figure Ensure that the ExpressModule s indicator lights on the front panel are facing toward you and...

Page 35: ...sult in damage with the ExpressModule s internal connection to the chassis midplane 8 Complete the installation by closing the ejector lever until the latch snaps into place 3 in the preceding figure...

Page 36: ...After you have installed the Sun 10GbE XFP SR PCI Express Card perform the following tasks to verify the installation To Verify the Installation on a Solaris System 1 Power on the system 2 Check the d...

Page 37: ...t adapter interfaces labeled as Intel R 82598EB 10 Gigabit AF Dual Port Network Connection will be displayed at the Network Connection window screen if the driver is installed successfully 3 To check...

Page 38: ...se the topmost port That port is the logical Port 0 and it has the lowest MAC address Configuring the Network Host Files for a Solaris System After installing the driver software you must plumb up the...

Page 39: ...rk host files dynamically on the command line At reboot the settings will revert 1 Create a file named etc hostname ixgbe for each ixgbe interface where is the ixgbe interface instance number you plan...

Page 40: ...inux Systems 1 Obtain the MAC address of the first Sun 10GbE XFP SR PCI Express Card port by checking the label of the card For the dual port card the MAC address on the label is for the first port Th...

Page 41: ...boot device priority is changed the OS installation process will repeat image pxe mac addr PXE E61 Media test failure check cable PXE MOF Exiting Intel Boot Agent NVIDIA Boot Agent 217 0513 Copyright...

Page 42: ...his chapter lists the available device driver parameters and describes how you can set these parameters Driver Overview on page 25 Driver Parameters for Solaris on page 26 Driver Parameters for Linux...

Page 43: ...default 3 0 Disable 1 Receive only 2 Transmit only 3 Receive and transmit Transmit Receive Queues tx rx queue tx_queue_number The number of the transmit queues Allowed values 1 to 32 default 1 Transm...

Page 44: ...s the hardware node name in the device tree The number not enclosed in quotes is the instance number shown in bold for emphasis The last part in double quotes is the driver name To identify a PCI E de...

Page 45: ...ix_alloc_limit 2 ddi_msix_alloc_limit pcplusmp apic_multi_msi_max pcplusmp apic_msix_max should be equal to rx_queue_number 1 as tx and other events such as link status change require an additional in...

Page 46: ...m the EEPROM If EEPROM is not detected default is 3 This parameter controls the automatic generation Tx and response Rx to Ethernet PAUSE frames RxDescriptiors 64 to 512 512 This value is the number o...

Page 47: ...cific network traffic Increasing this value adds extra latency to frame reception and can end up decreasing the throughput of TCP traffic If the system is reporting dropped receives this value might b...

Page 48: ...enables one or more network links to be aggregated together to form a link aggregation group This link aggregation group appears to MAC clients as a regular link Link aggregation is defined by IEEE 80...

Page 49: ...a link aggregation group with key 1 containing the first two interfaces In this example the l active option turns on LACP mode 3 Create a link aggregation group with key 2 containing the other two in...

Page 50: ...the dladm show aggr s command to show link aggregation statistics 4 Use the dladm show aggr L command to display LACP specific information To Delete Link Aggregations 1 Use the ifconfig command to un...

Page 51: ...34 Sun Dual 10GbE SFP PCIe ExpressModule User s Guide May 2010...

Page 52: ...oot you might experience configuration problems VLAN Overview With multiple VLANs on a card a server with a single card can have a logical presence on multiple IP subnets By default 128 VLANs can be d...

Page 53: ...ANs are commonly used to create individual broadcast domains or separate IP subnets it can be useful for a server to have a presence on more than one VLAN simultaneously Several Sun products support m...

Page 54: ...mponents of this network The Accounting Server is available to only VLAN 3 The Accounting Server is isolated from all traffic on VLANs 1 and 2 The switch port connected to the server has tagging turne...

Page 55: ...the destination MAC address and the source MAC address The tag header consists of two bytes of Ethernet Tag Protocol identifier TPID 0x8100 and two bytes of tag control information TCI FIGURE 7 2 show...

Page 56: ...figured in the etc path_to_inst file to 1000 For example on a server with the Sun PCI Express card having an instance of 2 belonging to a member of two VLANs with VID 123 and 224 you would use ixgbe12...

Page 57: ...ntation that came with your switch for specific instructions for setting VLAN tagging and ports To Configure VLANs in a Linux Environment 1 Ensure that the ixgbe module is loaded 2 Plumb the Sun 10GbE...

Page 58: ...operties 5 Click Configure 6 Click VLAN then click on New 7 Type VLAN with ID for example type Vlan10 8 Click Internet Protocol TCP IP 9 Click Use the following IP address 10 Type the IP address 11 Cl...

Page 59: ...ing device 3 Configure the bondn interfaces In this example two bonds bond0 and bond1 are configured Refer to Linux documentation for more information To Remove Bonding Use the rmmod command to remove...

Page 60: ...Chapter 7 Configuring VLANs 43...

Page 61: ...44 Sun Dual 10GbE SFP PCIe ExpressModule User s Guide May 2010...

Page 62: ...the specifications for Oracle s Sun 10GbE XFP SR PCI Express Card This appendix contains the following sections Connectors on page 46 Table lists the card s operating range Technical Features on page...

Page 63: ...l 10GbE SFP PCIe ExpressModule User s Guide May 2010 Connectors FIGURE A 1 shows the connectors for the Sun 10GbE XFP SR PCI Express Card FIGURE A 1 Sun Dual 10GbE SFP PCIe ExpressModule Connectors un...

Page 64: ...10 Gigabit Gb Bus type PCI Express 2 0 Bus width x8 lane PCI Express Conforms to Ethernet Standard 802 3 Boot ROM 2 Mbit SPI Flash Electromagnetic Interference EMI FCC Class A TABLE A 2 Physical Chara...

Page 65: ...er Requirements Specification Measurement Typical power consumption 14W 1 17A at 12V dual port Main host power supply 12 V 15 Operating temperature 35 to 70 C 95 to 158 F module inlet temperature Stor...

Page 66: ...ware components 1 I ifconfig command 39 installing the ExpressModule 16 installing the ixgbe driver on Linux platforms 8 on Windows platforms 11 J Jumbo Frames 30 L link aggregation in a Solaris envir...

Page 67: ...50 Sun Dual 10GbE SFP PCIe ExpressModule User s Guide May 2010 V verifying the installation 19 virtual device 39 VLAN ID VID 38 VLAN naming format 39...

Reviews: