background image

Oracle

®

 Dual Port 25 Gb Ethernet Adapter

User's Guide

Part No: E87989-01

September 2017

Summary of Contents for Dual Port 25 Gb

Page 1: ...Oracle Dual Port 25 Gb Ethernet Adapter User s Guide Part No E87989 01 September 2017 ...

Page 2: ......

Page 3: ...of information management applications It is not developed or intended for use in any inherently dangerous applications including applications that may create a risk of personal injury If you use this software or hardware in dangerous applications then you shall be responsible to take all appropriate fail safe backup redundancy and other measures to ensure its safe use Oracle Corporation and its a...

Page 4: ...des informations Ce logiciel ou matériel n est pas conçu ni n est destiné à être utilisé dans des applications à risque notamment dans des applications pouvant causer un risque de dommages corporels Si vous utilisez ce logiciel ou ce matériel dans le cadre d applications dangereuses il est de votre responsabilité de prendre toutes les mesures de secours de sauvegarde de redondance et autres mesure...

Page 5: ...e Adapter 15 Shipping Kit Contents 15 Adapter Overview 16 Front Panel Connectors and LEDs 17 Confirming Specifications and Requirements 19 Physical Specifications 19 Electrical Specifications 20 Environmental Specifications 20 Hardware and Software Requirements 21 Updating Software and Firmware 23 Update the OS Oracle Solaris x86 23 Firmware Update Tool Overview 24 Related Information 24 Installin...

Page 6: ... Windows 37 Configuring the Network 39 Configure the Network Interface Oracle Solaris x86 40 Configure the Network Interface Windows 40 Boot Options 41 Boot Over the Network PXE 41 Boot Over a 10GbE Network Oracle Solaris x86 and Linux 42 Installing RoCE 44 Install RoCE Linux 45 Install RoCE in Windows Kernel Mode 46 Install RoCE in Windows User Mode 47 Install RoCE in VMware ESXi 47 Verifying RoC...

Page 7: ...Configure VLANs Linux 65 Configure VLANs Windows 65 Configure VXLANs Oracle Solaris x86 66 Removing the Driver 69 Remove the bnxt Driver Oracle Solaris x86 69 Remove the bnxt_en Driver Linux 70 Remove the bnxt_en Driver Windows 70 Upgrading the Adapter Linux 71 Install the Upgrade Package 71 Verify the Upgrade 72 Troubleshooting the Adapter Oracle Solaris x86 75 Analyze Why the Device Link Is Miss...

Page 8: ...Contents Glossary 81 Index 85 8 Oracle Dual Port 25 Gb Ethernet Adapter User s Guide September 2017 ...

Page 9: ...ers to the Oracle Dual Port 25 Gb Ethernet Adapter the term x86 refers to 64 bit and 32 bit systems manufactured using processors compatible with the AMD64 Intel Xeon or Intel Pentium product families and the term Oracle Solaris refers to Oracle Solaris 11 3 SRU23 for x86 Product Documentation Library Documentation and resources for this product and related products are available at https docs ora...

Page 10: ...10 Oracle Dual Port 25 Gb Ethernet Adapter User s Guide September 2017 ...

Page 11: ...ris x86 on page 75 Installation Task Overview Oracle Solaris x86 Step Description Links 1 Understand the adapter Understanding the Adapter on page 15 2 Confirm the adapter specifications and technical requirements Physical Specifications on page 19 Electrical Specifications on page 20 Environmental Specifications on page 20 3 Determine if the driver is supported on your server and the driver is up...

Page 12: ...hooting the Adapter Oracle Solaris x86 on page 75 Related Information Installation Task Overview Linux on page 12 Installation Task Overview Windows on page 13 Installation Task Overview Linux Step Description Links 1 Understand the adapter Understanding the Adapter on page 15 2 Confirm the adapter specifications and technical requirements Physical Specifications on page 19 Electrical Specificatio...

Page 13: ...and technical requirements Physical Specifications on page 19 Electrical Specifications on page 20 Environmental Specifications on page 20 3 Determine if the driver is supported on your server and the driver is up to date Hardware and Software Requirements on page 21 4 If your OS is out of date update the entire OS image or download and apply the latest OS patch Updating Software and Firmware on p...

Page 14: ...ows Related Information Installation Task Overview Oracle Solaris x86 on page 11 Installation Task Overview Linux on page 12 Understanding the Adapter on page 15 14 Oracle Dual Port 25 Gb Ethernet Adapter User s Guide September 2017 ...

Page 15: ... on page 25 Installing the Adapter on page 31 Configuring the Network on page 39 Configuring Driver Parameters on page 51 Configuring Jumbo Frames on page 55 Configuring a Link Aggregation Oracle Solaris x86 on page 59 Configuring VLANs and VXLANs on page 63 Removing the Driver on page 69 Troubleshooting the Adapter Oracle Solaris x86 on page 75 Shipping Kit Contents The carton in which the adapte...

Page 16: ...DAC that has transceivers attached at each end Both ports operate at the same speed The adapter is a PCIe 3 0 x8 low profile card Feature Specification Data rate supported per port 2 x 25 GbE where both ports operate at 25 GbpsGbps per port Bus type PCIe V3 0 8 0 GTps Bus width 8 lane PCIe bus connector Conforms to Ethernet standard 802 3 Boot ROM 8 Mb SPI Flash EMI FCC Class A Related Information...

Page 17: ...f your adapter is installed horizontally the ports are numbered 1 and 2 left to right In a vertical orientation the ports are numbered 1 2 bottom to top No Description Device Mbit 1 Port 1 2 Port 2 3 Activity LED Off Blinking Green No activity Traffic flowing activity 4 Link LED Off Solid Green Solid Yellow No link Linked at 25 Gbps Linked at 1 Gbps or 10 Gbps Related Information Shipping Kit Cont...

Page 18: ...18 Oracle Dual Port 25 Gb Ethernet Adapter User s Guide September 2017 ...

Page 19: ...s on page 11 Understanding the Adapter on page 15 Updating Software and Firmware on page 23 Installing the Driver on page 25 Installing the Adapter on page 31 Configuring the Network on page 39 Configuring Driver Parameters on page 51 Configuring Jumbo Frames on page 55 Configuring a Link Aggregation Oracle Solaris x86 on page 59 Configuring VLANs and VXLANs on page 63 Removing the Driver on page ...

Page 20: ...GbE mode 5 traffic Supply voltage 12V 15 Related Information Physical Specifications on page 19 Environmental Specifications on page 20 Hardware and Software Requirements on page 21 Environmental Specifications Specification Operation Storage Temperature 5 C to 35 C 23 C to 95 F noncondensing 40 C to 65 C 40 F to 149 F noncondensing Humidity 10 to 90 noncondensing relative humidity at 27 C 80 6 F ...

Page 21: ...alled The actual internal ambient inside the server local to the card might be higher Related Information Physical Specifications on page 19 Electrical Specifications on page 20 Hardware and Software Requirements on page 21 Hardware and Software Requirements Hardware and software support changes over time For the latest information concerning I O options that are supported by your server refer to ...

Page 22: ...22 Oracle Dual Port 25 Gb Ethernet Adapter User s Guide September 2017 ...

Page 23: ...page 39 Configuring Driver Parameters on page 51 Configuring Jumbo Frames on page 55 Configuring a Link Aggregation Oracle Solaris x86 on page 59 Configuring VLANs and VXLANs on page 63 Removing the Driver on page 69 Troubleshooting the Adapter Oracle Solaris x86 on page 75 Update the OS Oracle Solaris x86 For the latest list of supported platforms and operating systems see Hardware and Software R...

Page 24: ...th the server which contains the firmware update tool Refer to the text files in OSA for instructions on updating your firmware Hardware Management Pack HMP which includes the firmware update tool Refer to the text files in HMP for instructions on updating your firmware The fwupdate Automatic Mode command For more information on this command refer to the Hardware Management Pack 2 3 x Documentatio...

Page 25: ...28 Related Information Understanding the Installation Process on page 11 Updating Software and Firmware on page 23 Installing the Adapter on page 31 Configuring Driver Parameters on page 51 Troubleshooting the Adapter Oracle Solaris x86 on page 75 Verify the bnxt Driver Oracle Solaris x86 The bnxt software package comes bundled in the Oracle Solaris software The bnxt driver does not support SRIOV ...

Page 26: ... bnxt driver is not installed install it Determine the device ID for the device using the scanpci command or equivalent For more information refer to the Oracle Solaris scanpci 1 man page add_drv i pciex14e4 16d7 pciex14e4 16ca bnxt 4 If you removed the driver and would like to reinstall the driver install Oracle Solaris 11 3 SRU23 Related Information Verify the bnxt Driver Oracle Solaris x86 on p...

Page 27: ...ver Linux on page 27 Download and Install the bnxt_en Driver Windows on page 28 Verify the bnxt_en Driver Linux 1 Check the version of the bnxt_en driver modinfo bnxt_en filename lib modules 4 1 12 94 el7uek x86_64 updates bnxt_en ko version 1 7 30 description Broadcom BCM573xx network driver license GPL srcversion 7EEACBE0D0FBD47E43A386D alias pci v000014E4d000016E5sv sd bc sc i alias pci v000014...

Page 28: ... on page 28 Download and Install the bnxt_en Driver Linux on page 26 Installing the Adapter on page 31 Download and Install the bnxt_en Driver Windows If the server uses Windows10 Windows8 Windows7 or Windows Vista XP perform this procedure to download and install the device driver 1 Log in to the server as the administrator 2 Open the Microsoft Device Manager and locate the ORACLE_SSM flash drive...

Page 29: ...ll the bnxt_en Driver Windows See Verify the Adapter Installation Windows on page 37 Related Information Download and Install the bnxt_en Driver Linux on page 26 Installing the Adapter on page 31 Installing the Driver 29 ...

Page 30: ...30 Oracle Dual Port 25 Gb Ethernet Adapter User s Guide September 2017 ...

Page 31: ...tall the SFP28 Transceivers on page 35 Verify the adapter installation Verify the Adapter Installation Oracle Solaris x86 on page 36 Verify the Adapter Installation Linux on page 37 Verify the Adapter Installation Windows on page 37 Related Information Understanding the Adapter on page 15 Confirming Specifications and Requirements on page 19 Updating Software and Firmware on page 23 Installing the...

Page 32: ...ort 1 A 25 GbE 2x25 25GbE Port 2 B 25 GbE Related Information Cable Cautions on page 33 Install the Adapter on page 34 Verify the Adapter Installation Oracle Solaris x86 on page 36 Verify the Adapter Installation Linux on page 37 Verify the Adapter Installation Windows on page 37 Cable and Transceiver Overview The Oracle Dual 25 Gb Ethernet adapter comes with a factory default port mode of 2x25GbE...

Page 33: ...the adapter s top SFP28 port The SFP28 end of the splitter cable connects to the SFP28 transceiver on the adapter while the two pigtails connect to two different 25 GbE SFP28 transceivers on the switch or other device Cable Cautions To prevent data cable damage you must follow these cautions Do not uncoil the cable as a kink might occur Hold the coil closed as you unroll the cable pausing to allow...

Page 34: ... entire cable to and from the points of connection Do not force the cable connector into the receptacle by pushing on the cable Apply connection or disconnection forces at the connector only Related Information Adapter Description on page 32 Install the Adapter on page 34 Install the Adapter These instructions describe the basic tasks required to install the adapter Refer to the server s installat...

Page 35: ...einstall it 9 Detach the wrist strap and close the server 10 Verify the installation Follow the instructions in the appropriate section Verify the Adapter Installation Oracle Solaris x86 on page 36 Verify the Adapter Installation Linux on page 37 Verify the Adapter Installation Windows on page 37 Related Information Adapter Description on page 32 Cable Cautions on page 33 Install the SFP28 Transce...

Page 36: ... Verify the Adapter Installation Oracle Solaris x86 on page 36 Verify the Adapter Installation Linux on page 37 Verify the Adapter Installation Windows on page 37 Related Information Cable and Transceiver Overview on page 32 Adapter Description on page 32 Install the Adapter on page 34 Verify the Adapter Installation Oracle Solaris x86 1 Power on the server and then boot the server 2 Check the ver...

Page 37: ...Adapter on page 34 Verify the Adapter Installation Linux on page 37 Verify the Adapter Installation Windows on page 37 Verify the Adapter Installation Linux Verify the new network interface instances for the adapter root nsn169 178 Linux ifconfig a grep 00 0a ether 00 0a f7 97 b1 4e txqueuelen 1000 Ethernet ether 00 0a f7 97 b1 4f txqueuelen 1000 Ethernet Related Information Adapter Description on...

Page 38: ...k Adapters folder 3 In the Administration tool click Computer Management Device Manager Network Adapter 4 Check the driver version For example the driver version for Microsoft Windows 12 16 is v20 6 123 0 Related Information Install the Adapter on page 34 Configuring the Network on page 39 38 Oracle Dual Port 25 Gb Ethernet Adapter User s Guide September 2017 ...

Page 39: ...rify RDMA on Converged Ethernet Install RoCE Linux on page 45 Install RoCE in Windows Kernel Mode on page 46 Install RoCE in Windows User Mode on page 47 Install RoCE in VMware ESXi on page 47 Verify RoCE in Windows on page 48 Related Information Updating Software and Firmware on page 23 Installing the Driver on page 25 Installing the Adapter on page 31 Configuring Driver Parameters on page 51 Con...

Page 40: ...reate addr T static a local 10 2 3 4 24 net4 v4 This command creates another address 10 2 3 5 24 on interface net1 but marks the address down until explicitly marked up ipadm create addr T static d a 10 2 3 5 24 net4 v4 This command marks the address object net4 v4a up that was previously marked down ipadm up addr net4 v4a Related Information Configure the Network Interface Windows on page 40 Boot...

Page 41: ... x86 Related Information Boot Over the Network PXE on page 41 Boot Over a 10GbE Network Oracle Solaris x86 and Linux on page 42 Boot Over the Network PXE PXE network boot is an environment for booting computers using a network interface independently of available data storage devices such as hard disks or installed OS No boot media is required on the client system With PXE you can install an OS on...

Page 42: ... the MAC addresses 3 Plug the Ethernet cable into the adapter s port 4 Power on the server 5 Press the F2 key or the Control E keys to go to the BIOS menu 6 Go to the Boot Boot Device Priority screen and ensure that the boot order of the network devices is higher than the hard drive 7 Press F10 to save the boot configuration changes and exit BIOS The server should reboot after saving the boot conf...

Page 43: ...he host will perform a PXE boot from the Oracle Dual Port 25 Gb Ethernet adapter port DHCP and the UEFI PXE boot server response This screen appears 11 Choose the UEFI PXE boot server using TFTP protocol 12 Select Oracle Linux OS from the UEFI PXE boot server for the OS installation Configuring the Network 43 ...

Page 44: ...e OS installation process repeats Related Information Boot Over the Network PXE on page 41 Installing RoCE on page 44 Installing RoCE The RDMA software allows computers in a network to exchange data in main memory without involving the processor cache or OS of either computer RDMA can improve throughput and performance because it frees up resources and it can also facilitate a faster data transfer...

Page 45: ...racle Linux The bnxt_en roce file RoCE supported bnxt_en driver which is part of released gzip compressed tar archive The bnxt_re file RoCE driver The libbnxtre file User mode RoCE library module The bnxt_re driver requires a special RoCE enabled version of bnxt_en which is included in the netxtremebnxt_en 1 7 9 tar gz or newer package The bnxt_re driver compilation depends whether IB stack is ava...

Page 46: ...s you specified ldconfig v Refer to the bnxt_re README txt file for more details on configurable options and recommendations Install RoCE in Windows Kernel Mode RoCE functionality is available in user mode and kernel mode application Starting with the Windows Server 2012 release the RDMA capability in the NIC for SMB file traffic is enabled if both ends are enabled for RDMA Broadcom NDIS miniport ...

Page 47: ...ocedure before you run a user mode application that writes to NDSPI 1 Copy the bxndspi dll user mode driver file to the C Windows System32 directory 2 Install the driver rundll32 exe bxndspi dll Config install more Install RoCE in VMware ESXi Before You Begin You must have at least ESXi 6 5 0 GA build 4564106 installed before you perform this procedure You must also have at least ESX6 5 L2 driver ...

Page 48: ...eed bottleneck when the hard disk is reading or writing use a RAM disk as the network share 2 Run these commands from the PowerShell Get SmbMultichannelConnection fl RDMA ClientRdmaCapable True ServerRdmaCapable True If both Client and Server are True any file transfers over this SMB connection use SMB 3 Enable or disable SMB Multichannel support On the Server side Enable Set SmbServerConfiguratio...

Page 49: ...ess on a unique subnet You can increase the number of RDMA connections by adding multiple IP addresses each with different a subnet for the same physical port under test Multiple network shares can be created and mapped to each link partner using the unique IP addresses that you created Configuring the Network 49 ...

Page 50: ...50 Oracle Dual Port 25 Gb Ethernet Adapter User s Guide September 2017 ...

Page 51: ...meters in Linux Set Driver Parameters Linux on page 53 Driver Parameters Linux on page 54 Related Information Understanding the Installation Process on page 11 Understanding the Adapter on page 15 Updating Software and Firmware on page 23 Installing the Driver on page 25 Installing the Adapter on page 31 Configuring the Network on page 39 Troubleshooting the Adapter Oracle Solaris x86 on page 75 S...

Page 52: ... 4 man page for more information about the PCIe device specification 2 Set the parameters for the bnxt conf devices in one of these ways a Copy the bnxt conf file to the kernel drv and edit the copied file Save the bnxt conf file and reboot the system See Driver Parameters Oracle Solaris x86 on page 53 pci 2 0 pci8086 2f08 3 pci108e 3044 0 0 bnxt pci 2 0 pci8086 2f08 3 pci108e 3044 0 1 1 bnxt b Se...

Page 53: ...ber of the transmit descriptors per transmit queue The actual value is rounded up to the next multiple of 8 Allowed values 64 to 4096 default 1024 Receive queue size rx_ring_size Number of the transmit descriptors per receive queue The actual value is rounded up to the next multiple of 8 Allowed values 64 to 4096 default 1024 Related Information Set Driver Parameters Oracle Solaris x86 on page 51 ...

Page 54: ...e is either 4056 8192 or 16384 bytes The maximum MTU size is 16114 RxIntDelay 0 to 65535 0 off 72 Delays the generation of receive interrupts in units of 0 8192 microseconds Receive interrupt reduction can improve CPU efficiency if properly tuned for specific network traffic Increasing this value adds extra latency to frame reception and can end up decreasing the throughput of TCP traffic If the s...

Page 55: ...llation Process on page 11 Installing the Driver on page 25 Installing the Adapter on page 31 Configuring the Network on page 39 Configuring a Link Aggregation Oracle Solaris x86 on page 59 Configuring VLANs and VXLANs on page 63 Troubleshooting the Adapter Oracle Solaris x86 on page 75 Change the MTU Permanently Oracle Solaris x86 Perform one of these actions to permanently change the MTU Add thi...

Page 56: ...ncreases MTUs to the maximum dladm set linkprop t p mtu 9500 net0 The temporary setting lasts only until the next reboot of the server Related Information Change the MTU Permanently Oracle Solaris x86 on page 55 Configure Jumbo Frames Linux on page 56 Configure Jumbo Frames Windows on page 57 Configure Jumbo Frames Linux Jumbo frames can support up to 9500 MTU The default value is 1500 MTU Set the...

Page 57: ...l Panel 2 Click Device Manager and open the Network Adapters folder 3 Right click the Oracle Dual 25G Ethernet Adapter and choose Properties 4 Click Configure 5 Highlight the jumbo frames item and select the desired setting 6 Click Apply for each port Related Information Configure Jumbo Frames Linux on page 56 Configuring VLANs and VXLANs on page 63 Configuring Jumbo Frames 57 ...

Page 58: ...58 Oracle Dual Port 25 Gb Ethernet Adapter User s Guide September 2017 ...

Page 59: ...n page 19 Updating Software and Firmware on page 23 Installing the Driver on page 25 Installing the Adapter on page 31 Configuring the Network on page 39 Configuring Driver Parameters on page 51 Configuring Jumbo Frames on page 55 Configuring VLANs and VXLANs on page 63 Removing the Driver on page 69 Troubleshooting the Adapter Oracle Solaris x86 on page 75 Configure a Link Aggregation Oracle Sola...

Page 60: ...ls about link aggregations as shown in these examples For more information refer to Creating a Link Aggregation in Managing Network Datalinks in Oracle Solaris 11 3 For more information on the commands refer to the Oracle Solaris ifconfig 1M man page and the dladm 5 man page Use the appropriate command to obtain the desired results Use the ifconfig command to examine the details about a link aggre...

Page 61: ...nterface that is configured over the link aggregation For example type ipadm delete ip ip aggr1 where ip aggr1 is the IP interface over the link aggregation 2 Delete each unwanted link aggregation For example dladm delete aggr aggr2 dladm delete aggr aggr2 Related Information Display Information About a Link Aggregation Oracle Solaris x86 on page 60 Configuring VLANs and VXLANs on page 63 Configur...

Page 62: ...62 Oracle Dual Port 25 Gb Ethernet Adapter User s Guide September 2017 ...

Page 63: ...ris x86 on page 75 VLANs Overview Virtual LANs enable you to divide the network into subnetworks without having to add to the physical network environment The subnetworks are virtual and use the same physical network resources VLANs facilitate network administrations because the smaller groups are easier to maintain You can create VLANs according to various criteria but each VLAN must be assigned ...

Page 64: ...0 2 Create a VLAN link over a datalink dladm create vlan l link v vid vlan link where link specifies the link where the VLAN interface is being created vid indicates the VLAN ID number and vlan link specifies the name of the VLAN which can also be an administratively chosen name 3 Verify the VLAN configuration dladm show vlan 4 Create an IP interface over the VLAN ipadm create ip interface where i...

Page 65: ...is the VID Note In Linux systems you can use any single digit as the VID 4 Configure the bnxt_en VLAN For example ifconfig eth6 5 ipv6addressup where ipv6address is the IP address of the interface Related Information Configure VLANs Oracle Solaris x86 on page 64 Configure VLANs Windows on page 65 Configure VXLANs Oracle Solaris x86 on page 66 Configure VLANs Windows 1 Click Control Panel 2 Click N...

Page 66: ...are VLAN configured Note Ensure that the firewall is configured to allow VLAN traffic Otherwise the VLAN might not operate properly Related Information Configure VLANs Oracle Solaris x86 on page 64 Configure VLANs Linux on page 65 Configure VXLANs Oracle Solaris x86 on page 66 Configure VXLANs Oracle Solaris x86 VXLAN is a Layer 2 technology that enables you to create a Layer 2 network on top of a...

Page 67: ...r the VXLAN dladm create vxlan p addr 10 10 10 1 vni 100 vxlan1 dladm create vxlan p addr 10 10 10 1 vni 101 vxlan2 3 Verify the VXLAN configuration dladm show vxlan LINK ADDR VNI MGROUP vxlan1 10 10 10 1 100 224 0 0 1 vxlan2 10 10 10 1 101 224 0 0 1 Related Information Configure VLANs Oracle Solaris x86 on page 64 Configure VLANs Linux on page 65 Configure VLANs Windows on page 65 Removing the Dr...

Page 68: ...68 Oracle Dual Port 25 Gb Ethernet Adapter User s Guide September 2017 ...

Page 69: ...e Solaris x86 on page 69 Remove the driver on a Linux server Remove the bnxt_en Driver Linux on page 70 Remove the driver on a Windows server Remove the bnxt_en Driver Windows on page 70 Related Information Installing the Driver on page 25 Configuring Driver Parameters on page 51 Troubleshooting the Adapter Oracle Solaris x86 on page 75 Remove the bnxt Driver Oracle Solaris x86 Remove the bnxt dri...

Page 70: ...mod bnxt_en Related Information Remove the bnxt_en Driver Windows on page 70 Remove the bnxt Driver Oracle Solaris x86 on page 69 Remove the bnxt_en Driver Linux on page 70 Remove the bnxt_en Driver Windows 1 Click Control Panel 2 Click Device Manager and open the Network Adapters folder 3 Right click the Oracle Dual 25G Ethernet Adapter and choose Uninstall 4 Click OK Related Information Remove t...

Page 71: ...that package files from the same source with the same versioning scheme or format are used for a specific controller These topics describe how to upgrade the adapter Install the Upgrade Package on page 71 Verify the Upgrade on page 72 Install the Upgrade Package Use the bnxtnvm utility to install the NVM upgrade package file 1 Log in to your server 2 Determine the version and description of the pa...

Page 72: ...is command checks the discovered and supported devices For more information on the packages refer to the readme txt file in the bnxtnvm directory of the firmware package 5 Verify the upgrade See Verify the Upgrade on page 72 Verify the Upgrade For more information on the packages refer to the readme txt file in the bnxtnvm directory of the firmware package 1 Log in to your server 2 Determine which...

Page 73: ...Verify the Upgrade Related Information Installing the Adapter on page 31 Troubleshooting the Adapter Oracle Solaris x86 on page 75 Upgrading the Adapter Linux 73 ...

Page 74: ...74 Oracle Dual Port 25 Gb Ethernet Adapter User s Guide September 2017 ...

Page 75: ...aris x86 on page 77 Analyze Why the Link Is Not Up After Back To Back Cable Connection Oracle Solaris x86 on page 78 Analyze Why Changing the MTU Does Not Correctly Set the Link Property Oracle Solaris x86 on page 79 Related Information Updating Software and Firmware on page 23 Installing the Driver on page 25 Installing the Adapter on page 31 Configuring Driver Parameters on page 51 Removing the ...

Page 76: ...and reseating it in another slot does not always clean up the device tree If this occurs you must remove the device tree and reboot the server For more information refer to Managing Network Virtualization and Network Resources in Oracle Solaris 11 3 Related Information Recover From a Port Hang Oracle Solaris x86 on page 76 Analyze Slow Network Performance Oracle Solaris x86 on page 77 Analyze Why ...

Page 77: ...r of packet to receive per interrupt16 4096 1024 by default rx_copy_threshold Packet size to determine bcopy or not during receive0 9216 128 by default tx_copy_threshold Packet size to determine bcopy or not during transmit0 9216 128 by default Related Information Analyze Why the Device Link Is Missing Oracle Solaris x86 on page 75 Analyze Slow Network Performance Oracle Solaris x86 on page 77 Ana...

Page 78: ...tex smtx For more information refer to the Oracle Solaris vmstat 1M man page or the mpstat 1M man page If the performance issue points to the driver profile the call stack for bnxt by using the DTrace script For more information about the DTrace script go to My Oracle Support Related Information Analyze Why the Device Link Is Missing Oracle Solaris x86 on page 75 Recover From a Port Hang Oracle So...

Page 79: ...s Not Correctly Set the Link Property Oracle Solaris x86 The dladm command might display this message dladm warning cannot set link property mtu on net0 link busy It is possible that some objects defined on the link need to be removed or plumbed down Remove and retry the command dladm set linkprop p mtu 9500 net0 For more information refer to the Oracle Solaris dladm 1M man page Related Informatio...

Page 80: ...80 Oracle Dual Port 25 Gb Ethernet Adapter User s Guide September 2017 ...

Page 81: ...er in the Internet protocol suite DNS Domain name system Translates human readable domain names into numerical identifiers E EEPROM Electronically erasable programmable read only memory EMI Electromagnetic interference The interference caused by the magnetic fields of electronic components G Gb Gigabyte GbE Gigabit Ethernet Gbps Gigabits per second Glossary 81 ...

Page 82: ...es several physical ports to be bundled into a single logical channel LOM LAN on motherboard A LAN design M MAC Media access control Enables the use of a unique address for each device on a network Mb Megabit MTU Maximum transmission unit The MTU payload without the Ethernet header affects how jumbo frames function N NIS Network Information Service Originally known as Yellow Pages NIS is a protoco...

Page 83: ...h memory SRC Source code The SRC RPM is used in Linux to build the driver kernel files T TCP Transmission Control Protocol Part of the transport layer of the Internet protocol suite transceiver The 25GbE SFP28 optical transceiver that both ports in the adapter use to transmit data TX Generation The automatic generation mechanism used by the Ethernet PAUSE frames U UDP User Datagram Protocol Part o...

Page 84: ...LANs are supported on a single port enabling a server with a single adapter to have a logical presence on multiple IP subnets VXLAN Virtual eXtensive LAN A tunneling mechanism for providing isolated virtual Layer 2 L2 segments that can span multiple physical L2 segments 84 Oracle Dual Port 25 Gb Ethernet Adapter User s Guide September 2017 ...

Page 85: ...installing the driver Linux 26 installing the driver Windows 28 setting driver parameters Linux 53 boot options 41 options over the network 39 booting over a 10GbE network Linux OS 42 booting over the network using PXE 41 with DHCP 41 bottlenecks 77 C cable cautions 33 copper 32 optical 32 overview 32 configuring driver parameters 51 jumbo frames 55 link aggregation Oracle Solaris x86 59 network 3...

Page 86: ...river Linux 26 bnxt_en driver Windows 28 driver 25 transceivers 35 interface for Windows configuring 40 J jumbo frames changing the MTU permanently Oracle Solaris x86 55 changing the MTU temporarily Oracle Solaris x86 56 configuring Linux 56 configuring Oracle Solaris x86 55 configuring Windows 57 L link aggregation configuring Oracle Solaris x86 59 deleting Oracle Solaris x86 61 displaying inform...

Page 87: ... specifications 19 port hang troubleshooting 76 R RDMA over Converged Ethernet See RoCE removing the driver Linux 70 Oracle Solaris x86 69 Windows 70 resource convention 78 RoCE See installing Linux See installing on VMware ESXi See installing on Windows User Mode See installing on Windows Kernel Mode list of supported OS 44 supported feature combinations 44 S setting driver parameters Linux 54 dr...

Page 88: ...86 25 viewing link aggregation information Oracle Solaris x86 60 VLANs configuring 64 Linux 65 Windows 65 ID 63 overview 63 VXLANs configuring 66 W Windows configure VLANs 65 configuring jumbo frames 57 downloading and installing bnxt_en driver 28 remove the bnxt_en driver 70 task overview 13 verifying adapter installation 37 Windows kernel mode See installing RoCE driver Windows user mode See ins...

Reviews: