Chelsio Communications Chelsio T4 Installation And User Manual Download Page 167

Page: 167 / 511

Chapter X. FCoE PDU Offload Target

Chelsio T5/T4 Unified Wire for Linux

Page 167

4.3.

Configuring LUNs on Target

i. Determine the target and initiator WWPNs using the procedure mentioned in previous

section.

ii. Create an SCST configuration file based on your setup. A sample configuration file will be

available at

/etc/chelsio-fcoe/

after Unified Wire installation.

iii. Ensure that SCST handler modules, which are used in configuration (eg:

scst_vdisk

), are

loaded before proceeding.

iv. Configure LUNs on target by running the following command.

[root@host~]# scstadmin -config <LUN_Config_file>

Summary of Contents for Chelsio T4

Page 1: ......

Page 2: ...TWARE IS SUBJECT TO THE SOFTWARE LICENSE TERMS OF CHELSIO COMMUNICATIONS INC Sales For all sales inquiries please send email to sales chelsio com Support For all support related questions please send...

Page 3: ...4 04 12 2013 1 0 5 06 20 2013 1 0 6 08 17 2013 1 0 7 10 22 2013 1 0 8 03 08 2013 1 0 9 05 15 2013 1 1 0 07 26 2013 1 1 1 08 14 2013 1 1 2 12 06 2013 1 1 3 12 19 2013 1 1 4 03 13 2014 1 1 5 05 02 2014...

Page 4: ...M 41 5 Configuring Chelsio Network Interfaces 43 5 1 Configuring 40G adapters 43 5 2 Configuring network scripts 45 5 3 Creating network scripts 45 5 4 Checking Link 46 6 Performance Tuning 47 7 Softw...

Page 5: ...ation and Fine tuning 72 4 1 Testing connectivity with ping and rping 72 4 2 Enabling various MPIs 73 4 3 Setting up NFS RDMA 80 4 4 Performance Tuning 82 V RDMA BLOCK DEVICE DRIVER RBD 83 1 Introduct...

Page 6: ...ce tools iscsictl chisns 128 4 10 Rules of Target Reload i e on the fly changes 133 4 11 System Wide Parameters 135 4 12 Performance Tuning 136 VIII ISCSI PDU OFFLOAD INITIATOR 137 1 Introduction 138...

Page 7: ...e Requirements 175 1 2 Software Requirements 175 2 Software Driver Loading 177 3 Software Driver Unloading 178 4 Software Driver Configuration and Fine tuning 179 4 1 Configuring Cisco Nexus 5010 and...

Page 8: ...nfiguring UDP Pacing 205 XV OFFLOAD IPV6 DRIVER 207 1 Introduction 208 1 1 Hardware Requirements 208 1 2 Software Requirements 208 2 Software Driver Loading 210 3 Software Driver Unloading 211 3 1 Unl...

Page 9: ...Rules 243 3 2 Listing Filter Rules 244 3 3 Removing Filter Rules 245 3 4 Swap MAC feature 245 3 5 Hit Counters 246 XIX TRAFFIC MANAGEMENT 248 1 Introduction 249 1 1 Hardware Requirements 249 1 2 Softw...

Page 10: ...0 6 CLI client 271 6 1 CLI Help system 271 6 2 Client conflict resolution 271 7 Web GUI client 272 7 1 Management Station 272 7 2 Accessing Web Management Interface 273 7 3 Layout and Navigation 276 7...

Page 11: ...DUD 451 7 1 Creating DUD for RedHat Enterprise Linux 451 7 2 Creating DUD for Suse Enterprise Linux 451 8 OS Installation 453 8 1 Installation using Chelsio NIC DUD PXE only 453 8 2 Installation on FC...

Page 12: ...Chapter I Chelsio Unified Wire Chelsio T5 T4 Unified Wire for Linux Page 12 I Chelsio Unified Wire...

Page 13: ...enable a unified fabric over a single wire by simultaneously running all unmodified IP sockets Fibre Channel and InfiniBand applications over Ethernet at line rate Designed for deployment in virtualiz...

Page 14: ...on loading unloading and configuring the drivers tools please refer to their respective sections This product is not supported with the current release Support will be added in upcoming releases FCoE...

Page 15: ...fication files required for building RPM packages src Source code for different drivers support This directory contains source files for the dialog utility tools autoconf 2 63 This directory contains...

Page 16: ...for higher performance It achieves it through modifying the IRQ CPU binding This script can also be used to change Tx coalescing settings t4 forward sh RFC2544 Forward test tuning script uname_r This...

Page 17: ...kage See Software Driver Installation section for more information uninstall py Python script that uninstalls the RPM package See Software Driver Uninstallation section for more information Uboot Ther...

Page 18: ...ter securing the card ensure that the card is still fully seated in the PCIE x8 slot as sometimes the process of securing the card causes the card to become unseated 10 Connect a fiber cable multi mod...

Page 19: ...Ethernet Controller 03 00 4 Ethernet controller Chelsio Communications Inc T420 CR Unified Wire Ethernet Controller 03 00 5 SCSI storage controller Chelsio Communications Inc T420 CR Unified Wire Sto...

Page 20: ...of the adapters as well as the Serial numbers Network device names for Chelsio s physical ports are assigned using the following convention the port farthest from the motherboard will appear as the fi...

Page 21: ...latency specially needed for financial applications NIC TOE iWARP RBD WD UDP IPv6 Sniffer Tracer Bonding MAFO UM Agent Client WebGUI Filtering TM High capacity RDMA Configures adapters to establish a...

Page 22: ...kage IPv6 should be enabled in the machine to use the RPM Packages 3 2 Installing Chelsio Unified Wire from source 3 2 1 GUI mode with Dialog utility i Download the tarball ChelsioUwire x xx x x tar g...

Page 23: ...Choose an action vi Select Enable IPv6 Offload to install drivers with IPv6 Offload support or Disable IPv6 offload to continue installation without IPv6 offload support vii Select the required T5 T4...

Page 24: ...RQs to CPUs Bind MSI X interrupts to different CPUs and disable IRQ balance daemon b Retain IRQ balance daemon Do not disable IRQ balance daemon c TX Coalasce Write tx_coal 2 to modprobe d conf For mo...

Page 25: ...on of OFED software installed you can skip this step by selecting Skip OFED To install OFED 3 18 1 choose the Install OFED option To install OFED 3 12 1 select Choose OFED Version and then OFED 3 12 1...

Page 26: ...allation summary of installed components will be displayed xiii Select View log to view the installation log or Exit to continue xiv Select Yes to exit the installer or No to go back xv Reboot your ma...

Page 27: ...ript to start the GUI installer root host install py ii Select Yes to continue with the installation on the updated kernel or No to exit iii Select the nearest supported kernel version from the list a...

Page 28: ...er successful installation you can press 1 to view the installation log Press any other key to exit from the installer viii Reboot your machine for changes to take effect 3 2 2 1 iWARP driver installa...

Page 29: ...mmands will install iWARP iw_cxgb4 and TOE t4_tom drivers on all the nodes listed in the machinefilename file 3 2 3 CLI mode i Download the tarball ChelsioUwire x xx x x tar gz from Chelsio Download C...

Page 30: ...l To view the list of the supported kernel versions run the following command root host make list_kernels Reboot your machine for changes to take effect 3 2 4 CLI mode individual drivers You can also...

Page 31: ...upport root host make toe_ipv4 root host make toe_ipv4_install To build and install iWARP driver against outbox OFED root host make iwarp root host make iwarp_install To build and install RDMA Block D...

Page 32: ...t make udp_offload_install To build and install FCoE Target drivers root host make fcoe_pdu_offload_target root host make fcoe_pdu_offload_target_install The default T5 T4 configuration tuning option...

Page 33: ...mmand root host install py iv Select the Installation type as described below Enter the corresponding number in the Input field and press Enter 1 Unified Wire Install all the drivers in the Unified Wi...

Page 34: ...lsio Unified Wire package directory and install Unified Wire using root host install py i nic_toe all bypass udpso wd nic_toe NIC and TOE drivers only all all Chelsio drivers built against inbox OFED...

Page 35: ...to ChelsioUwire directory and execute the following command root host install py C m machinefilename i nic_toe all bypass udpso wd c T5 T4 configuration o Here o parameter will install OFED and Chelsi...

Page 36: ...Chapter I Chelsio Unified Wire Chelsio T5 T4 Unified Wire for Linux Page 36 The firmware version can be verified using ethtool root host ethtool i iface...

Page 37: ...decide to use source you can uninstall the package using CLI or GUI mode 4 1 Uninstalling Chelsio Unified Wire from source 4 1 1 GUI mode with Dialog utility i Change your current working directory to...

Page 38: ...T4 Unified Wire for Linux Page 38 iv The selected components will now be uninstalled v After successful uninstalltion summary of the uninstalled components will be displayed vi Select View log to vie...

Page 39: ...and uninstall using the following command root host make uninstall 4 1 3 1 iWARP driver uninstallation on Cluster nodes To uninstal iWARP drivers on multiple Cluster nodes with a single command run t...

Page 40: ...P RDMA Block Device Bypass UDP Segmentation Offload FCoE PDU Offload target drivers and Unified Wire Manager UM To know about other drivers access help by running make help To uninstall NIC driver roo...

Page 41: ...your current working directory to Chelsio Unified Wire package directory and and run the following command root host uninstall py inbox ofed inbox for removing all Chelsio drivers ofed for removing O...

Page 42: ...uninstallation on Cluster nodes To uninstal iWARP drivers on multiple Cluster nodes with a single command run the following root host install py C m machinefilename u The above command will remove Che...

Page 43: ...s 40Gbps link The port nearest to the motherboard will appear as the first network interface Port 0 ii 4X10Gbps In this mode port 0 functions as 4 10Gbps links and port 1 is disabled iii QSA This mode...

Page 44: ...T580 PCI devices 1 T580 LP CR 01 00 0 2 T580 CR 03 00 0 3 T580 LP SO CR 04 00 0 iii Select the adapter to configure by specifying the adapter index iv Select the required mode Possible T580 adapter mo...

Page 45: ...reating network scripts To spot the new interfaces make sure the driver is unloaded first To that point ifconfig a grep HWaddr should display all non chelsio interfaces whose drivers are loaded whethe...

Page 46: ...n the eth1 interface of the adapter can be brought up and down through the ifup eth1 and ifdown eth1 commands respectively Note that it is of course not compulsory to create a configuration file for e...

Page 47: ...Installing the tools which will copy t4_perftune sh script to sbin directory Run the script to map the adapter queues to different CPUs root host t4_perftune sh Also follow the steps mentioned below t...

Page 48: ...any distribution specific problems please check README and Release Notes included in the release for possible workaround Please visit Chelsio support web site http service chelsio com for regular upda...

Page 49: ...Chapter II Network NIC TOE Chelsio T5 T4 Unified Wire for Linux Page 49 II Network NIC TOE...

Page 50: ...zed data flow processor implementation and a host of features designed for high throughput and low latency in demanding conditions and networking environments TCP offload is fully implemented in the h...

Page 51: ...HEL 7 1 LE 3 10 0 229 ael7b ppc64le POWER8 RHEL 6 7 2 6 32 573 el6 RHEL 6 6 2 6 32 504 el6 RHEL 6 5 2 6 32 431 el6 SLES 12 SP1 3 12 49 11 default SLES 12 3 12 28 4 default SLES 11 SP4 3 0 101 63 defau...

Page 52: ...g command root host modprobe cxgb4 2 2 Loading in TOE mode with full offload support To enable full offload support run the following command root host modprobe t4_tom In VMDirect Path environment it...

Page 53: ...ameter root host modprobe t4_tom unsupported_allow_unload 1 ii Stop all the offloaded traffic servers and connections Check for the reference count root host cat sys module t4_tom refcnt If the refere...

Page 54: ...Chapter II Network NIC TOE Chelsio T5 T4 Unified Wire for Linux Page 54 iii Unload the driver root host rmmod t4_tom root host rmmod toecore root host rmmod cxgb4...

Page 55: ...s Guests using the following command root host rmmod cxgb4vf 4 2 Enabling Busy waiting Busy waiting polling is a technique where a process repeatedly checks to see if an event has occurred by spinning...

Page 56: ...ceiving queue interrupts a specific CPU through a specific interrupt now For example on a 4 core system t4_perftune sh gives the following output root host t4_perftune sh Discovering Chelsio T4 T5 dev...

Page 57: ...ue 3 Now interrupts from eth6 are evenly distributed among the 4 CPUs Without T5 T4 s RSS support the interrupts caused by network traffic may be distributed unevenly over CPUs For your information th...

Page 58: ...0 sysctl w net ipv4 tcp_low_latency 1 sysctl w net core netdev_max_backlog 250000 sysctl w net core rmem_max 16777216 sysctl w net core wmem_max 16777216 sysctl w net core rmem_default 16777216 sysctl...

Page 59: ...form a larger packet before pushing them to the receive host network stack By doing this rather than processing every small packet the receiver CPU works on fewer packet headers but with same amount o...

Page 60: ...ote you might need to reboot your system After removing the t4_tom module you can use ethtool to check the status of current GRO LRO settings for example root host ethtool k eth6 Offload parameters fo...

Page 61: ...ed to larger packets This number is usually zero GROMerged is the number of packets that merged to larger packets Usually this number increases if there is any continuous traffic stream present ethtoo...

Page 62: ...Chapter III Virtual Function Network vNIC Chelsio T5 T4 Unified Wire for Linux Page 62 III Virtual Function Network vNIC...

Page 63: ...lude improved disaster recovery server portability cloud computing Virtual Desktop Infrastructure VDI etc Chelsio s T5 and T4 Unified Wire family of Adapters deliver increased bandwidth lower latency...

Page 64: ...29 el7 RHEL 6 7 2 6 32 573 el6 RHEL 6 6 2 6 32 504 el6 RHEL 6 5 2 6 32 431 el6 SLES 12 SP1 3 12 49 11 default SLES 12 3 12 28 4 default SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76 0 11 default U...

Page 65: ...ctions please refer the Network NIC TOE section click here 2 2 Loading the driver The vNIC driver must be loaded on the Guest OS by the root user Any attempt to load the driver as a regular user will...

Page 66: ...r Linux Page 66 3 Software Driver Unloading 3 1 Unloading the driver The vNIC driver must be unloaded on the Guest OS by the root user Any attempt to unload the driver as a regular user will fail To u...

Page 67: ...Chapter IV iWARP RDMA Chelsio T5 T4 Unified Wire for Linux Page 67 IV iWARP RDMA...

Page 68: ...her priority to QPs that implement distributed locking mechanisms The iWARP operation also benefits from the high performance and low latency TCP implementation in the offload engine 1 1 Hardware Requ...

Page 69: ...12 49 11 default SLES 12 3 12 28 4 default SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76 0 11 default Ubuntu 14 04 3 3 19 0 25 generic Ubuntu 14 04 2 3 16 0 30 generic Kernel org linux 4 1 Kernel...

Page 70: ...er Any attempt to load the driver as a regular user will fail To load the iWARP driver we need to load the NIC driver and core RDMA drivers first Run the following commands root host modprobe cxgb4 ro...

Page 71: ...the following command root host rmmod iw_cxgb4 openmpi 1 4 3 can cause IMB benchmark stalls due to a shared memory BTL issue This issue is fixed in openmpi 1 4 5 and later releases Hence it is recomme...

Page 72: ...command on the client machine root host rping c Vv C10 a server_ip_addr p 9999 You should see ping data like this on the client ping data rdma ping 0 ABCDEFGHIJKLMNOPQRSTUVWXYZ _ abcdefghijklmnopqr p...

Page 73: ...pting to accept default setup and empty password phrase iv Create authorization file root host cd ssh root host cat pub authorized_keys root host chmod 600 authorized_keys v Copy directory ssh to all...

Page 74: ...your Chelsio interface name is eth2 then the following line adds a DAT version 2 0 device named chelsio2 for that interface chelsio2 u2 0 nonthreadsafe default libdaplofa so 2 dapl 2 0 eth2 0 Open MPI...

Page 75: ...able iotrace root host make root host make install The above step will install openMPI in usr mpi gcc openmpi x y z v Next create a shell script mpivars csh with the following entry path if echo path...

Page 76: ...LD_LIBRARY_PATH usr mpi gcc openmpi x y z lib64 LD_LIBRARY_PATH LD_LIBRARY_PATH export LD_LIBRARY_PATH fi MPI_ROOT MPI_ROOT usr mpi gcc openmpi x y z export MPI_ROOT vii Next copy the two files create...

Page 77: ...64 enable rdma cm libdir usr mpi gcc mvapich2 x y lib64 root host make root host make install The above step will install MVAPICH2 in usr mpi gcc mvapich2 x y iv Next create a shell script mpivars csh...

Page 78: ...i gcc mvapich2 x y lib64 LD_LIBRARY_PATH LD_LIBRARY_PATH export LD_LIBRARY_PATH fi MPI_ROOT MPI_ROOT usr mpi gcc mvapich2 x y export MPI_ROOT vi Next copy the two files created in steps iv and v to us...

Page 79: ...h you want to build the benchmarks tool against For example in case of openMPI 1 6 4 set the variable as MPI_HOME usr mpi gcc openmpi 1 6 4 iv Next build and install the benchmarks using root host gma...

Page 80: ...Peer core96n8 Workaround Increase the OpenMPI rdma route resolution timeout The default is 1000 or 1000ms Increase it to 30000 with this parameter mca btl_openib_connect_rdmacm_resolve_timeout 30000...

Page 81: ...t modprobe svcrdma iv Start the nfs service as root host service nfs start All services in NFS should start without errors v Now we need to edit the file portlist in the path proc fs nfsd Include the...

Page 82: ...show all directories from server as root host showmount e server chelsio ip iv Once the exported directories are listed mount them as root host mount nfs serverip directory mountpoint on client o vers...

Page 83: ...Chapter V RDMA Block Device Driver RBD Chelsio T5 T4 Unified Wire for Linux Page 83 V RDMA Block Device Driver RBD...

Page 84: ...ed 1 1 Hardware Requirements 1 1 1 Supported Adapters The following are the currently shipping Chelsio adapters that are compatible with Chelsio RDMA block device driver T520 BT T580 CR T520 LL CR T52...

Page 85: ...ng commands to load the RDMA block device driver on the target machine root host modprobe iw_cxgb4 root host modprobe rdma_ucm root host modprobe rbdt On Initiator Run the following commands to load t...

Page 86: ...e following commands to unload the RDMA block device driver on the target machine root host rmmod rbdt root host rmmod rdma_ucm root host rmmod iw_cxgb4 On Initiator Run the following commands to unlo...

Page 87: ...dctl n a 102 1 1 106 d dev ram0 p 65000 Removing a Target Run the following command to remove a target from the initiator machine root host rbdctl r d initiator_device E g root host rbdctl r d dev rbd...

Page 88: ...Chapter VI WD UDP Chelsio T5 T4 Unified Wire for Linux Page 88 VI WD UDP...

Page 89: ...thernet solution for high frequency trading and other delay sensitive applications 1 1 Hardware Requirements 1 1 1 Supported Adapters The following are the currently shipping Chelsio Adapters that are...

Page 90: ...ault SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76 0 11 default Ubuntu 14 04 3 3 19 0 25 generic Ubuntu 14 04 2 3 16 0 30 generic Kernel org linux 4 1 Kernel org linux 3 18 Kernel org linux 3 17 K...

Page 91: ...user will fail RDMA core modules from the OFED package should be loaded before proceeding To load the WD UDP driver use the following commands which will automatically load RDMA core modules root host...

Page 92: ...Chapter VI WD UDP Chelsio T5 T4 Unified Wire for Linux Page 92 3 Software Driver Unloading To unload the WD UDP driver run the following command root host rmmod iw_cxgb4...

Page 93: ...Latency or High Capacity WD tuning option 4 1 1 Application Requirements Certain application behavior is not supported by libcxb4_sock in this release If your application does any of the following it...

Page 94: ...arting your application Preloading using wdload script root host PROT UDP wdload pathto your_application The above command will generate an end point file libcxgb4_sock conf at etc Parameters like int...

Page 95: ...eth2 and eth3 configured for example you can define certain endpoints to eth2 and others to eth3 endpoint interface eth2 port 9999 endpoint interface eth3 port 8888 For VLAN support create your VLANs...

Page 96: ...ion root host LD_PRELOAD libcxgb4_sock_debug so CXGB4_SOCK_DEBUG 1 pathto your_application 4 1 4 Running WD UDP with larger I O size If the I O size is 3988 execute the commands mentioned below root h...

Page 97: ...t r9 root r10 cat etc libcxgb4_sock conf endpoint interface eth1 port 0 root r10 On R10 we run udpserver on port 9000 without libcxgb4_sock preloaded and on port 90001 with preload root r10 usr local...

Page 98: ...termining if the application is being offloaded To see if the application is being offloaded open a window on one of the machines and run tcpdump against the Chelsio interface If you see minimal UDP o...

Page 99: ...Chapter VII iSCSI PDU Offload Target Chelsio T5 T4 Unified Wire for Linux Page 99 VII iSCSI PDU Offload Target...

Page 100: ...protocol is executed in software The performance of this iSCSI stack is outstanding and when used with Chelsio s hardware it is enhanced further Because of the tight integration with Chelsio s TOE ad...

Page 101: ...lease for Microsoft Cluster Support Persistent Reservation Dynamic LUN Resizing iSCSI Target Redirection Multiple Target device types Block Virtual Block LVM Software RAID EVMS etc Built in RAM Disk B...

Page 102: ...are supported block virtual block RAM disk Multiple storage devices are allowed by configuring the devices to one target or the devices to multiple targets The software allows multiple targets to sha...

Page 103: ...16 0 30 generic Kernel org linux 3 18 Kernel org linux 3 17 Kernel org linux 3 6 Other kernel versions have not been tested and are not guaranteed to work Limited QA performed 1 3 2 Requirements for I...

Page 104: ...limitation on what version of the Linux kernel it can run on is mostly dependent on the NIC driver s limitations The iSCSI module will be installed in the lib modules linux_kernel_version updates kern...

Page 105: ...t service loads the kernel module and starts all the targets configured by default It can also be used to stop the targets and restart reload configuration Note i While using rpm tar ball for installa...

Page 106: ...Chapter VII iSCSI PDU Offload Target Chelsio T5 T4 Unified Wire for Linux Page 106 3 Software Driver Unloading Use the following command to unload the module root host rmmod chiscsi_t4...

Page 107: ...et configuration settings Retrieve active sessions information of an iSCSI Target Manually flush data to the iSCSI Target disks Reload the iSCSI configuration file Update the iSCSI configuration file...

Page 108: ...Basic editing of the iSCSI configuration file Basic commands of the iSCSI control tool including how to start and stop a target 4 3 1 A Sample iSCSI Configuration File The default Chelsio iSCSI config...

Page 109: ...Control of the Chelsio iSCSI software is done through iscsictl the command line interface control tool The following are the basic commands needed for effective control of the target Start Target To s...

Page 110: ...global settings execute iscsictl with g option root host iscsictl g Change Global Settings To change Chelsio global settings execute iscsictl with G option root host iscsictl G iscsi_login_complete_t...

Page 111: ...ltiple values they must be listed on one line with a comma to separate their values Another way to list the values instead of commas is to list their values as key value pairs repeatedly each on a new...

Page 112: ...way CHAP DISC_Auth_CHAP_Target user id secret Yes CHAP user id and secret for the target user id must be less than 256 characters Commas are not allowed secret must be between 6 and 255 characters Com...

Page 113: ...is information is unique for each entity block The parameters follow the IETF iSCSI standard RFC 3720 in both definition and syntax The descriptions below are mostly from this RFC Table of iSCSI Entit...

Page 114: ...etAlias target alias No A human readable name or description of a target It is not used as an identifier nor is it for authentication Target only MaxRecvDataSegmentLength 512 to 16777215 224 1 8192 No...

Page 115: ...secret Yes CHAP user id and secret for the initiator user id must be less than 256 characters Commas are not allowed secret must be between 6 and 255 characters Commas are not allowed The initiator us...

Page 116: ...rected to NOTE There can be multiple redirection target portalgroups specified for a particular target portal group and the redirection will happen to these in a round robin manner ShadowMode Yes No N...

Page 117: ...RamDisk size is 16MB 16 Megabytes The minimum value of x is 1 1MB and the maximum value is limited by system memory SN is a 16 character unique value ID is a 24 character unique value WWN is a 16 char...

Page 118: ...that the iSCSI target is listening on i e the target portal IP addresses NOTE when configuring an ACL at least one of the above three must be provided iname and or sip and or dip lun lun list permiss...

Page 119: ...ecret1 DISC_Auth_CHAP_Initiator initiator_id1 initiator_sec1 an iSCSI Target iqn 2006 02 com chelsio diskarray san1 being served by the portal group 5 Setup as a RAM Disk target TargetName iqn 2006 02...

Page 120: ...ortal groups served this target PortalGroup 1 102 50 50 25 3260 PortalGroup 2 102 60 60 25 3260 CHAP configuration Auth_CHAP_Policy Mutual Auth_CHAP_target iTarget1ID iTarget1Secret Auth_CHAP_Initiato...

Page 121: ...essions 4 5 1 Normal Session CHAP Authentication For a normal Session the CHAP authentication is configured on a per target basis 4 5 2 Oneway CHAP authentication With one way CHAP also called unidire...

Page 122: ...or needs to be authenticated or not The default setting of AuthMethod is None CHAP The Auth_CHAP_Policy key controls which CHAP authentication one way or mutual needs to be performed if CHAP is used T...

Page 123: ...ecret Sample Chelsio iSCSI Global Settings global DISC_AuthMethod CHAP DISC_Auth_CHAP_Policy Mutual DISC_Auth_CHAP_Target target_id1 target_secret1 DISC_Auth_CHAP_Initiator initiator_id1 initiator_sec...

Page 124: ...102 60 60 25 initiator iqn 2005 09 com chelsio san2 from 102 50 50 22 and connected via the target portal 102 50 50 25 is allowed read only access of this target ACL iname iqn 2006 02 com chelsio san2...

Page 125: ...arlier in this document 4 7 1 RAM Disk Details For the built in RAM disk The minimum size of the RAM disk is 1 Megabyte MB and the maximum is limited by system memory To use a RAM disk with a Windows...

Page 126: ...The path must exist in the system SYNC When specified the Target will flush all the data in the system cache to the storage driver before sending response back to the Initiator 4 7 3 Example Configur...

Page 127: ...redirect an initiator to use a different IP address and port often called a portal instead of the current one to connect to the target The redirected target portal can either be on the same machine o...

Page 128: ...eceived on a particular portal group to multiple portal groups in a round robin manner Below is an example Redirection to Multiple Portal Groups target snip any login requests received on 10 193 184 8...

Page 129: ...s This option must be specified with one of the following other options S or W For the S option f must be specified first All other options will ignore this f option If the f option is not specified...

Page 130: ...e cached data to the target disk s target name parameter Where name is the name of the target to be flushed name can be one or more string of names separated by a comma name1 name2 nameN ALL A name of...

Page 131: ...iSCSI targets target name parameter Where name is the name of the target s that will be started or reloaded The target name parameter can be specified as one or more parameter on the same command line...

Page 132: ...session This option should be specified with the handle of the session in hex that needs to be dropped The session handle can be retrieved using the previous mentioned iscsictl option r used to retrie...

Page 133: ...tional and if it s not specified it defaults to 3205 The server with the ip address is mandatory and if it s not specified the the command will be denied id isns entity id where id is the iSNS entity...

Page 134: ...y connections and sessions that already completed login phase TargetAlias MaxConnections InitialR2T ImmediateData FirstBurstLength MaxBurstLength MaxOutstandingR2T HeaderDigest DataDigest MaxRecvDataS...

Page 135: ...defaults to CHAP On an iSCSI target when ACL_Enable is set to Yes iscsi_auth_order decides whether to perform CHAP first then ACL or perform ACL then CHAP ACL When setting iscsi_auth_order ACL initiat...

Page 136: ...and identify if the initiator is running Chelsio drivers if the initiator name contains the same substring as iscsi_chelsio_ini_idstr it is assumed the initiator is running with the Chelsio iscsi init...

Page 137: ...Chapter VIII iSCSI PDU Offload Initiator Chelsio T5 T4 Unified Wire for Linux Page 137 VIII iSCSI PDU Offload Initiator...

Page 138: ...TTT in Data Out PDUs PDU Transmit and Recovery On transmit side Chelsio hardware accepts the complete PDU header data from the host driver computes and inserts the digests decomposes the PDU into mul...

Page 139: ...10 0 229 el7 RHEL 7 1 BE 3 10 0 229 el7 ppc64 POWER7 RHEL 7 1 LE 3 10 0 229 ael7b ppc64le POWER8 RHEL 6 7 2 6 32 573 el6 RHEL 6 6 2 6 32 504 el6 RHEL 6 5 2 6 32 431 el6 SLES 12 SP1 3 12 49 11 default...

Page 140: ...n 0 On SLES load the driver with allow option root host modprobe cxgb4i lro_on 0 allow If loading of cxgb4i displays unkown symbols found error in dmesg follow the steps mentioned below i Kill iSCSI d...

Page 141: ...VIII iSCSI PDU Offload Initiator Chelsio T5 T4 Unified Wire for Linux Page 141 3 Software Driver Unloading To unload the driver execute the following commands root host rmmod cxgb4i root host rmmod l...

Page 142: ...ce ipaddress iscsi ip address E g iface iscsi_ifacename cxgb4i 00 07 43 04 5b da iface hwaddress 00 07 43 04 5b da iface transport_name cxgb4i iface net_ifacename eth3 iface ipaddress 102 2 2 137 Alte...

Page 143: ...b da iii Logging into an iSCSI Target Log into an iSCSI target using the following format iscsiadm m node T iqn name of target p target ip address target port no I cxgb4i iface file name l E g root ho...

Page 144: ...ame of target p target ip address target port no I cxgb4i iface file name u E g root host iscsiadm m node T iqn 2004 05 com chelsio target1 p 102 2 2 155 3260 1 I cxgb4i 00 07 43 04 5b da u 4 2 Auto l...

Page 145: ...d Wire for Linux Page 145 E g force_start echo n Starting prog modprobe q iscsi_tcpmodprobe q ib_iser modprobe q cxgb4i modprobe q cxgb3i modprobe q bnx2i modprobe q be2iscsi daemon brcm_iscsiuio daem...

Page 146: ...Chapter IX Data Center Bridging DCB Chelsio T5 T4 Unified Wire for Linux Page 146 IX Data Center Bridging DCB...

Page 147: ...tion Administration is simplified since the specifications enable transport of storage and networking traffic over a single unified Ethernet network 1 1 Hardware Requirements 1 1 1 Supported Adapters...

Page 148: ...or Linux Page 148 Ubuntu 14 04 3 3 19 0 25 generic Ubuntu 14 04 2 3 16 0 30 generic Kernel org linux 4 1 Kernel org linux 3 18 Kernel org linux 3 17 Kernel org linux 3 6 Other kernel versions have not...

Page 149: ...pport and FCoE Initiator csiostor drivers must be loaded in order to enable DCB feature Also the drivers must be loaded by the root user Any attempt to load the drivers as a regular user will fail Run...

Page 150: ...re for Linux Page 150 3 Software Driver Unloading To disable DCB feature unload FCoE Initiator and Network drivers root host rmmod csiostor root host rmmod cxgb4 If t4_tom is loaded please reboot mach...

Page 151: ...affic priorities NIC uses priority 0 and FcoE uses priority 3 switch config class map type qos class nic switch config cmap qos match cos 0 switch config cmap qos class map type qos class fcoe switch...

Page 152: ...rcent 0 vii Configure network qos policy maps and set up the PFC for no drop traffic class switch config policy map type network qos policy test switch config pmap nq class type network qos class nic...

Page 153: ...exit switch config vsan database switch config vsan db vsan 2 switch config vsan db vsan 2 interface vfc 13 switch config vsan db exit iii Assign VLAN ID to the Ethernet port on which FCoE service was...

Page 154: ...iator and the target on that particular VSAN although FLOGI d into the switch will not talk to each other To enable it execute the below command switch config zone default zone permit vsan 2 4 2 Confi...

Page 155: ...er rule 2 proto fip encap ethv2 switch config vlan classifier group 1 add rule 1 switch config vlan classifier group 1 add rule 2 switch config interface vlan 1002 switch conf if vl 1002 fcf forward s...

Page 156: ...for running NIC and iSCSI traffic and configure corresponding VLAN priority Example Switch is configured with a VLAN priority of 2 and 5 for NIC and iSCSI class of traffic respectively NIC traffic is...

Page 157: ...Chapter X FCoE PDU Offload Target Chelsio T5 T4 Unified Wire for Linux Page 157 X FCoE PDU Offload Target...

Page 158: ...nts 1 1 1 Supported Adapters The following are the currently shipping Chelsio Adapters that are compatible with FCoE PDU offload target driver T520 CR T520 LL CR T580 LP CR T580 CR 1 2 Software Requir...

Page 159: ...oad the driver in FCF mode run the following command root host modprobe chfcoe To load the driver in VN2VN mode run the following command root host modprobe chfcoe chfcoe_fip_mode 1 To load the driver...

Page 160: ...Chapter X FCoE PDU Offload Target Chelsio T5 T4 Unified Wire for Linux Page 160 3 Software Driver Unloading To unload the driver run the following command root host modprobe r chfcoe...

Page 161: ...set the traffic priorities NIC uses priority 0 and FcoE uses priority 3 switch config class map type qos class nic switch config cmap qos match cos 0 switch config cmap qos class map type qos class f...

Page 162: ...coe switch config pmap c que bandwidth percent 50 switch config pmap c que class type queuing class default switch config pmap c que bandwidth percent 0 vii Configure network qos policy maps and set u...

Page 163: ...annel VFC and binds that VFC to an Ethernet interface so that the Ethernet port begins functioning as an FCoE port switch config interface vfc 13 switch config if bind interface ethernet 1 13 switch c...

Page 164: ...switch config zone default zone permit vsan 2 4 2 Collecting port information To create a SCST target configuration enable the interfaces Next determine the WWPN of target and initiator nodes using th...

Page 165: ...the local port information root host cxgbtool stor a adapter_device_file show lnode If FCoE PDU Offload Target is operating in FCF mode then the local node information will be available only after the...

Page 166: ...helsio T5 T4 Unified Wire for Linux Page 166 4 2 2 Verifying remote ports To verify remote ports fabric name server initiator ports etc use the following command root host cxgbtool stor a adapter_devi...

Page 167: ...previous section ii Create an SCST configuration file based on your setup A sample configuration file will be available at etc chelsio fcoe after Unified Wire installation iii Ensure that SCST handler...

Page 168: ...arget Chelsio T5 T4 Unified Wire for Linux Page 168 The following configuration file adds three LUNs RAMDisk physical disk NULLIO disk for the target specified Only initiators present in the group wil...

Page 169: ...P 4 4 Configuring Persistent Target chfcoe service is required to configure persistent target and will be installed during Unified Wire installation Please follow the procedure mentioned below i Based...

Page 170: ...l be in disabled state Enable it using the following command root host chkconfig chfcoe on To determine the run levels on which the service is enabled run the following command root host chkconfig lis...

Page 171: ...d in the system Follow the steps mentioned below to do so root host chkconfig list irqbalance irqbalance 0 off 1 off 2 on 3 on 4 on 5 on 6 off root host chkconfig irqbalance off root host service irqb...

Page 172: ...command will load chfcoe module in VN2VN mode and create 12 chfcoe workers on NUMA node 0 Binding one chfcoe worker per CPU Use the following command to bind chfcoe workers to CPUs 2 3 4 5 6 7 18 19...

Page 173: ...1 smp_affinity Writing 20000 in proc irq 152 smp_affinity Writing 1 in proc irq 153 smp_affinity Writing 2 in proc irq 154 smp_affinity Writing 10000 in proc irq 155 smp_affinity Writing 20000 in proc...

Page 174: ...Chapter XI FCoE Full Offload Initiator Chelsio T5 T4 Unified Wire for Linux Page 174 XI FCoE Full Offload Initiator...

Page 175: ...hannel networks and management software 1 1 Hardware Requirements 1 1 1 Supported Adapters The following are the currently shipping Chelsio Adapters that are compatible with FCoE full offload Initiato...

Page 176: ...FCoE Full Offload Initiator Chelsio T5 T4 Unified Wire for Linux Page 176 Kernel org linux 3 17 Kernel org linux 3 6 Other kernel versions have not been tested and are not guaranteed to work Limited Q...

Page 177: ...t user Any attempt to load the driver as a regular user will fail To load the driver execute the following root host modprobe csiostor To load the driver on any SLES distribution execute the following...

Page 178: ...T5 T4 Unified Wire for Linux Page 178 3 Software Driver Unloading To unload the driver root host modprobe r csiostor If multipath services are running unload of FCoE driver is not possible Stop the mu...

Page 179: ...itch use the following command to see if the FIP has gone through and a VN_Port MAC address has been assigned Verify if all the FCoE ports are online ready and a successful FIP has taken place using t...

Page 180: ...Chapter XI FCoE Full Offload Initiator Chelsio T5 T4 Unified Wire for Linux Page 180...

Page 181: ...the WWPN of the initiator local port under sysfs The hosts under fc_host depends on the number of ports on the adapter used root host cat sys class fc_host hostX port_name iii After finding the localp...

Page 182: ...itiator Chelsio T5 T4 Unified Wire for Linux Page 182 After finding out the WWPN of the local node to verify the list of discovered targets use the following command root host cxgbtool stor a adapter_...

Page 183: ...XI FCoE Full Offload Initiator Chelsio T5 T4 Unified Wire for Linux Page 183 4 3 Formatting the LUNs and Mounting the Filesystem Use lsscsi g to list the LUNs discovered by the initiator root host ls...

Page 184: ...s discovered by the Chelsio FCoE initiators can be accessed via easily identifiable udev path device files like root host ls dev disk by path pci 0000 04 00 0 csio fcoe local_wwpn remote_wwpn lun_wwn...

Page 185: ...Full Offload Initiator Chelsio T5 T4 Unified Wire for Linux Page 185 4 5 Mounting the formatted LUN The formatted LUN can be mounted on the specified mountpoint using the following command root host m...

Page 186: ...Chapter XII Offload Bonding driver Chelsio T5 T4 Unified Wire for Linux Page 186 XII Offload Bonding driver...

Page 187: ...e T5 T4 Adapter thus freeing the CPU from TCP IP overhead 1 1 Hardware Requirements 1 1 1 Supported Adapters The following are the currently shipping Chelsio Adapters that are compatible with the Chel...

Page 188: ...28 4 default SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76 0 11 default Ubuntu 14 04 3 3 19 0 25 generic Ubuntu 14 04 2 3 16 0 30 generic Kernel org linux 4 1 Kernel org linux 3 18 Kernel org lin...

Page 189: ...ing The driver must be loaded by the root user Any attempt to load the driver as a regular user will fail To load the driver with offload support run the following command root host modprobe bonding P...

Page 190: ...Chapter XII Offload Bonding driver Chelsio T5 T4 Unified Wire for Linux Page 190 3 Software Driver Unloading To unload the driver run the following command root host rmmod bonding...

Page 191: ...erface use the following method i Load the network driver with TOE support root host modprobe t4_tom ii Create a bonded interface root host modprobe bonding mode 1 miimon 100 iii Bring up the bonded i...

Page 192: ...Chapter XIII Offload Multi Adapter Failover MAFO Chelsio T5 T4 Unified Wire for Linux Page 192 XIII Offload Multi Adapter Failover MAFO...

Page 193: ...ffective fault tolerance The traffic running over the bonded interface can be fully offloaded to the Adapter thus freeing the CPU from TCP IP overhead 1 1 Hardware Requirements 1 1 1 Supported Adapter...

Page 194: ...S 12 3 12 28 4 default SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76 0 11 default Ubuntu 14 04 3 3 19 0 25 generic Ubuntu 14 04 2 3 16 0 30 generic Kernel org linux 4 1 Kernel org linux 3 18 Kerne...

Page 195: ...er Loading The driver must be loaded by the root user Any attempt to load the driver as a regular user will fail To load the driver with offload support run the following command root host modprobe bo...

Page 196: ...Chapter XIII Offload Multi Adapter Failover MAFO Chelsio T5 T4 Unified Wire for Linux Page 196 3 Software Driver Unloading To unload the driver run the following command root host rmmod bonding...

Page 197: ...om ii Create a bonded interface root host modprobe bonding mode 1 miimon 100 iii Bring up the bonded interface and enslave the interfaces to the bond root host ifconfig bond0 up root host ifenslave bo...

Page 198: ...Chapter XIV UDP Segmentation Offload and Pacing Chelsio T5 T4 Unified Wire for Linux Page 198 XIV UDP Segmentation Offload and Pacing...

Page 199: ...g in millions of system calls and packet traversals through all protocol layers in the operating system to the network device In contrast USO implements the network protocol stack in the adapter and t...

Page 200: ...ver is available for the following versions RHEL 7 2 3 10 0 327 el7 RHEL 7 1 3 10 0 229 el7 RHEL 6 7 2 6 32 573 el6 RHEL 6 6 2 6 32 504 el6 RHEL 6 5 2 6 32 431 el6 SLES 12 SP1 3 12 49 11 default SLES...

Page 201: ...ver as a regular user will fail Run the following commands to load the driver root host modprobe cxgb4 root host modprobe t4_tom Though normally associated with the Chelsio TCP Offload engine the t4_t...

Page 202: ...n Offload and Pacing Chelsio T5 T4 Unified Wire for Linux Page 202 3 Software Driver Unloading Reboot the system to unload the driver To unload without rebooting refer Unloading the TOE driver section...

Page 203: ...n the data stream to This value needs to be in the range of 0 to 14 for T4 series of adapters and a range of 0 to 15 for T5 series of adapters The application will function according to the parameters...

Page 204: ...and sends out the data In order to use the UDP offload functionality for RTP data make the following additions to the steps mentioned above 1 In step ii declare and initialize a new variable in the ap...

Page 205: ...hannel Channel No class scheduler class index max rate maximum rate pkt size Packet size Here ethX is the Chelsio interface Channel No is the port on which data is flowing 0 3 scheduler class index is...

Page 206: ...type packet level cl rl mode flow rate unit bits rate mode absolute channel 0 class 1 max rate 10000 pkt size 1316 To get an accurate bit rate per class data sent by the application to the sockets sh...

Page 207: ...Chapter XV Offload IPv6 driver Chelsio T5 T4 Unified Wire for Linux Page 207 XV Offload IPv6 driver...

Page 208: ...1 1 Hardware Requirements 1 1 1 Supported Adapters The following are the currently shipping Chelsio Adapters that are compatible with Chelsio Offload IPv6 feature T520 BT T580 CR T520 LL CR T520 CR T...

Page 209: ...ES 12 3 12 28 4 default SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76 0 11 default Ubuntu 14 04 3 3 19 0 25 generic Ubuntu 14 04 2 3 16 0 30 generic Kernel org linux 4 1 Kernel org linux 3 18 Kern...

Page 210: ...upport see Software Driver Installation After installing Unified Wire package and rebooting the host load the NIC cxgb4 and TOE t4_tom drivers The drivers must be loaded by the root user Any attempt t...

Page 211: ...load IPv6 feature unload NIC and TOE drivers 3 1 Unloading the NIC driver To unload the NIC driver run the following command root host rmmod cxgb4 3 2 Unloading the TOE driver Please reboot the system...

Page 212: ...Chapter XVI Bypass Driver Chelsio T5 T4 Unified Wire for Linux Page 212 XVI Bypass Driver...

Page 213: ...re programmable behavior on power fails either Bypass Mode or Drop Mode Firmware control of Bypass Normal Drop Modes when T4 timer expires Bypass control via software Drop Mode control by putting the...

Page 214: ...s called a rule When a rule is matched an action is applied to the ingress packet The actions that are supported are drop forward and input The drop action causes the packet to be discarded The forwar...

Page 215: ...RHEL 6 7 2 6 32 573 el6 RHEL 6 6 2 6 32 504 el6 RHEL 6 5 2 6 32 431 el6 SLES 12 SP1 3 12 49 11 default SLES 12 3 12 28 4 default SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76 0 11 default Ubuntu 1...

Page 216: ...with Bypass support as mentioned in CLI mode individual drivers section The driver must be loaded by the root user Any attempt to load the driver as a regular user will fail Run the following command...

Page 217: ...Chapter XVI Bypass Driver Chelsio T5 T4 Unified Wire for Linux Page 217 3 Software Driver Unloading Run the following command to unload the Bypass driver root host rmmod cxgb4...

Page 218: ...e created that implements the Bypass API as specified below This CLI will then communicate the requests to the SDK server The API will contain the following elements Bypass Management watchdog state R...

Page 219: ...watchdog enable disable lock ping bypass ethX get watchdog_timeout timeout in milliseconds bypass ethX set watchdog_timeout timeout in milliseconds maximum is 60000 4 2 2 Operating the Switch Example...

Page 220: ...nds root host bypass ethX set watchdog_timeout 3000 Start pinging the watchdog root host while true do bypass ethX set watchdog ping sleep 1 done Enable the watchdog root host bypass ethX set watchdog...

Page 221: ...to any srcaddr Source IP address dstaddr Destination IP address vlan VLAN id action input forward drop default input port If action is input then this is the port to which the packet is directed srcm...

Page 222: ...e that is used to hold a set of rules redirect ethX activate_table table table id Activate a table so that all the rules in it will be active redirect ethx deactivate_table table table id Deactivate a...

Page 223: ...e current configured rules tables persistent redirect the output to etc ba cfg file only root host redirect ethX dump etc ba cfg where the etc ba cfg is read by the bad service at boot time To apply t...

Page 224: ...Chapter XVII WD Sniffing and Tracing Chelsio T5 T4 Unified Wire for Linux Page 224 XVII WD Sniffing and Tracing...

Page 225: ...icast traffic and sending it directly to user space a Get a Queue raw QP idx b Program a filter to redirect specific traffic to the raw QP queue Tracer All tapped traffic is forwarded to user space an...

Page 226: ...ed Wire for Linux Page 226 Schematic diagram of sniffer and tracer 1 1 Hardware Requirements 1 1 1 Supported Adapters The following are the currently shipping Chelsio Adapters that are compatible with...

Page 227: ...g version RHEL 7 2 3 10 0 327 el7 RHEL 7 1 3 10 0 229 el7 RHEL 6 7 2 6 32 573 el6 RHEL 6 6 2 6 32 504 el6 RHEL 6 5 2 6 32 431 el6 SLES 12 SP1 3 12 49 11 default SLES 12 3 12 28 4 default SLES 11 SP4 3...

Page 228: ...s with one machine having a T5 T4 card The machines should be setup in the following manner Machine A Machine B 192 168 1 100 192 168 1 200 2 Procedure On the Device Under Test DUT start sniffer root...

Page 229: ...Procedure Run wd_tcpdump_trace i iface on the command prompt where iface is one of the interfaces whose traffic you want to trace In the above diagram its port 0 or port 1 root host wd_tcpdump_trace...

Page 230: ...Chapter XVIII Classification and Filtering Chelsio T5 T4 Unified Wire for Linux Page 230 XVIII Classification and Filtering...

Page 231: ...th to Steer ingress packets that meet ACL Access Control List accept criteria to a particular receive queue Switch proxy ingress packets that meet ACL accept criteria to an output port with optional h...

Page 232: ...L 7 1 3 10 0 229 el7 RHEL 6 7 2 6 32 573 el6 RHEL 6 6 2 6 32 504 el6 RHEL 6 5 2 6 32 431 el6 SLES 12 SP1 3 12 49 11 default SLES 12 3 12 28 4 default SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76...

Page 233: ...is set by default and packets will be matched accordingly i For T5 filterMode fcoemask srvrsram fragmentation mpshittype protocol vlan port fcoe ii For T4 filterMode fragmentation mpshittype protocol...

Page 234: ...xgbtool ethx filter index action pass drop switch Where ethX Chelsio interface index positive integer set as filter id action Ingress packet disposition pass Ingress packets will be passed through set...

Page 235: ...s use the prio argument with the above command root host cxgbtool ethx filter index action pass drop switch prio 1 2 3 Listing Filter Rules To list the filters set run the following command root host...

Page 236: ...ost ifconfig eth0 eth0 Link encap Ethernet HWaddr 00 07 43 04 7D 50 inet addr 102 1 1 1 Bcast 102 1 1 255 Mask 255 255 255 0 inet6 addr fe80 207 43ff fe04 7d50 64 Scope Link UP BROADCAST RUNNING PROMI...

Page 237: ...onfig eth0 3 102 1 2 3 24 up root host ifconfig eth0 eth0 Link encap Ethernet HWaddr 00 07 43 12 D4 88 inet addr 102 1 2 1 Bcast 102 1 2 255 Mask 255 255 255 0 inet6 addr fe80 7 4300 112 d488 64 Scope...

Page 238: ...729 60 2 KiB Interrupt 16 root host ifconfig eth1 102 1 2 250 24 up root host ifconfig eth1 eth1 Link encap Ethernet HWaddr 00 07 43 04 96 48 inet addr 102 1 2 250 Bcast 102 1 2 255 Mask 255 255 255 0...

Page 239: ...24 hitcnts 1 action switch eport 0 smac 00 07 43 04 96 40 dmac 00 07 43 04 7D 50 Where smac is the MAC address of eth0 interface on T5 adapter machine and dmac is the MAC address of eth0 interface on...

Page 240: ...ns 0 carrier 0 collisions 0 txqueuelen 1000 RX bytes 1585952 1 5 MiB TX bytes 4798122 4 5 MiB Interrupt 16 ii Setup ARP entry to reach 102 1 1 2 root host arp s 102 1 1 2 00 07 43 12 D4 88 Follow thes...

Page 241: ...h0 up promisc root host ifconfig eth1 up promisc iv Build and install latest iproute2 package v Add fdb entry corresponding to Node 2 on T5 s eth0 interface root host bridge fdb add 00 07 43 12 D4 88...

Page 242: ...helsio T5 T4 Unified Wire for Linux Page 242 ix Create a filter to match incoming packet s dst mac 00 07 43 04 7d 50 with particular mac idx and switch it out via eport 0 root host cxgbtool eth0 filte...

Page 243: ...ex action pass drop switch fip source ip of incoming packet lip destination ip of incoming packet fport source port lport destination port hitcnts 1 cap maskless Where ethX Chelsio interface index Fil...

Page 244: ...ort 12000 hitcnts 1 cap maskless proto 6 Hash Filter Index 308184 The above filter rule will pass all TCP packets matching above 4 tuple Switch action root host cxgbtool ethX filter 496 action switch...

Page 245: ...ses This is applicable only for switch filter rules Here s an example root host cxgbtool eth2 filter 1 action switch lip 102 2 2 1 fip 102 2 2 2 lport 5001 fport 14000 hitcnts 1 iport 1 eport 0 swapma...

Page 246: ...s_id trace0 iii Configure RSS Queue to send trace packets Determine the RspQ ID of the queues by looking at Trace QType in sys kernel debug cxgb4 bus id sge_qinfo file root host cxgbtool ethX reg 0x0a...

Page 247: ...Trace Queue0 RspQ ID iv Similarly for other direction and for multiple ports run the follow commands root host echo rx0 snaplen 40 sys kernel debug cxgb4 bus_id trace1 root host echo tx1 snaplen 40 s...

Page 248: ...XIX Traffic Management Chelsio T5 T4 Unified Wire for Linux Page 248 XIX Traffic Management...

Page 249: ...esence of other traffic Control max bandwidth that a connection or a flow a group of connections can use Allocate available bandwidth to several connection or flows based on desired levels of performa...

Page 250: ...9 el7 RHEL 6 7 2 6 32 573 el6 RHEL 6 6 2 6 32 504 el6 RHEL 6 5 2 6 32 431 el6 SLES 12 SP1 3 12 49 11 default SLES 12 3 12 28 4 default SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76 0 11 default Ub...

Page 251: ...ections as well as on offloaded connections The drivers must be loaded by the root user Any attempt to load the drivers as a regular user will fail Run the following commands to load the TOE driver ro...

Page 252: ...agement Chelsio T5 T4 Unified Wire for Linux Page 252 3 Software Driver Unloading Reboot the system to unload the driver To unload without rebooting refer Unloading the TOE driver section of Network N...

Page 253: ...te mode channel Channel No class scheduler class index max rate maximum rate pkt size Packet size Here ethX is the Chelsio interface scheduler mode specifies whether the rule is configured for individ...

Page 254: ...bin scheduling hierarchy Possible values include 1 to 99 4 1 3 Channel Rate Limiting This scheduler hierarchy level can be used to rate limit individual channels Channel rate limiting can be configure...

Page 255: ...hX up ii Bind connections to queues root host tc qdisc add dev ethX root handle 1 multiq root host tc filter add dev ethX parent 1 protocol ip prio 1 u32 match ip dst IP address of destination action...

Page 256: ...4_tom root host ifconfig ethX up ii Create a new policy file say new_policy_file and add the following line to associate connections with the given scheduling class E g src host 102 1 1 1 offload clas...

Page 257: ...ll function according to the parameters set for that traffic class iii Add socket option definitions In order to use setsockopt to set the options to the TCP socket the following two definitions need...

Page 258: ...1 multiq root host tc filter add dev eth0 parent 1 protocol ip prio 1 u32 match ip dst 192 168 5 3 action skbedit queue_mapping 3 iii Bind the NIC TX queue to class 0 root host cxgbtool eth0 sched qu...

Page 259: ...rl mode class rate unit bits rate mode absolute channel 0 class 0 max rate 300000 pkt size 1460 5 3 Offloaded Connections with Modified Application The following example demonstrates the method to rat...

Page 260: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 260 XX Unified Wire Manager UM...

Page 261: ...manage Option ROM PXE and iSCSI for T3 PXE FCoE and iSCSI for T5 and T4 capability for Chelsio cards using various tools available in the software Additionally Unified Wire Manager allows Chelsio adap...

Page 262: ...radation issues will not be observed when using the Web GUI since it s lightweight and utilizes very less system resources Figure 1 2 Chelsio Unified Wire Manager with web interface Web GUI 1 3 Unifie...

Page 263: ...ng a web browser The management interface uses a secure 256 bit encrypted HTTP connection ensuring that authentication and configuration data are protected during transmission from the web browser to...

Page 264: ...ers that are compatible with Chelsio Unified Wire Manager T520 BT T580 CR T520 LL CR T520 CR T580 LP CR T420 CR T440 CR T422 CR T420 SO CR T404 BT T420 BCH T440 LP CR T420 BT T420 LL CR T420 CX S302E...

Page 265: ...S 11 SP3 3 0 76 0 11 default Management Agent Management Client Web Management Interface 2 3 Platform Driver Matrix The table below lists the Chelsio drivers and their supported versions Chelsio drive...

Page 266: ...lsio Unified Wire has been designed to install Unified Wire Manager UM by default All the three UM components i e Management Agent Client and Station will be installed on selecting any of the Terminat...

Page 267: ...ld confirm that Management Agent is running by displaying a similar result root 30531 1 0 09 27 00 00 00 UWMgrServer root 30534 1 0 09 27 00 00 00 UWMgrServer run slp root 30537 1 0 09 27 00 00 00 UWM...

Page 268: ...following query command to determine the status of Management Station root host etc init d chelsio mgmtstd status The above command will display one of the following messages UM Management Station Run...

Page 269: ...e parameter available for the agent is the TCP listening port which can be specified with syntax similar to the example below PORT 35001 After changing the port please restart Management Agent for cha...

Page 270: ...such as iptables it should be configured to allow traffic to the management agent TCP port configured above in the configuration section or the default port that the management agent uses 35001 Revie...

Page 271: ...1 1 Viewing help Use the chelsio_uwcli command to view the help file as shown below root host chelsio_uwcli 6 2 Client conflict resolution The CLI and Web GUI cannot manage the same system at the same...

Page 272: ...d chelsio mgmtstd start restart 7 1 2 Running Management Station on SLES11SP3 i On SLES11SP3 Management Station needs to be configured before running Hence execute the following in command prompt and...

Page 273: ...sing Web Management Interface i To access the Web GUI type in the URL https management station IP address in a web browser ii The security certificate used by the web server is a generic one It may ca...

Page 274: ...UM Chelsio T5 T4 Unified Wire for Linux Page 274 Figure 7 2 b Security Certificate prompt in Mozilla Firefox Figure 7 2 c Security Certificate prompt in Apple Safari Figure 7 2 d Security Certificate...

Page 275: ...ization to be accessed Enter the administrator root credentials that were set up on the management station system and click on the Login button Figure 7 2 e Web GUI Login page Not performing any opera...

Page 276: ...ation Pane with a cascading tree of links to various configuration modules for a UM Agent You can navigate between connected agents and various sections of the managed agent s interface You can view a...

Page 277: ...e home page Bookmarks and History A history of the last 128 systems that were managed from this system by the current user will be shown here in a list Each system s management IP address TCP port and...

Page 278: ...nected the system will appear on the left pane with different related modules on the right to view and manage Removing a system Select the system from the Bookmark list and click Delete system to remo...

Page 279: ...agent s IP or hostname is known Select the appropriate discovery method and provide the relevant information For example to search using hostname select Hostname as the Input Type and provide the agen...

Page 280: ...ect T3 or T4 T5 depending on the chip revision of the network card 2 Select the operating system for which drivers are to be installed in the Choose the OS Type field All the systems with the selected...

Page 281: ...rrect user credentials for the agent in order to connect successfully After connecting to the Agent the menu bar on the left will display the connected system and its related modules If you deselect t...

Page 282: ...any changes made to system settings like load unload drivers 7 4 5 Subscribe Email Alerts This feature is available only on the Web Management Interface Using this option you can receive email alerts...

Page 283: ...veniently perform bulk operations like installing option ROM setting MTU and VLAN ID changing adapter and port parameters on various devices without having to access multiple modules and thus saving c...

Page 284: ...e Boot Configuration module create a group with group type t4adapter Here is a list of available configuration modules and corresponding group type Boot Configuration t3adapter t4adapter t5adapter Net...

Page 285: ...5 Figure 7 4 6 b Managing a group Boot Configuration Using this module you can install option ROM or erase option ROM on Chelsio network devices The Set Default Boot Settings button will reset the ada...

Page 286: ...tion module you can set Maximum Transfer Unit MTU Virtual LAN VLAN ID and change the IP address type for the members network interfaces of the Network group MTU can be set between 1500 9000 bytes VLAN...

Page 287: ...ion The Card Configuration module allows you to set various adapter settings including TCP Offload Offload settings are only available when using the TOE capable drivers t4_tom and toecore for T5 and...

Page 288: ...rt Configuration In the Port Configuration module you can set various port settings like enabling Tx checksum and TCP segmentation offload setting Link speed and link duplex mode etc The settings depe...

Page 289: ...89 Bypass Configuration Use the Bypass Configuration module to configure Chelsio s bypass adapters like B420 SR and B404 BT For more information on different bypass modes and configurational parameter...

Page 290: ...n the tree menu on the left On adding a system this item is automatically selected and this page is displayed The system page contains generic system and support modules which are discussed below 7 5...

Page 291: ...inux Page 291 7 5 2 Drivers Installation Using this module one can install various Chelsio drivers for different operating systems You can choose the configuration file type Linux Agents only Figure 7...

Page 292: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 292 Figure 7 5 2 b Drivers Installation module connected to FreeBSD Agent...

Page 293: ...installation date is shown in this module To load or unload a particular driver select the appropriate option Yes to load No to unload in the corresponding cell of the Loaded column To reload a driver...

Page 294: ...n Chelsio adapters to troubleshoot adapter related issues Select the adapter s from the list for which you want to run the test select the operation type of test you can run more than one test at a ti...

Page 295: ...related operations Once enabled two related modules VM Configurations and VF Configurations will be available and you can manage VMs and related settings While enabling you will have to provide the n...

Page 296: ...uired in order to asssign VFs to VMs iii Finally access WebGUI Remove the Agent using the Remove System button and connect to it again from the Bookmarks and History module You should now be able to s...

Page 297: ...tual machines To do so click on the machine names in the list The properties box will display the domain state of the machines selected Now click on any of the system power actions provided at the bot...

Page 298: ...Linux Page 298 7 5 8 VF Configurations Linux The VF Configurations module lists all the VMs Virtual Functions mapped to each Virtual Machine and all the available VFs You can also add and remove VFs...

Page 299: ...power options like start resume if VM is paused turn off restart or suspend pause a VM You can perform similar actions on multiple virtual machines To do so click on the machine names in the list The...

Page 300: ...lected VFs to the hosts To enable SR IOV support IOMMU must be enabled To do this select Enable for IOMMU and then click Set IOMMU Reboot the host machine for changes to take effect Figure 7 5 10 a Xe...

Page 301: ...x and FreeBSD and in the Event log in Windows This log can be obtained in this module Only 20 entries can be obtained and viewed at a time Logs can be viewed by either choosing from a list of fixed ra...

Page 302: ...Chelsio interfaces and VLANs Figure 7 6 1 a Network Summary module 7 6 2 Chelsio card page When a Chelsio card is selected in the tree menu on the left this page is displayed It provides details of th...

Page 303: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 303 Figure 7 6 2 a Card Summary module...

Page 304: ...g the TOE capable drivers t3_tom and toecore for T3 adapters t4_tom and toecore for T4 and T5 adapters On changing the settings the changed settings may not reflect immediately on refreshing the data...

Page 305: ...card are shown here For Chelsio T5 and T4 adapters only the MaxVMQueues field will be displayed On changing the settings the changed settings may not reflect immediately on refreshing the data Highlig...

Page 306: ...re maintained on a per card basis instead of a per port basis since the card has a TCP IP offload capability The statistics are for TCP and IP protocol processing done in the card s hardware These sta...

Page 307: ...listed in the tree menu on the left It provides details of the port and port settings It also displays any port specific statistics that the hardware provides The modules available on this page are a...

Page 308: ...T5 T4 Unified Wire for Linux Page 308 Port settings Port settings such as MTU Link speed and others can be set in this module The settings depend on the device driver installed Figure 7 6 2 1 b Port S...

Page 309: ...ds DNS and default gateway settings can be viewed and modified here Network adapters can also be enabled or disabled as required The modules available on this page are as below System Network configur...

Page 310: ...ses configured on the same adapter for the same network may result in unpredictable behavior of the system s networking stack Maximum Transfer Unit MTU can be set between 1500 9000 bytes VLAN id can a...

Page 311: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 311 Figure 7 6 3 b Managing IP aliases...

Page 312: ...ghput Mbs Receive Transmit Bi direction in Table and Graph format for a network adapter A report for hardware statistics can be generated based on different parameters only in the Table view in the Ad...

Page 313: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 313 Figure 7 6 3 d Network Throughput Vs Time instant Graph Figure 7 6 3 e Network Throughput Vs Time instant Table...

Page 314: ...mote networks and the Internet can also be set here On Linux and FreeBSD only one default gateway is allowed On Windows you may set multiple default gateways Use the option to set multiple default gat...

Page 315: ...is allowed when creating the team although both DHCP and Static IP addressing is supported for the team adapter after it is created successfully Please check with the driver documentation for the sup...

Page 316: ...o send and packet timeout The result of the ping can be viewed by clicking on the Ping Result button Using TraceRoute one can determine the route taken by packets across an IP network Use the GetConne...

Page 317: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 317 Figure 7 6 3 i TraceRoute Utility...

Page 318: ...d Clicking on a bridge name will display related properties on the right If a virtual interface is attached to a particular bridge a link appears next to the bridge name Expanding the link will displa...

Page 319: ...tual network interface is attached to a particular bridge a link appears for that bridge name Expanding the link will display the virtual network interface and expanding the link for that virtual netw...

Page 320: ...Create Bridge section All other parameters are optional If not specified the bridge will be created with default values Except STP and Priority you can change all of the other parameters in the Bridg...

Page 321: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 321 Figure 7 6 3 1 c Creating Bridge Figure 7 6 3 1 d Adding Bridge to VM Figure 7 6 3 1 e Adding interfafe to Bridge...

Page 322: ...e MTU and Name Description fields are optional The bridge name will be generated automatically by the operating system Once created it will appear in the Xen Bridge Configuration module You will have...

Page 323: ...you will have to detach the virtual machine first To do so click on the virtual machine and click Detach Similarly detach all the virtual machines and then use the Delete Switch to delete the virtual...

Page 324: ...rnal Network guest operating systems can only communicate with guest operating systems in the same private network and not with the host The host operating system cannot access the virtual machines on...

Page 325: ...P iWARP Settings On Linux Agents iWARP parameter settings for Chelsio s RDMA capable NICs can be set using this module These settings can be set only when iWARP driver iw_cxgb4 for T4 and T5 iw_cxgb3...

Page 326: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 326 Figure 7 6 4 a iWARP settings for T4 CNA for FreeBSD Agent...

Page 327: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 327 Figure 7 6 4 b iWARP settings for T4 CNA for Linux Agent...

Page 328: ...rocess Statistics Attributes The WD UDP module lists the process ids pid of UDP traffic running on the agent and displays the corresponding statistics and attributes Figure 7 6 5 a WD UDP Process Stat...

Page 329: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 329 Figure 7 6 5 b WD UDP Process Attributes...

Page 330: ...The WD TOE module lists the process ids pid of TOE traffic running on the agent and displays the corresponding statistics and attributes Figure 7 6 5 c WD TOE Process Statistics Figure 7 6 5 d WD TOE...

Page 331: ...itiators available on the operating system can be managed from this page FCoE support is extended on Linux Windows and XenServer platforms Please refer to Platform Driver matrix section on the list of...

Page 332: ...ry Details pertaining to the card used such as model firmware hardware version etc are provided in this module Figure 7 7 1 1 a FCoE Card Summary module FCoE Attributes Information such as Interrupt m...

Page 333: ...orms FIP and FCoE device discovery This page lets the user to retrieve all the FCoE specific port information and also extend NPIV management support It contains the following sections FCoE Port Summa...

Page 334: ...s fabric information such as fabric name VLAN on which the FCoE service is currently running and the number of SCSI targets that are being discovered by this port Port speed being mentioned in this se...

Page 335: ...create a virtual port select the option Create and the GUI allows two ways of creating a virtual port i Manual Where the user can manually create a virtual port by providing a value to the WWPN and WW...

Page 336: ...ctive N_port virtual ports The GUI conveys the same via a tree structure so that the end user knows the initiator target mapping FCoE Remote Port Attributes This module provides details about the disc...

Page 337: ...his module provides the LUN information such as size of the LUN SCSI address and LUN address For Linux the SCSI address is displayed in H C T L Host Channel Target Lun format and for Windows it is dis...

Page 338: ...ecially where virtual SANs are called for The virtual ports appear under their respective N_Ports after creation and the GUI conveys it via a tree structure so that the end user knows the N_port VN_Po...

Page 339: ...contains fabric information such as fabric name VLAN on which the FCoE service is currently running and the number of SCSI targets that are being discovered by this virtual port Port speed being menti...

Page 340: ...ntify the discovered target accordingly Figure 7 7 1 4 c FCoE Remort Port Attributes module FCoE Remote Port Lun Details This module provides LUN information for remote port associate with virtual por...

Page 341: ...pters configured in the initiator stack The node can be enabled or disabled Chelsio node cannot be disabled in Windows and its properties can be viewed and edited in this module In the Chelsio Linux s...

Page 342: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 342 Figure 7 7 2 b Microsoft iSCSI initiator...

Page 343: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 343 Figure 7 7 2 c Chelsio iSCSI initiator...

Page 344: ...port The discovery operation also fetches all the other Portals that the target s are listening on The discovered target can be deleted if required Please note that all the Portals that the target se...

Page 345: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 345 Figure 7 7 2 e Discover targets module...

Page 346: ...ion can be added or deleted For the Microsoft iSCSI initiator or the Open iSCSI initiator you may specify the authentication details and digest settings while logging in For Chelsio Linux initiator th...

Page 347: ...er related details are provided in this module Select the Chelsio adapter for which you want to view properties from the Select a T4 Card drop down list and the module will expand to display related p...

Page 348: ...select the port for which you want set any of the aforementioned properties MTU can be set between 1500 9000 bytes VLAN id can be set within the range 0 4094 enter 0 to disable it The IP type can be I...

Page 349: ...49 FO iSCSI Initiator Properties In the FO iSCSI Initiator Properties module you can configure FO iSCSI Initiator by setting different properties like enabling disabling CHAP authentication setting He...

Page 350: ...iSCSI Initiator service maintains multiple instances of a target depending on the discovery method In this module you can set upto 8 instances Configurable parameters include initiator node name IQN...

Page 351: ...Chelsio adapter and initiator instance using which you want to discover targets Next provide the source initiator and destination target IP Finally click Discover After successful discovery all the d...

Page 352: ...dapter initiator instance Target Name Source Initiator IP Destination Target IP and Destination Port are mandatory After providing values for these fields click Login By default no authentication mech...

Page 353: ...login details of the established iSCSI session will be displayed under the Established sessions section Select the Adapter and session id Details of the selected session will be displayed To end the...

Page 354: ...s also available The modules available on this page are as below Target Stack Globals This module displays various global properties of a currently connected iSCSI target Authentication priority betwe...

Page 355: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 355 Figure 7 7 4 b Target properties module...

Page 356: ...sio T5 T4 Unified Wire for Linux Page 356 Session details Details including Session ID Initiator IQN and Connections List of all discovered and currently connected iSCSI targets are listed here Figure...

Page 357: ...Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 357 New Target Creation New iSCSI target can be created here by specifying the Target IQN and Target Alias name Figure 7 7 4 d New Target Crea...

Page 358: ...us Logical Units created in an iSCSI Target can be managed here The modules available on this page are as below View Edit iSCSI Target LUNs This module displays various Logical Units created in an iSC...

Page 359: ...UNs can be added here by providing various parameters like Target Name Target Device and RAM Disk Size etc RW Read Write and RO Read Only are the two kinds of permissions that can be set If Ram Disk i...

Page 360: ...viewed and added here The modules available on this page are as below View Edit iSCSI Target Portals Portal List on the left displays details of the portal group on which an iSCSI target is listening...

Page 361: ...anager UM Chelsio T5 T4 Unified Wire for Linux Page 361 Add Portal New Portals can be added here by choosing the specific target and Portal IP address The Port number should be 3260 Figure 7 7 6 b Add...

Page 362: ...figured for currently connected iSCSI Targets can be managed here The modules available on this page are as below View Edit iSCSI Target ACLs This module displays details for all the ACLs configured f...

Page 363: ...ied Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 363 Add ACL New ACLs can be configured by specifying Target name initiator IQN name IP address and permission type Figure 7 7 7 b Adding n...

Page 364: ...nly when offload driver t3_tom is not loaded This module lists various parameters which can be set while determining filtering options for a system IP You can set the maximum number of filters and als...

Page 365: ...nation You can create filter rules for any combination in the list However filter rule created only for the Active Combination will apply To create a new rule select the adapter type T5 or T4 in the S...

Page 366: ...presence of offload driver t3_tom for T3 adapters t4_tom for T5 and T4 adapters Traffic Management configuration The Chelsio Card section on the left displays all the cards available in the server and...

Page 367: ...odule displays the current T5 T4 configuration tuning option selected You can also change the tuning option by selecting the config file for each option located in ChelsioUwire x xx x x src network fi...

Page 368: ...e module T5 T4 Boot Option ROM management This module allows managing the PXE and FCoE boot capability for Chelsio T5 and T4 adapters The Option ROM PXE and FCoE may be installed to or erased from the...

Page 369: ...on target will list assigned LUNs on the right Select a LUN from the list to view details Show WWPN parameter will display the WWPNs of all the ports There are four configurable parameters available...

Page 370: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 370 Figure 7 8 3 c PXE Boot configuration for T4 CNAs...

Page 371: ...nified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 371 Figure 7 8 3 d FCoE Boot configuration for T4 CNAs Function parameter Figure 7 8 3 e FCoE Boot configuration for T4 CNAs Boot param...

Page 372: ...ied Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 372 Figure 7 8 3 f FCoE Boot configuration for T4 CNAs Show WWPN parameter Figure 7 8 3 g iSCSI Boot configuration for T4 CNAs Function pa...

Page 373: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 373 Figure 7 8 3 h iSCSI Boot configuration for T4 CNAs Initiator parameter...

Page 374: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 374 Figure 7 8 3 i iSCSI Boot configuration for T4 CNAs Network parameter...

Page 375: ...ver etc There are two modules available Bypass Configuration and Redirect Configuration Bypass Configuration In the Bypass Configuration module you can view the status and start stop the BA server acc...

Page 376: ...p rules into tables You can save the currently configured tables and rules for a bypass adapter into a shell script using the Download Configuration button The Table Configuration tab displays BA serv...

Page 377: ...ton to add a new rule by specifying the rule id in the INDEX field and providing the required parameters Finally click Save Changes To edit an existing rule select the corresponding checkbox change th...

Page 378: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 378 Figure 7 8 4 c Redirect Configuration module Rules configuration tab...

Page 379: ...s to Tx Scheduler classes 7 8 5 a Egress Queue Map module Egress Packet Scheduler Using this module you can configure different scheduler hierarchy levels i e Class Rate Limiting Class Weighted Round...

Page 380: ...gmt agent Now execute the following command with the result from the above query to uninstall Management Agent E g for RHEL 6 3 root host rpm e chelsio uwire_mgmt agent rhel6u3 2 2 xyz x86_64 8 2 Unin...

Page 381: ...he following query command to determine the name of the Management Station RPM root host rpm qa grep chelsio uwire_mgmt station 2 Now execute the following command with the result from the above query...

Page 382: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 382 XXI Unified Boot...

Page 383: ...SI SAN boot This section of the guide also describes the use and configuration of Chelsio s DUD for OS installations via PXE server on FC FCoE LUN and iSCSI LUN This solution can be used for installin...

Page 384: ...a DCS 7124S F Mellanox SX_PPC_M460EX Other platforms switches have not been tested and are not guaranteed to work 1 1 3 Supported Adapters Following are the currently shipping Chelsio Adapters that ar...

Page 385: ...he list of Drivers Software and supported Linux distributions Linux Distribution Driver Software DUDs RHEL 7 2 3 10 0 327 el7 PXE RHEL 7 1 3 10 0 229 el7 PXE RHEL 6 7 2 6 32 573 el6 PXE RHEL 6 6 2 6 3...

Page 386: ...e necessary files Follow the steps below to prepare the drive i Create a DOS bootable USB flash drive Click here for instructions ii Create a directory CHELSIO on the USB flash drive iii If you haven...

Page 387: ...stem having Chelsio CNA to boot in Legacy mode ii Once the system boots from the USB flash drive change your working directory to CHELSIO directory C cd CHELSIO iii Run the following command to list a...

Page 388: ...case v Delete any previous firmware using the following command C CHELSIO cfut4 d idx xh xf vi Delete any previous Option ROM settings C CHELSIO cfut4 d idx xc vii Run the following command to flash t...

Page 389: ...Flash the unified option ROM onto the Chelsio CNA using the following command C CHELSIO cfut4 d idx ub cubt4 bin Here cubt4 bin is the unified option ROM image file present in the CHELSIO directory ix...

Page 390: ...T4 Unified Wire for Linux Page 390 x Reboot the system for changes to take effect 2 3 uEFI i In BIOS configure the system having Chelsio CNA to boot in uEFI mode For Supermicro systems enable Network...

Page 391: ...i Boot to EFI Shell iii Issue command drivers to determine if Chelsio uEFI driver is loaded If the driver is loaded as shown in the image below continue to step iv If the driver is not loaded load the...

Page 392: ...setup v Chelsio HII should be listed as Chelsio T4 T5 Highlight it and press Enter vi Highlight the Chelsio adapter to be configured and press Enter If Chelsio T4 T5 is not listed please ensure that C...

Page 393: ...393 vii Highlight Flash Utility and press Enter viii Erase or update firmware using the methods explained below Erase existing firmware a Select Erase as Flash Operation b Select FW File as Flash Fil...

Page 394: ...FW File as Flash File Type c Enter full path to the firmware file for Enter File Name For e g CHELSIO t5fw 1 13 32 0 bin d Press Enter e Select Update Erase f Press Y to confirm g Reboot system Simil...

Page 395: ...ng pxeboot html http www howtoforge com ubuntu_pxe_install_server PXE server configuration steps for Windows can be found on following links http technet microsoft com en us library cc771670 28WS 10 2...

Page 396: ...oot i After configuring the PXE server make sure the PXE server works Then reboot the client machine ii Press Alt C when the message Chelsio Unified Boot BIOS vX X X XX Copyright C 2003 2015 Chelsio C...

Page 397: ...for Linux Page 397 v Enable the Adapter BIOS using arrow keys if not already enabled Hit ENTER vi Choose PXE from the list to configure Hit Enter Use the default values for Boot Mode EDD and EBDA Rel...

Page 398: ...oot Chelsio T5 T4 Unified Wire for Linux Page 398 vii Use the arrow keys to highlight the appropriate function among the supported NIC functions and hit Enter to select viii Enable NIC function bios i...

Page 399: ...NIC Func 00 will enable port 0 for PXE enabling NIC Func 01 will enable port 1 and so on for NIC function Please refer the table below NIC Function enabled Ports enabled NIC Func00 00 NIC Func01 01 N...

Page 400: ...4 Unified Wire for Linux Page 400 xiii In the system setup choose any of the Chelsio PXE devices as the first boot device xiv Reboot DO NOT PRESS ALT S to skip Chelsio option ROM during POST xv Hit F1...

Page 401: ...m and go into the BIOS setup ii Chelsio HII should be listed as Chelsio T4 T5 Highlight it and press Enter If Chelsio T4 T5 is not listed please ensure that Chelsio uEFI driver is loaded correctly as...

Page 402: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 402 iii Select the Chelsio adapter to be configured and press Enter iv Select Configuration Utility and press Enter...

Page 403: ...Unified Wire for Linux Page 403 v Enable adapter BIOS if not already enabled vi Select Chelsio Protocol Selection and press Enter It is highly recommended that you use the Save Changes option every t...

Page 404: ...commended to enable only those functions and ports which are going to be used Please note that enabling PXE Function 0 will enable port 0 for PXE enabling PXE Function 1 will enable port 1 and so on f...

Page 405: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 405 ix Select Save Changes and press Enter...

Page 406: ...Unified Wire for Linux Page 406 x Reboot the system and choose any of the available Chelsio PXE devices for PXE boot xi Reboot and hit F12 key when prompted to start PXE boot xii Chelsio option ROM wi...

Page 407: ...irmware and option ROM 5 1 Legacy FCoE boot i Reboot the system ii Press Alt C when the message Chelsio Unified Boot BIOS vX X X XX Copyright C 2003 2015 Chelsio Communications Press Alt C to Configur...

Page 408: ...d Wire for Linux Page 408 v Enable the Adapter BIOS if not already enabled Hit ENTER vi Choose FCoE from the list to configure and hit Enter Use the default values for Boot Mode EDD and EBDA Relocatio...

Page 409: ...I Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 409 vii Choose the first option Configure function parameters from the list of parameter type and hit Enter viii Enable FCoE BIOS if not alread...

Page 410: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 410 ix Choose the order of the ports to discover FCoE targets x Set discovery timeout to a suitable value Recommended value is 30...

Page 411: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 411 xi Hit F10 or Esc and then Y to save the configuration xii Choose Configure boot parameters...

Page 412: ...e 412 xiii Select the first boot device and hit Enter to discover FC FCoE targets connected to the switch Wait till all reachable targets are discovered xiv List of discovered targets will be displaye...

Page 413: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 413 xv From the list of LUNs displayed for the selected target choose one on which operating system has to be installed Hit Enter...

Page 414: ...Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 414 xvi Hit F10 or Esc and then Y to save the configuration xvii Reboot the machine xviii During POST allow the Chelsio option ROM to discover F...

Page 415: ...ot Chelsio T5 T4 Unified Wire for Linux Page 415 xix Enter BIOS setup and choose FCoE disk discovered via Chelsio adapter as the first boot device xx Reboot and boot from the FCoE disk or install the...

Page 416: ...etup ii Select Chelsio T4 T5 and press Enter Only uEFI v2 1 and v2 3 1 supported Any other uEFI version is NOT SUPPORTED and may render your system unusable Important If Chelsio T4 T5 is not listed pl...

Page 417: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 417 iii Select the Chelsio adapter to be configured and press Enter iv Select Configuration Utility and press Enter...

Page 418: ...Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 418 v Enable adapter BIOS if not already enabled It is highly recommended that you use the Save Changes option every time a parameter option is c...

Page 419: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 419 vi Select Chelsio Protocol Selection and press Enter vii Select FCoE and press Enter...

Page 420: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 420 viii Under Function Parameters enable FCoE BIOS if not already enabled...

Page 421: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 421 ix Set discovery timeout to a suitable value Recommended value is 30...

Page 422: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 422 x Choose the order of the ports to discover FCoE targets...

Page 423: ...423 xi Under the first boot device select Discover Target and press Enter to discover FC FCoE targets connected to the switch Wait till all reachable targets are discovered xii List of discovered targ...

Page 424: ...o T5 T4 Unified Wire for Linux Page 424 xiii List of LUNs for the selected target will be displayed Highlight a LUN to select it and hit Enter xiv Select Save Changes and press Enter xv Reboot the sys...

Page 425: ...ed Wire for Linux Page 425 xvi The discovered LUN should appear in the Boot Configuration section and system BIOS section xvii Select the LUN as the first boot device and exit from BIOS xviii Either b...

Page 426: ...irmware and option ROM 6 1 Legacy iSCSI boot i Reboot the system ii Press Alt C when the message Chelsio Unified Boot BIOS vX X X XX Copyright C 2003 2015 Chelsio Communications Press Alt C to Configu...

Page 427: ...Wire for Linux Page 427 v Enable the Adapter BIOS if not already enabled Hit Enter vi Choose iSCSI from the list to configure and hit Enter Use the default values for Boot Mode EDD and EBDA Relocatio...

Page 428: ...tion Configure Function Parameters from the list of parameter type and hit Enter viii Enable iSCSI BIOS if not already enabled iBFT iSCSI Boot Firmware Table will be selected by default You can also c...

Page 429: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 429 ix Choose the order of the ports to discover iSCSI targets x Set discovery timeout to a suitable value Recommended value is 30...

Page 430: ...XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 430 xi Hit Esc and then Y to save the configuration xii Go back and choose Configure Initiator Parameters to configure initiator related pro...

Page 431: ...nitiator properties like IQN Header Digest Data Digest etc will be displayed Change the values appropriately or continue with the default values Hit F10 to save xiv CHAP authentication is disabled by...

Page 432: ...ENABLED in the CHAP Policy field Next choose either one way or mutual as the authentication method Finally provide Initiator and Target CHAP credentials according to the authentication method selected...

Page 433: ...T4 Unified Wire for Linux Page 433 xvii Select the port using which you want to connect to the target Hit Enter xviii Select Yes in the Enable DHCP field to configure port using DHCP or No to manually...

Page 434: ...nfigure Target Parameters to configure iSCSI target related properties xx If you want to discover target using DHCP select Yes in the Discover Boot Target via DHCP field To discover target via static...

Page 435: ...XI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 435 xxi Go back and choose Discover iSCSI Target s to connect to a target xxii Select the portal group on which iSCSI service is provided by t...

Page 436: ...for Linux Page 436 xxiii A list of available targets will be displayed Select the target you wish to connect to and hit Enter xxiv A list of LUNs configured on the selected target will be displayed S...

Page 437: ...XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 437 xxv Hit Esc and then Y to save the configuration xxvi Reboot the machine xxvii During POST allow the Chelsio option ROM to discover iSCSI...

Page 438: ...o T5 T4 Unified Wire for Linux Page 438 xxviii Enter BIOS setup and choose iSCSI target LUN discovered via Chelsio adapter as the first boot device xxix Reboot and boot from the iSCSI Target LUN or in...

Page 439: ...i Reboot the system and go into BIOS setup ii Select Chelsio T4 T5 and press Enter If Chelsio T4 T5 is not listed please ensure that Chelsio uEFI driver is loaded correctly as mentioned here in the Fl...

Page 440: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 440 iii Select the Chelsio adapter to be configured and press Enter iv Select Configuration Utility and press Enter...

Page 441: ...Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 441 v Enable adapter BIOS if not already enabled It is highly recommended that you use the Save Changes option every time a parameter option is c...

Page 442: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 442 vi Select Chelsio Protocol Selection and press Enter vii Select iSCSI and press Enter...

Page 443: ...r XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 443 viii Under Function Parameters enable iSCSI BIOS if not already enabled ix Set discovery timeout to a suitable value Recommended value...

Page 444: ...Linux Page 444 x Choose the order of the ports to discover iSCSI targets xi Under Initiator Parameters iSCSI Initiaitor properties like IQN Header Digest Data Digest etc will be displayed Change the v...

Page 445: ...i Under the first port select Enable DHCP field hit Enter and select Enabled This will configure port using DHCP Select Disabled to manually configure the port xiii Under Target Parameters select Enab...

Page 446: ...age 446 To discover target via static IP select Disabled and provide the target IP xiv CHAP authentication is disabled by default To enable and configure highlight CHAP Policy and hit Enter Select the...

Page 447: ...re for Linux Page 447 xv Provide Initiator and Target CHAP credentials according to the CHAP policy selected xvi Select Discover Target and press Enter to discover iSCSI targets connected to the switc...

Page 448: ...for Linux Page 448 xvii A list of available targets will be displayed Select the target you wish to connect to and hit Enter xviii A list of LUNs configured on the selected target will be displayed S...

Page 449: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 449 xix Select Save Changes and press Enter xix Reboot the system for changes to take effect...

Page 450: ...Unified Wire for Linux Page 450 xx The discovered LUN should appear in the Boot Configuration section and system BIOS xxi Select the LUN as the first boot device and exit from BIOS xxii Either boot f...

Page 451: ...ChelsioUwire x xx x x tar gz iii Change your current working directory to LinuxDUD directory root host cd ChelsioUwire x xx x x Uboot LinuxDUD iv Insert a blank formatted USB flash drive v Depending...

Page 452: ...USB drive root host mkfs vfat dev sda1 v Depending on the distribution to be installed copy the corresponding image file to the USB stick For example execute the following command for SLES11sp3 root h...

Page 453: ...se Network Boot PXE Boot media to install the OS and provide the Driver Update Disk as per the detailed instructions for each OS The DUD supports installation of Linux distributions using Chelsio adap...

Page 454: ...The dd option specifies that you will be providing a Driver Update Disk during the installation ii You will be asked to select the Driver Update Disk device from a list USB drives usually show up as...

Page 455: ...x or enter C to start the loading process Hit Enter The selected driver s will now be loaded vi The Driver disk prompt will be displayed again Follow the same procedure mentioned above to select any o...

Page 456: ...hat the USB drive with DUD image is inserted Press Tab and then type dd at the boot prompt for the installation media The dd option specifies that you will be providing a Driver Update Disk during the...

Page 457: ...e would assume the first drive letter a Hence the drive name would be sda You can view the messages from the Linux kernel and drivers to determine the name of the USB drive by pressing Alt F3 or Alt F...

Page 458: ...helsio T5 T4 Unified Wire for Linux Page 458 v The installer will ask if you wish to load more drivers Choose Yes to load if you have any other drivers to load Otherwise choose No vi Select the requir...

Page 459: ...Chelsio T5 T4 Unified Wire for Linux Page 459 vii Select the type of keyboard you have from the list viii In this step you can choose the source which contains the OS installation ISO image In this c...

Page 460: ...o detwork devices will be displayed Select the appropriate Chelsio NIC interface to proceed with installation x Here you can specify if you want to configure your network interfaces using DHCP or manu...

Page 461: ...on Then the graphical Installation screens for RHEL will appear Proceed with the installation as usual 8 1 3 SLES11 SPx SLES12 installation i In case of SLES11 SPx PXE FCoE and iSCSI and SLES12 FCoE p...

Page 462: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 462 iii Select Start Installation and then Start Installation or Update...

Page 463: ...Operating System v Select the desired Network protocol from the list presented vi Select the appropriate Chelsio interface from the list to proceed with installation You can view the messages from th...

Page 464: ...f you are installing using CD DVD please make sure that the USB drive with DUD image is inserted Also change the boot priority to boot from CD DVD in the BIOS setup i Insert the OS installation disc i...

Page 465: ...ng Chelsio DUD PXE boot Click here for RHEL 7 x Click here for RHEL6 x Click here for SLES11 SPx SLES12 section to load Chelsio Driver Update Disk After successfully loading Chelsio DUD follow the pro...

Page 466: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 466 ii Click INSTALLATION DESTINATION under SYSTEM...

Page 467: ...Page 467 iii The discovered FC FCoE LUNs will appear as local storage in the Local Standard Disks section Select the LUN which was saved as boot device in system BIOS Make sure the same LUN discovered...

Page 468: ...Under Other Storage Options you can either chose to configure partition automatically or manually Select the appropriate option and click Done Then proceed with the installation as usual 8 2 2 RHEL 6...

Page 469: ...pecialized Storage Devices radio button and click Next iii Select the FC FCoE LUN which was saved as boot device in system BIOS and click Next Then proceed with the installation as usual Make sure the...

Page 470: ...I Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 470 8 2 3 SLES11 SPx Installation i Choose installation language and Keyboard layout type Select the checkbox I Agree to the License terms and...

Page 471: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 471 ii Select New Installation to perform a fresh installation and click Next...

Page 472: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 472 iii Choose from the available base scenarios and click Next...

Page 473: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 473 iv Configure Clock and Time Zone settings Click Next...

Page 474: ...inux Page 474 v The discovered FC FCoE LUNs will appear in the Preparing Hard Disk screen Select the LUN which was saved as boot device in system BIOS Click Next Make sure the same LUN discovered at t...

Page 475: ...summary of user selected and YaST suggested options for the installation You can review and modify them if required Basic settings can be changed in the Overview tab and advanced settings can be chang...

Page 476: ...lsio T5 T4 Unified Wire for Linux Page 476 vii The Expert Partitioner screen displays the partition setup suggested by the installer Click on the device selected in step v and click Accept viii Procee...

Page 477: ...stallation i Choose installation language and keyboard layout type Select the checkbox I Agree to the License terms and click Next ii During system probe the YaST installer will detect Chelsio FCoE dr...

Page 478: ...perating system and technical support you will need to register your system Enter the registration or evaluation code for your copy of SLES12 and email id associated with your Suse Customer Care SCC a...

Page 479: ...e 479 iv The next screen will display a list of add ons and extensions available for SLES12 To install select the checkbox I would like to install an additional Add On Product then select the radio bu...

Page 480: ...ggested Partitioning screen YaST generated partition setup will be displayed To change the suggested settings click Edit Proposal Settings To select the disk on which to apply the proposed settings cl...

Page 481: ...4 Unified Wire for Linux Page 481 vi Click Create Partition Setup and select the LUN which was saved as boot device in system BIOS Click Next Make sure the same LUN discovered at the Option ROM stage...

Page 482: ...Linux Page 482 vii To use the entire LUN for installation click User Entire Hard Disk Please note that this will delete all the existing partitions To install operating system on an existing partition...

Page 483: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 483 viii The selected LUN should now appear in the Suggested Partitioning screen Click Next ix Proceed with installation as usual...

Page 484: ...m option if not already selected iii Type e and then dd at the boot prompt for RHEL 7 For RHEL 6 and SLES distributions press Tab and then dd iv Load Chelsio Driver Update Disk depending on the Linux...

Page 485: ...e for Linux Page 485 After successfully loading Chelsio DUD follow the procedure mentioned below to continue installation based on the distribution 8 3 1 RHEL 7 x i On the installer welcome screen cho...

Page 486: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 486 ii Click Installation Destination under SYSTEM...

Page 487: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 487 iii Click Add a disk...

Page 488: ...Chelsio T5 T4 Unified Wire for Linux Page 488 iv The discovered iSCSI LUNs will appear in the Search tab Select it and click Done Make sure the same LUN discovered at the Option ROM stage is selected...

Page 489: ...489 v Under Other Storage Options you can either chose to configure partition automatically or manually Select the appropriate option and click Done Then proceed with the installation as usual 8 3 2...

Page 490: ...ces radio button and click Next iii The discovered LUNs will appear in the Basic Devices tab Select the LUN which was saved as boot device in system BIOS and click Next iv Proceed with the installatio...

Page 491: ...I Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 491 8 3 3 SLES11 SPx installation i Choose installation language and Keyboard layout type Select the checkbox I Agree to the License terms and...

Page 492: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 492 ii Click Configure iSCSI Disks in the Disk Activation screen...

Page 493: ...er XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 493 iii The discovered LUNs will appear in the Connected Targets tab Select the LUN which was saved as boot device in system BIOS and clic...

Page 494: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 494 iv Select New Installation to perform a fresh installation and click Next...

Page 495: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 495 v Configure Clock and Time Zone settings Click Next...

Page 496: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 496 vi Choose from the available server base scenarios and click Next...

Page 497: ...ected and YaST suggested options for the installation You can review and modify them if required Basic settings can be changed in the Overview tab and advanced settings can be changed in the Expert ta...

Page 498: ...XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 498 8 3 4 SLES12 Installation i Choose installation language and Keyboard layout type Select the checkbox I Agree to the License terms and cl...

Page 499: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 499 ii Click Configure iSCSI Disks in the Disk Activation screen...

Page 500: ...i The discovered LUNs will appear in the Connected Targets tab Select the LUN which was saved as boot device in system BIOS and click OK iv Proceed with the installation as usual Make sure the same LU...

Page 501: ...Chapter XXII Lustre File System Chelsio T5 T4 Unified Wire for Linux Page 501 XXII Lustre File System...

Page 502: ...uting clusters Lustre Clusters Lustre clusters contain three kinds of systems File system clients which can be used to access the file system Object storage servers OSS which provide file I O service...

Page 503: ...LL CR 1 2 Software Requirements 1 2 1 Lustre Requirements Chelsio Unified Wire currently supports Lustre 2 6 0 1 2 2 Linux Requirements Currently Lustre File System is supported on following distribut...

Page 504: ...iv Load the Network and iWARP driver as per requirement To load Network driver in NIC mode root host modprobe cxgb4 To load Network driver in TOE mode root host modprobe cxgb4 root host modprobe t4_to...

Page 505: ...fsname fsname mgs mdt block_device ix Mount the file system created in the previous step Run the following command on the MDS node root host mount t lustre block_device mount_point x Create the OST on...

Page 506: ...Chapter XXIII Appendix Chelsio T5 T4 Unified Wire for Linux Page 506 XXIII Appendix A...

Page 507: ...as ping If you get a return value of 0 when doing a cat proc sys net ipv4 icmp_echo_ignore_all on the remote host that means it is configured to reply to incoming pings Change ipv4 to ipv6 in the path...

Page 508: ...k mode Binding VFC to MAC If you are binding the VFC to MAC address in case of Cisco Nexus switch then make sure you make the Ethernet interface part of both Ethernet VLAN and FCoE VLAN Cisco nexus sw...

Page 509: ...f or ii make available the Software or any portion thereof in any form on the Internet The Software contains trade secrets and in order to protect them you may not decompile reverse engineer disassemb...

Page 510: ...R LOSS OF ANTICIPATED PROFITS EVEN IF CHELSIO HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES IN NO EVENT SHALL CHELSIO S LIABILITY ARISING OUT OF OR RELATED TO THE LICENSE OR USE OF THE SOFTWARE...

Page 511: ...rnia law except as to copyright matters which are covered by Federal law You hereby irrevocably submit to the personal jurisdiction of and irrevocably waive objection to the laying of venue including...

Search results

Summary of Contents for Chelsio T4

Reviews:

Brands by name

Popular brands

Chelsio Communications Chelsio T4, Installation And User Manual

Search results

Summary of Contents for Chelsio T4

Reviews:

Brands by name

Popular brands