Chelsio Communications Chelsio T4 Скачать руководство пользователя страница 74 | Manualshive

Страница: 74 / 511

Chelsio Communications Chelsio T4 Скачать руководство пользователя страница 74

Chapter IV. iWARP (RDMA)

Chelsio T5/T4 Unified Wire for Linux

Page 74

vi. Set IntelMPI with mpi-selector (do this on all nodes).

[root@host~]# mpi-selector --register intelmpi --source-dir
/opt/intel/impi/3.1/bin/
[root@host~]# mpi-selector --set intelmpi

vii. Edit

.bashrc

and add these lines:

export RSH=ssh
export DAPL_MAX_INLINE=64
export I_MPI_DEVICE=rdssm:chelsio
export MPIEXEC_TIMEOUT=180
export MPI_BIT_MODE=64

viii. Logout & log back in.
ix. Populate

mpd.hosts

with node names.

x. Contact Intel for obtaining their MPI with DAPL support.
xi. To run Intel MPI over RDMA interface, DAPL 2.0 should be set up as follows:

Enable the Chelsio device by adding an entry at the beginning of the /

etc/dat.conf

file for

the Chelsio interface. For instance, if your Chelsio interface name is eth2, then the following
line adds a DAT version 2.0 device named

“chelsio2" for that interface:

chelsio2 u2.0 nonthreadsafe default libdaplofa.so.2 dapl.2.0 "eth2 0" ""

Open MPI (Installation and Setup)

Open MPI iWARP support is only available in Open MPI version 1.3 or greater.

Open MPI will work without any specific configuration via the openib btl. Users wishing to
performance tune the configurable options may wish to inspect the receive queue values. Those
can be found in the "Chelsio T4" section of

mca-btl-openib-device-params.ini

. Follow the

steps mentioned below to install and configure Open MPI.

i. If not alreay done, install

mpi-selector

tool.



The hosts in this file should be Chelsio interface IP addresses.



I_MPI_DEVICE=rdssm:chelsio

assumes

you

have

an

entry

in

/etc/dat.conf

named

chelsio

.



MPIEXEC_TIMEOUT

value might be required to increase if heavy traffic is

going across the systems.

Note

«
...
72
73
74
75
76
...
»

Содержание Chelsio T4

Страница 1: ......

Страница 2: ...TWARE IS SUBJECT TO THE SOFTWARE LICENSE TERMS OF CHELSIO COMMUNICATIONS INC Sales For all sales inquiries please send email to sales chelsio com Support For all support related questions please send...

Страница 3: ...4 04 12 2013 1 0 5 06 20 2013 1 0 6 08 17 2013 1 0 7 10 22 2013 1 0 8 03 08 2013 1 0 9 05 15 2013 1 1 0 07 26 2013 1 1 1 08 14 2013 1 1 2 12 06 2013 1 1 3 12 19 2013 1 1 4 03 13 2014 1 1 5 05 02 2014...

Страница 4: ...M 41 5 Configuring Chelsio Network Interfaces 43 5 1 Configuring 40G adapters 43 5 2 Configuring network scripts 45 5 3 Creating network scripts 45 5 4 Checking Link 46 6 Performance Tuning 47 7 Softw...

Страница 5: ...ation and Fine tuning 72 4 1 Testing connectivity with ping and rping 72 4 2 Enabling various MPIs 73 4 3 Setting up NFS RDMA 80 4 4 Performance Tuning 82 V RDMA BLOCK DEVICE DRIVER RBD 83 1 Introduct...

Страница 6: ...ce tools iscsictl chisns 128 4 10 Rules of Target Reload i e on the fly changes 133 4 11 System Wide Parameters 135 4 12 Performance Tuning 136 VIII ISCSI PDU OFFLOAD INITIATOR 137 1 Introduction 138...

Страница 7: ...e Requirements 175 1 2 Software Requirements 175 2 Software Driver Loading 177 3 Software Driver Unloading 178 4 Software Driver Configuration and Fine tuning 179 4 1 Configuring Cisco Nexus 5010 and...

Страница 8: ...nfiguring UDP Pacing 205 XV OFFLOAD IPV6 DRIVER 207 1 Introduction 208 1 1 Hardware Requirements 208 1 2 Software Requirements 208 2 Software Driver Loading 210 3 Software Driver Unloading 211 3 1 Unl...

Страница 9: ...Rules 243 3 2 Listing Filter Rules 244 3 3 Removing Filter Rules 245 3 4 Swap MAC feature 245 3 5 Hit Counters 246 XIX TRAFFIC MANAGEMENT 248 1 Introduction 249 1 1 Hardware Requirements 249 1 2 Softw...

Страница 10: ...0 6 CLI client 271 6 1 CLI Help system 271 6 2 Client conflict resolution 271 7 Web GUI client 272 7 1 Management Station 272 7 2 Accessing Web Management Interface 273 7 3 Layout and Navigation 276 7...

Страница 11: ...DUD 451 7 1 Creating DUD for RedHat Enterprise Linux 451 7 2 Creating DUD for Suse Enterprise Linux 451 8 OS Installation 453 8 1 Installation using Chelsio NIC DUD PXE only 453 8 2 Installation on FC...

Страница 12: ...Chapter I Chelsio Unified Wire Chelsio T5 T4 Unified Wire for Linux Page 12 I Chelsio Unified Wire...

Страница 13: ...enable a unified fabric over a single wire by simultaneously running all unmodified IP sockets Fibre Channel and InfiniBand applications over Ethernet at line rate Designed for deployment in virtualiz...

Страница 14: ...on loading unloading and configuring the drivers tools please refer to their respective sections This product is not supported with the current release Support will be added in upcoming releases FCoE...

Страница 15: ...fication files required for building RPM packages src Source code for different drivers support This directory contains source files for the dialog utility tools autoconf 2 63 This directory contains...

Страница 16: ...for higher performance It achieves it through modifying the IRQ CPU binding This script can also be used to change Tx coalescing settings t4 forward sh RFC2544 Forward test tuning script uname_r This...

Страница 17: ...kage See Software Driver Installation section for more information uninstall py Python script that uninstalls the RPM package See Software Driver Uninstallation section for more information Uboot Ther...

Страница 18: ...ter securing the card ensure that the card is still fully seated in the PCIE x8 slot as sometimes the process of securing the card causes the card to become unseated 10 Connect a fiber cable multi mod...

Страница 19: ...Ethernet Controller 03 00 4 Ethernet controller Chelsio Communications Inc T420 CR Unified Wire Ethernet Controller 03 00 5 SCSI storage controller Chelsio Communications Inc T420 CR Unified Wire Sto...

Страница 20: ...of the adapters as well as the Serial numbers Network device names for Chelsio s physical ports are assigned using the following convention the port farthest from the motherboard will appear as the fi...

Страница 21: ...latency specially needed for financial applications NIC TOE iWARP RBD WD UDP IPv6 Sniffer Tracer Bonding MAFO UM Agent Client WebGUI Filtering TM High capacity RDMA Configures adapters to establish a...

Страница 22: ...kage IPv6 should be enabled in the machine to use the RPM Packages 3 2 Installing Chelsio Unified Wire from source 3 2 1 GUI mode with Dialog utility i Download the tarball ChelsioUwire x xx x x tar g...

Страница 23: ...Choose an action vi Select Enable IPv6 Offload to install drivers with IPv6 Offload support or Disable IPv6 offload to continue installation without IPv6 offload support vii Select the required T5 T4...

Страница 24: ...RQs to CPUs Bind MSI X interrupts to different CPUs and disable IRQ balance daemon b Retain IRQ balance daemon Do not disable IRQ balance daemon c TX Coalasce Write tx_coal 2 to modprobe d conf For mo...

Страница 25: ...on of OFED software installed you can skip this step by selecting Skip OFED To install OFED 3 18 1 choose the Install OFED option To install OFED 3 12 1 select Choose OFED Version and then OFED 3 12 1...

Страница 26: ...allation summary of installed components will be displayed xiii Select View log to view the installation log or Exit to continue xiv Select Yes to exit the installer or No to go back xv Reboot your ma...

Страница 27: ...ript to start the GUI installer root host install py ii Select Yes to continue with the installation on the updated kernel or No to exit iii Select the nearest supported kernel version from the list a...

Страница 28: ...er successful installation you can press 1 to view the installation log Press any other key to exit from the installer viii Reboot your machine for changes to take effect 3 2 2 1 iWARP driver installa...

Страница 29: ...mmands will install iWARP iw_cxgb4 and TOE t4_tom drivers on all the nodes listed in the machinefilename file 3 2 3 CLI mode i Download the tarball ChelsioUwire x xx x x tar gz from Chelsio Download C...

Страница 30: ...l To view the list of the supported kernel versions run the following command root host make list_kernels Reboot your machine for changes to take effect 3 2 4 CLI mode individual drivers You can also...

Страница 31: ...upport root host make toe_ipv4 root host make toe_ipv4_install To build and install iWARP driver against outbox OFED root host make iwarp root host make iwarp_install To build and install RDMA Block D...

Страница 32: ...t make udp_offload_install To build and install FCoE Target drivers root host make fcoe_pdu_offload_target root host make fcoe_pdu_offload_target_install The default T5 T4 configuration tuning option...

Страница 33: ...mmand root host install py iv Select the Installation type as described below Enter the corresponding number in the Input field and press Enter 1 Unified Wire Install all the drivers in the Unified Wi...

Страница 34: ...lsio Unified Wire package directory and install Unified Wire using root host install py i nic_toe all bypass udpso wd nic_toe NIC and TOE drivers only all all Chelsio drivers built against inbox OFED...

Страница 35: ...to ChelsioUwire directory and execute the following command root host install py C m machinefilename i nic_toe all bypass udpso wd c T5 T4 configuration o Here o parameter will install OFED and Chelsi...

Страница 36: ...Chapter I Chelsio Unified Wire Chelsio T5 T4 Unified Wire for Linux Page 36 The firmware version can be verified using ethtool root host ethtool i iface...

Страница 37: ...decide to use source you can uninstall the package using CLI or GUI mode 4 1 Uninstalling Chelsio Unified Wire from source 4 1 1 GUI mode with Dialog utility i Change your current working directory to...

Страница 38: ...T4 Unified Wire for Linux Page 38 iv The selected components will now be uninstalled v After successful uninstalltion summary of the uninstalled components will be displayed vi Select View log to vie...

Страница 39: ...and uninstall using the following command root host make uninstall 4 1 3 1 iWARP driver uninstallation on Cluster nodes To uninstal iWARP drivers on multiple Cluster nodes with a single command run t...

Страница 40: ...P RDMA Block Device Bypass UDP Segmentation Offload FCoE PDU Offload target drivers and Unified Wire Manager UM To know about other drivers access help by running make help To uninstall NIC driver roo...

Страница 41: ...your current working directory to Chelsio Unified Wire package directory and and run the following command root host uninstall py inbox ofed inbox for removing all Chelsio drivers ofed for removing O...

Страница 42: ...uninstallation on Cluster nodes To uninstal iWARP drivers on multiple Cluster nodes with a single command run the following root host install py C m machinefilename u The above command will remove Che...

Страница 43: ...s 40Gbps link The port nearest to the motherboard will appear as the first network interface Port 0 ii 4X10Gbps In this mode port 0 functions as 4 10Gbps links and port 1 is disabled iii QSA This mode...

Страница 44: ...T580 PCI devices 1 T580 LP CR 01 00 0 2 T580 CR 03 00 0 3 T580 LP SO CR 04 00 0 iii Select the adapter to configure by specifying the adapter index iv Select the required mode Possible T580 adapter mo...

Страница 45: ...reating network scripts To spot the new interfaces make sure the driver is unloaded first To that point ifconfig a grep HWaddr should display all non chelsio interfaces whose drivers are loaded whethe...

Страница 46: ...n the eth1 interface of the adapter can be brought up and down through the ifup eth1 and ifdown eth1 commands respectively Note that it is of course not compulsory to create a configuration file for e...

Страница 47: ...Installing the tools which will copy t4_perftune sh script to sbin directory Run the script to map the adapter queues to different CPUs root host t4_perftune sh Also follow the steps mentioned below t...

Страница 48: ...any distribution specific problems please check README and Release Notes included in the release for possible workaround Please visit Chelsio support web site http service chelsio com for regular upda...

Страница 49: ...Chapter II Network NIC TOE Chelsio T5 T4 Unified Wire for Linux Page 49 II Network NIC TOE...

Страница 50: ...zed data flow processor implementation and a host of features designed for high throughput and low latency in demanding conditions and networking environments TCP offload is fully implemented in the h...

Страница 51: ...HEL 7 1 LE 3 10 0 229 ael7b ppc64le POWER8 RHEL 6 7 2 6 32 573 el6 RHEL 6 6 2 6 32 504 el6 RHEL 6 5 2 6 32 431 el6 SLES 12 SP1 3 12 49 11 default SLES 12 3 12 28 4 default SLES 11 SP4 3 0 101 63 defau...

Страница 52: ...g command root host modprobe cxgb4 2 2 Loading in TOE mode with full offload support To enable full offload support run the following command root host modprobe t4_tom In VMDirect Path environment it...

Страница 53: ...ameter root host modprobe t4_tom unsupported_allow_unload 1 ii Stop all the offloaded traffic servers and connections Check for the reference count root host cat sys module t4_tom refcnt If the refere...

Страница 54: ...Chapter II Network NIC TOE Chelsio T5 T4 Unified Wire for Linux Page 54 iii Unload the driver root host rmmod t4_tom root host rmmod toecore root host rmmod cxgb4...

Страница 55: ...s Guests using the following command root host rmmod cxgb4vf 4 2 Enabling Busy waiting Busy waiting polling is a technique where a process repeatedly checks to see if an event has occurred by spinning...

Страница 56: ...ceiving queue interrupts a specific CPU through a specific interrupt now For example on a 4 core system t4_perftune sh gives the following output root host t4_perftune sh Discovering Chelsio T4 T5 dev...

Страница 57: ...ue 3 Now interrupts from eth6 are evenly distributed among the 4 CPUs Without T5 T4 s RSS support the interrupts caused by network traffic may be distributed unevenly over CPUs For your information th...

Страница 58: ...0 sysctl w net ipv4 tcp_low_latency 1 sysctl w net core netdev_max_backlog 250000 sysctl w net core rmem_max 16777216 sysctl w net core wmem_max 16777216 sysctl w net core rmem_default 16777216 sysctl...

Страница 59: ...form a larger packet before pushing them to the receive host network stack By doing this rather than processing every small packet the receiver CPU works on fewer packet headers but with same amount o...

Страница 60: ...ote you might need to reboot your system After removing the t4_tom module you can use ethtool to check the status of current GRO LRO settings for example root host ethtool k eth6 Offload parameters fo...

Страница 61: ...ed to larger packets This number is usually zero GROMerged is the number of packets that merged to larger packets Usually this number increases if there is any continuous traffic stream present ethtoo...

Страница 62: ...Chapter III Virtual Function Network vNIC Chelsio T5 T4 Unified Wire for Linux Page 62 III Virtual Function Network vNIC...

Страница 63: ...lude improved disaster recovery server portability cloud computing Virtual Desktop Infrastructure VDI etc Chelsio s T5 and T4 Unified Wire family of Adapters deliver increased bandwidth lower latency...

Страница 64: ...29 el7 RHEL 6 7 2 6 32 573 el6 RHEL 6 6 2 6 32 504 el6 RHEL 6 5 2 6 32 431 el6 SLES 12 SP1 3 12 49 11 default SLES 12 3 12 28 4 default SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76 0 11 default U...

Страница 65: ...ctions please refer the Network NIC TOE section click here 2 2 Loading the driver The vNIC driver must be loaded on the Guest OS by the root user Any attempt to load the driver as a regular user will...

Страница 66: ...r Linux Page 66 3 Software Driver Unloading 3 1 Unloading the driver The vNIC driver must be unloaded on the Guest OS by the root user Any attempt to unload the driver as a regular user will fail To u...

Страница 67: ...Chapter IV iWARP RDMA Chelsio T5 T4 Unified Wire for Linux Page 67 IV iWARP RDMA...

Страница 68: ...her priority to QPs that implement distributed locking mechanisms The iWARP operation also benefits from the high performance and low latency TCP implementation in the offload engine 1 1 Hardware Requ...

Страница 69: ...12 49 11 default SLES 12 3 12 28 4 default SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76 0 11 default Ubuntu 14 04 3 3 19 0 25 generic Ubuntu 14 04 2 3 16 0 30 generic Kernel org linux 4 1 Kernel...

Страница 70: ...er Any attempt to load the driver as a regular user will fail To load the iWARP driver we need to load the NIC driver and core RDMA drivers first Run the following commands root host modprobe cxgb4 ro...

Страница 71: ...the following command root host rmmod iw_cxgb4 openmpi 1 4 3 can cause IMB benchmark stalls due to a shared memory BTL issue This issue is fixed in openmpi 1 4 5 and later releases Hence it is recomme...

Страница 72: ...command on the client machine root host rping c Vv C10 a server_ip_addr p 9999 You should see ping data like this on the client ping data rdma ping 0 ABCDEFGHIJKLMNOPQRSTUVWXYZ _ abcdefghijklmnopqr p...

Страница 73: ...pting to accept default setup and empty password phrase iv Create authorization file root host cd ssh root host cat pub authorized_keys root host chmod 600 authorized_keys v Copy directory ssh to all...

Страница 74: ...your Chelsio interface name is eth2 then the following line adds a DAT version 2 0 device named chelsio2 for that interface chelsio2 u2 0 nonthreadsafe default libdaplofa so 2 dapl 2 0 eth2 0 Open MPI...

Страница 75: ...able iotrace root host make root host make install The above step will install openMPI in usr mpi gcc openmpi x y z v Next create a shell script mpivars csh with the following entry path if echo path...

Страница 76: ...LD_LIBRARY_PATH usr mpi gcc openmpi x y z lib64 LD_LIBRARY_PATH LD_LIBRARY_PATH export LD_LIBRARY_PATH fi MPI_ROOT MPI_ROOT usr mpi gcc openmpi x y z export MPI_ROOT vii Next copy the two files create...

Страница 77: ...64 enable rdma cm libdir usr mpi gcc mvapich2 x y lib64 root host make root host make install The above step will install MVAPICH2 in usr mpi gcc mvapich2 x y iv Next create a shell script mpivars csh...

Страница 78: ...i gcc mvapich2 x y lib64 LD_LIBRARY_PATH LD_LIBRARY_PATH export LD_LIBRARY_PATH fi MPI_ROOT MPI_ROOT usr mpi gcc mvapich2 x y export MPI_ROOT vi Next copy the two files created in steps iv and v to us...

Страница 79: ...h you want to build the benchmarks tool against For example in case of openMPI 1 6 4 set the variable as MPI_HOME usr mpi gcc openmpi 1 6 4 iv Next build and install the benchmarks using root host gma...

Страница 80: ...Peer core96n8 Workaround Increase the OpenMPI rdma route resolution timeout The default is 1000 or 1000ms Increase it to 30000 with this parameter mca btl_openib_connect_rdmacm_resolve_timeout 30000...

Страница 81: ...t modprobe svcrdma iv Start the nfs service as root host service nfs start All services in NFS should start without errors v Now we need to edit the file portlist in the path proc fs nfsd Include the...

Страница 82: ...show all directories from server as root host showmount e server chelsio ip iv Once the exported directories are listed mount them as root host mount nfs serverip directory mountpoint on client o vers...

Страница 83: ...Chapter V RDMA Block Device Driver RBD Chelsio T5 T4 Unified Wire for Linux Page 83 V RDMA Block Device Driver RBD...

Страница 84: ...ed 1 1 Hardware Requirements 1 1 1 Supported Adapters The following are the currently shipping Chelsio adapters that are compatible with Chelsio RDMA block device driver T520 BT T580 CR T520 LL CR T52...

Страница 85: ...ng commands to load the RDMA block device driver on the target machine root host modprobe iw_cxgb4 root host modprobe rdma_ucm root host modprobe rbdt On Initiator Run the following commands to load t...

Страница 86: ...e following commands to unload the RDMA block device driver on the target machine root host rmmod rbdt root host rmmod rdma_ucm root host rmmod iw_cxgb4 On Initiator Run the following commands to unlo...

Страница 87: ...dctl n a 102 1 1 106 d dev ram0 p 65000 Removing a Target Run the following command to remove a target from the initiator machine root host rbdctl r d initiator_device E g root host rbdctl r d dev rbd...

Страница 88: ...Chapter VI WD UDP Chelsio T5 T4 Unified Wire for Linux Page 88 VI WD UDP...

Страница 89: ...thernet solution for high frequency trading and other delay sensitive applications 1 1 Hardware Requirements 1 1 1 Supported Adapters The following are the currently shipping Chelsio Adapters that are...

Страница 90: ...ault SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76 0 11 default Ubuntu 14 04 3 3 19 0 25 generic Ubuntu 14 04 2 3 16 0 30 generic Kernel org linux 4 1 Kernel org linux 3 18 Kernel org linux 3 17 K...

Страница 91: ...user will fail RDMA core modules from the OFED package should be loaded before proceeding To load the WD UDP driver use the following commands which will automatically load RDMA core modules root host...

Страница 92: ...Chapter VI WD UDP Chelsio T5 T4 Unified Wire for Linux Page 92 3 Software Driver Unloading To unload the WD UDP driver run the following command root host rmmod iw_cxgb4...

Страница 93: ...Latency or High Capacity WD tuning option 4 1 1 Application Requirements Certain application behavior is not supported by libcxb4_sock in this release If your application does any of the following it...

Страница 94: ...arting your application Preloading using wdload script root host PROT UDP wdload pathto your_application The above command will generate an end point file libcxgb4_sock conf at etc Parameters like int...

Страница 95: ...eth2 and eth3 configured for example you can define certain endpoints to eth2 and others to eth3 endpoint interface eth2 port 9999 endpoint interface eth3 port 8888 For VLAN support create your VLANs...

Страница 96: ...ion root host LD_PRELOAD libcxgb4_sock_debug so CXGB4_SOCK_DEBUG 1 pathto your_application 4 1 4 Running WD UDP with larger I O size If the I O size is 3988 execute the commands mentioned below root h...

Страница 97: ...t r9 root r10 cat etc libcxgb4_sock conf endpoint interface eth1 port 0 root r10 On R10 we run udpserver on port 9000 without libcxgb4_sock preloaded and on port 90001 with preload root r10 usr local...

Страница 98: ...termining if the application is being offloaded To see if the application is being offloaded open a window on one of the machines and run tcpdump against the Chelsio interface If you see minimal UDP o...

Страница 99: ...Chapter VII iSCSI PDU Offload Target Chelsio T5 T4 Unified Wire for Linux Page 99 VII iSCSI PDU Offload Target...

Страница 100: ...protocol is executed in software The performance of this iSCSI stack is outstanding and when used with Chelsio s hardware it is enhanced further Because of the tight integration with Chelsio s TOE ad...

Страница 101: ...lease for Microsoft Cluster Support Persistent Reservation Dynamic LUN Resizing iSCSI Target Redirection Multiple Target device types Block Virtual Block LVM Software RAID EVMS etc Built in RAM Disk B...

Страница 102: ...are supported block virtual block RAM disk Multiple storage devices are allowed by configuring the devices to one target or the devices to multiple targets The software allows multiple targets to sha...

Страница 103: ...16 0 30 generic Kernel org linux 3 18 Kernel org linux 3 17 Kernel org linux 3 6 Other kernel versions have not been tested and are not guaranteed to work Limited QA performed 1 3 2 Requirements for I...

Страница 104: ...limitation on what version of the Linux kernel it can run on is mostly dependent on the NIC driver s limitations The iSCSI module will be installed in the lib modules linux_kernel_version updates kern...

Страница 105: ...t service loads the kernel module and starts all the targets configured by default It can also be used to stop the targets and restart reload configuration Note i While using rpm tar ball for installa...

Страница 106: ...Chapter VII iSCSI PDU Offload Target Chelsio T5 T4 Unified Wire for Linux Page 106 3 Software Driver Unloading Use the following command to unload the module root host rmmod chiscsi_t4...

Страница 107: ...et configuration settings Retrieve active sessions information of an iSCSI Target Manually flush data to the iSCSI Target disks Reload the iSCSI configuration file Update the iSCSI configuration file...

Страница 108: ...Basic editing of the iSCSI configuration file Basic commands of the iSCSI control tool including how to start and stop a target 4 3 1 A Sample iSCSI Configuration File The default Chelsio iSCSI config...

Страница 109: ...Control of the Chelsio iSCSI software is done through iscsictl the command line interface control tool The following are the basic commands needed for effective control of the target Start Target To s...

Страница 110: ...global settings execute iscsictl with g option root host iscsictl g Change Global Settings To change Chelsio global settings execute iscsictl with G option root host iscsictl G iscsi_login_complete_t...

Страница 111: ...ltiple values they must be listed on one line with a comma to separate their values Another way to list the values instead of commas is to list their values as key value pairs repeatedly each on a new...

Страница 112: ...way CHAP DISC_Auth_CHAP_Target user id secret Yes CHAP user id and secret for the target user id must be less than 256 characters Commas are not allowed secret must be between 6 and 255 characters Com...

Страница 113: ...is information is unique for each entity block The parameters follow the IETF iSCSI standard RFC 3720 in both definition and syntax The descriptions below are mostly from this RFC Table of iSCSI Entit...

Страница 114: ...etAlias target alias No A human readable name or description of a target It is not used as an identifier nor is it for authentication Target only MaxRecvDataSegmentLength 512 to 16777215 224 1 8192 No...

Страница 115: ...secret Yes CHAP user id and secret for the initiator user id must be less than 256 characters Commas are not allowed secret must be between 6 and 255 characters Commas are not allowed The initiator us...

Страница 116: ...rected to NOTE There can be multiple redirection target portalgroups specified for a particular target portal group and the redirection will happen to these in a round robin manner ShadowMode Yes No N...

Страница 117: ...RamDisk size is 16MB 16 Megabytes The minimum value of x is 1 1MB and the maximum value is limited by system memory SN is a 16 character unique value ID is a 24 character unique value WWN is a 16 char...

Страница 118: ...that the iSCSI target is listening on i e the target portal IP addresses NOTE when configuring an ACL at least one of the above three must be provided iname and or sip and or dip lun lun list permiss...

Страница 119: ...ecret1 DISC_Auth_CHAP_Initiator initiator_id1 initiator_sec1 an iSCSI Target iqn 2006 02 com chelsio diskarray san1 being served by the portal group 5 Setup as a RAM Disk target TargetName iqn 2006 02...

Страница 120: ...ortal groups served this target PortalGroup 1 102 50 50 25 3260 PortalGroup 2 102 60 60 25 3260 CHAP configuration Auth_CHAP_Policy Mutual Auth_CHAP_target iTarget1ID iTarget1Secret Auth_CHAP_Initiato...

Страница 121: ...essions 4 5 1 Normal Session CHAP Authentication For a normal Session the CHAP authentication is configured on a per target basis 4 5 2 Oneway CHAP authentication With one way CHAP also called unidire...

Страница 122: ...or needs to be authenticated or not The default setting of AuthMethod is None CHAP The Auth_CHAP_Policy key controls which CHAP authentication one way or mutual needs to be performed if CHAP is used T...

Страница 123: ...ecret Sample Chelsio iSCSI Global Settings global DISC_AuthMethod CHAP DISC_Auth_CHAP_Policy Mutual DISC_Auth_CHAP_Target target_id1 target_secret1 DISC_Auth_CHAP_Initiator initiator_id1 initiator_sec...

Страница 124: ...102 60 60 25 initiator iqn 2005 09 com chelsio san2 from 102 50 50 22 and connected via the target portal 102 50 50 25 is allowed read only access of this target ACL iname iqn 2006 02 com chelsio san2...

Страница 125: ...arlier in this document 4 7 1 RAM Disk Details For the built in RAM disk The minimum size of the RAM disk is 1 Megabyte MB and the maximum is limited by system memory To use a RAM disk with a Windows...

Страница 126: ...The path must exist in the system SYNC When specified the Target will flush all the data in the system cache to the storage driver before sending response back to the Initiator 4 7 3 Example Configur...

Страница 127: ...redirect an initiator to use a different IP address and port often called a portal instead of the current one to connect to the target The redirected target portal can either be on the same machine o...

Страница 128: ...eceived on a particular portal group to multiple portal groups in a round robin manner Below is an example Redirection to Multiple Portal Groups target snip any login requests received on 10 193 184 8...

Страница 129: ...s This option must be specified with one of the following other options S or W For the S option f must be specified first All other options will ignore this f option If the f option is not specified...

Страница 130: ...e cached data to the target disk s target name parameter Where name is the name of the target to be flushed name can be one or more string of names separated by a comma name1 name2 nameN ALL A name of...

Страница 131: ...iSCSI targets target name parameter Where name is the name of the target s that will be started or reloaded The target name parameter can be specified as one or more parameter on the same command line...

Страница 132: ...session This option should be specified with the handle of the session in hex that needs to be dropped The session handle can be retrieved using the previous mentioned iscsictl option r used to retrie...

Страница 133: ...tional and if it s not specified it defaults to 3205 The server with the ip address is mandatory and if it s not specified the the command will be denied id isns entity id where id is the iSNS entity...

Страница 134: ...y connections and sessions that already completed login phase TargetAlias MaxConnections InitialR2T ImmediateData FirstBurstLength MaxBurstLength MaxOutstandingR2T HeaderDigest DataDigest MaxRecvDataS...

Страница 135: ...defaults to CHAP On an iSCSI target when ACL_Enable is set to Yes iscsi_auth_order decides whether to perform CHAP first then ACL or perform ACL then CHAP ACL When setting iscsi_auth_order ACL initiat...

Страница 136: ...and identify if the initiator is running Chelsio drivers if the initiator name contains the same substring as iscsi_chelsio_ini_idstr it is assumed the initiator is running with the Chelsio iscsi init...

Страница 137: ...Chapter VIII iSCSI PDU Offload Initiator Chelsio T5 T4 Unified Wire for Linux Page 137 VIII iSCSI PDU Offload Initiator...

Страница 138: ...TTT in Data Out PDUs PDU Transmit and Recovery On transmit side Chelsio hardware accepts the complete PDU header data from the host driver computes and inserts the digests decomposes the PDU into mul...

Страница 139: ...10 0 229 el7 RHEL 7 1 BE 3 10 0 229 el7 ppc64 POWER7 RHEL 7 1 LE 3 10 0 229 ael7b ppc64le POWER8 RHEL 6 7 2 6 32 573 el6 RHEL 6 6 2 6 32 504 el6 RHEL 6 5 2 6 32 431 el6 SLES 12 SP1 3 12 49 11 default...

Страница 140: ...n 0 On SLES load the driver with allow option root host modprobe cxgb4i lro_on 0 allow If loading of cxgb4i displays unkown symbols found error in dmesg follow the steps mentioned below i Kill iSCSI d...

Страница 141: ...VIII iSCSI PDU Offload Initiator Chelsio T5 T4 Unified Wire for Linux Page 141 3 Software Driver Unloading To unload the driver execute the following commands root host rmmod cxgb4i root host rmmod l...

Страница 142: ...ce ipaddress iscsi ip address E g iface iscsi_ifacename cxgb4i 00 07 43 04 5b da iface hwaddress 00 07 43 04 5b da iface transport_name cxgb4i iface net_ifacename eth3 iface ipaddress 102 2 2 137 Alte...

Страница 143: ...b da iii Logging into an iSCSI Target Log into an iSCSI target using the following format iscsiadm m node T iqn name of target p target ip address target port no I cxgb4i iface file name l E g root ho...

Страница 144: ...ame of target p target ip address target port no I cxgb4i iface file name u E g root host iscsiadm m node T iqn 2004 05 com chelsio target1 p 102 2 2 155 3260 1 I cxgb4i 00 07 43 04 5b da u 4 2 Auto l...

Страница 145: ...d Wire for Linux Page 145 E g force_start echo n Starting prog modprobe q iscsi_tcpmodprobe q ib_iser modprobe q cxgb4i modprobe q cxgb3i modprobe q bnx2i modprobe q be2iscsi daemon brcm_iscsiuio daem...

Страница 146: ...Chapter IX Data Center Bridging DCB Chelsio T5 T4 Unified Wire for Linux Page 146 IX Data Center Bridging DCB...

Страница 147: ...tion Administration is simplified since the specifications enable transport of storage and networking traffic over a single unified Ethernet network 1 1 Hardware Requirements 1 1 1 Supported Adapters...

Страница 148: ...or Linux Page 148 Ubuntu 14 04 3 3 19 0 25 generic Ubuntu 14 04 2 3 16 0 30 generic Kernel org linux 4 1 Kernel org linux 3 18 Kernel org linux 3 17 Kernel org linux 3 6 Other kernel versions have not...

Страница 149: ...pport and FCoE Initiator csiostor drivers must be loaded in order to enable DCB feature Also the drivers must be loaded by the root user Any attempt to load the drivers as a regular user will fail Run...

Страница 150: ...re for Linux Page 150 3 Software Driver Unloading To disable DCB feature unload FCoE Initiator and Network drivers root host rmmod csiostor root host rmmod cxgb4 If t4_tom is loaded please reboot mach...

Страница 151: ...affic priorities NIC uses priority 0 and FcoE uses priority 3 switch config class map type qos class nic switch config cmap qos match cos 0 switch config cmap qos class map type qos class fcoe switch...

Страница 152: ...rcent 0 vii Configure network qos policy maps and set up the PFC for no drop traffic class switch config policy map type network qos policy test switch config pmap nq class type network qos class nic...

Страница 153: ...exit switch config vsan database switch config vsan db vsan 2 switch config vsan db vsan 2 interface vfc 13 switch config vsan db exit iii Assign VLAN ID to the Ethernet port on which FCoE service was...

Страница 154: ...iator and the target on that particular VSAN although FLOGI d into the switch will not talk to each other To enable it execute the below command switch config zone default zone permit vsan 2 4 2 Confi...

Страница 155: ...er rule 2 proto fip encap ethv2 switch config vlan classifier group 1 add rule 1 switch config vlan classifier group 1 add rule 2 switch config interface vlan 1002 switch conf if vl 1002 fcf forward s...

Страница 156: ...for running NIC and iSCSI traffic and configure corresponding VLAN priority Example Switch is configured with a VLAN priority of 2 and 5 for NIC and iSCSI class of traffic respectively NIC traffic is...

Страница 157: ...Chapter X FCoE PDU Offload Target Chelsio T5 T4 Unified Wire for Linux Page 157 X FCoE PDU Offload Target...

Страница 158: ...nts 1 1 1 Supported Adapters The following are the currently shipping Chelsio Adapters that are compatible with FCoE PDU offload target driver T520 CR T520 LL CR T580 LP CR T580 CR 1 2 Software Requir...

Страница 159: ...oad the driver in FCF mode run the following command root host modprobe chfcoe To load the driver in VN2VN mode run the following command root host modprobe chfcoe chfcoe_fip_mode 1 To load the driver...

Страница 160: ...Chapter X FCoE PDU Offload Target Chelsio T5 T4 Unified Wire for Linux Page 160 3 Software Driver Unloading To unload the driver run the following command root host modprobe r chfcoe...

Страница 161: ...set the traffic priorities NIC uses priority 0 and FcoE uses priority 3 switch config class map type qos class nic switch config cmap qos match cos 0 switch config cmap qos class map type qos class f...

Страница 162: ...coe switch config pmap c que bandwidth percent 50 switch config pmap c que class type queuing class default switch config pmap c que bandwidth percent 0 vii Configure network qos policy maps and set u...

Страница 163: ...annel VFC and binds that VFC to an Ethernet interface so that the Ethernet port begins functioning as an FCoE port switch config interface vfc 13 switch config if bind interface ethernet 1 13 switch c...

Страница 164: ...switch config zone default zone permit vsan 2 4 2 Collecting port information To create a SCST target configuration enable the interfaces Next determine the WWPN of target and initiator nodes using th...

Страница 165: ...the local port information root host cxgbtool stor a adapter_device_file show lnode If FCoE PDU Offload Target is operating in FCF mode then the local node information will be available only after the...

Страница 166: ...helsio T5 T4 Unified Wire for Linux Page 166 4 2 2 Verifying remote ports To verify remote ports fabric name server initiator ports etc use the following command root host cxgbtool stor a adapter_devi...

Страница 167: ...previous section ii Create an SCST configuration file based on your setup A sample configuration file will be available at etc chelsio fcoe after Unified Wire installation iii Ensure that SCST handler...

Страница 168: ...arget Chelsio T5 T4 Unified Wire for Linux Page 168 The following configuration file adds three LUNs RAMDisk physical disk NULLIO disk for the target specified Only initiators present in the group wil...

Страница 169: ...P 4 4 Configuring Persistent Target chfcoe service is required to configure persistent target and will be installed during Unified Wire installation Please follow the procedure mentioned below i Based...

Страница 170: ...l be in disabled state Enable it using the following command root host chkconfig chfcoe on To determine the run levels on which the service is enabled run the following command root host chkconfig lis...

Страница 171: ...d in the system Follow the steps mentioned below to do so root host chkconfig list irqbalance irqbalance 0 off 1 off 2 on 3 on 4 on 5 on 6 off root host chkconfig irqbalance off root host service irqb...

Страница 172: ...command will load chfcoe module in VN2VN mode and create 12 chfcoe workers on NUMA node 0 Binding one chfcoe worker per CPU Use the following command to bind chfcoe workers to CPUs 2 3 4 5 6 7 18 19...

Страница 173: ...1 smp_affinity Writing 20000 in proc irq 152 smp_affinity Writing 1 in proc irq 153 smp_affinity Writing 2 in proc irq 154 smp_affinity Writing 10000 in proc irq 155 smp_affinity Writing 20000 in proc...

Страница 174: ...Chapter XI FCoE Full Offload Initiator Chelsio T5 T4 Unified Wire for Linux Page 174 XI FCoE Full Offload Initiator...

Страница 175: ...hannel networks and management software 1 1 Hardware Requirements 1 1 1 Supported Adapters The following are the currently shipping Chelsio Adapters that are compatible with FCoE full offload Initiato...

Страница 176: ...FCoE Full Offload Initiator Chelsio T5 T4 Unified Wire for Linux Page 176 Kernel org linux 3 17 Kernel org linux 3 6 Other kernel versions have not been tested and are not guaranteed to work Limited Q...

Страница 177: ...t user Any attempt to load the driver as a regular user will fail To load the driver execute the following root host modprobe csiostor To load the driver on any SLES distribution execute the following...

Страница 178: ...T5 T4 Unified Wire for Linux Page 178 3 Software Driver Unloading To unload the driver root host modprobe r csiostor If multipath services are running unload of FCoE driver is not possible Stop the mu...

Страница 179: ...itch use the following command to see if the FIP has gone through and a VN_Port MAC address has been assigned Verify if all the FCoE ports are online ready and a successful FIP has taken place using t...

Страница 180: ...Chapter XI FCoE Full Offload Initiator Chelsio T5 T4 Unified Wire for Linux Page 180...

Страница 181: ...the WWPN of the initiator local port under sysfs The hosts under fc_host depends on the number of ports on the adapter used root host cat sys class fc_host hostX port_name iii After finding the localp...

Страница 182: ...itiator Chelsio T5 T4 Unified Wire for Linux Page 182 After finding out the WWPN of the local node to verify the list of discovered targets use the following command root host cxgbtool stor a adapter_...

Страница 183: ...XI FCoE Full Offload Initiator Chelsio T5 T4 Unified Wire for Linux Page 183 4 3 Formatting the LUNs and Mounting the Filesystem Use lsscsi g to list the LUNs discovered by the initiator root host ls...

Страница 184: ...s discovered by the Chelsio FCoE initiators can be accessed via easily identifiable udev path device files like root host ls dev disk by path pci 0000 04 00 0 csio fcoe local_wwpn remote_wwpn lun_wwn...

Страница 185: ...Full Offload Initiator Chelsio T5 T4 Unified Wire for Linux Page 185 4 5 Mounting the formatted LUN The formatted LUN can be mounted on the specified mountpoint using the following command root host m...

Страница 186: ...Chapter XII Offload Bonding driver Chelsio T5 T4 Unified Wire for Linux Page 186 XII Offload Bonding driver...

Страница 187: ...e T5 T4 Adapter thus freeing the CPU from TCP IP overhead 1 1 Hardware Requirements 1 1 1 Supported Adapters The following are the currently shipping Chelsio Adapters that are compatible with the Chel...

Страница 188: ...28 4 default SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76 0 11 default Ubuntu 14 04 3 3 19 0 25 generic Ubuntu 14 04 2 3 16 0 30 generic Kernel org linux 4 1 Kernel org linux 3 18 Kernel org lin...

Страница 189: ...ing The driver must be loaded by the root user Any attempt to load the driver as a regular user will fail To load the driver with offload support run the following command root host modprobe bonding P...

Страница 190: ...Chapter XII Offload Bonding driver Chelsio T5 T4 Unified Wire for Linux Page 190 3 Software Driver Unloading To unload the driver run the following command root host rmmod bonding...

Страница 191: ...erface use the following method i Load the network driver with TOE support root host modprobe t4_tom ii Create a bonded interface root host modprobe bonding mode 1 miimon 100 iii Bring up the bonded i...

Страница 192: ...Chapter XIII Offload Multi Adapter Failover MAFO Chelsio T5 T4 Unified Wire for Linux Page 192 XIII Offload Multi Adapter Failover MAFO...

Страница 193: ...ffective fault tolerance The traffic running over the bonded interface can be fully offloaded to the Adapter thus freeing the CPU from TCP IP overhead 1 1 Hardware Requirements 1 1 1 Supported Adapter...

Страница 194: ...S 12 3 12 28 4 default SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76 0 11 default Ubuntu 14 04 3 3 19 0 25 generic Ubuntu 14 04 2 3 16 0 30 generic Kernel org linux 4 1 Kernel org linux 3 18 Kerne...

Страница 195: ...er Loading The driver must be loaded by the root user Any attempt to load the driver as a regular user will fail To load the driver with offload support run the following command root host modprobe bo...

Страница 196: ...Chapter XIII Offload Multi Adapter Failover MAFO Chelsio T5 T4 Unified Wire for Linux Page 196 3 Software Driver Unloading To unload the driver run the following command root host rmmod bonding...

Страница 197: ...om ii Create a bonded interface root host modprobe bonding mode 1 miimon 100 iii Bring up the bonded interface and enslave the interfaces to the bond root host ifconfig bond0 up root host ifenslave bo...

Страница 198: ...Chapter XIV UDP Segmentation Offload and Pacing Chelsio T5 T4 Unified Wire for Linux Page 198 XIV UDP Segmentation Offload and Pacing...

Страница 199: ...g in millions of system calls and packet traversals through all protocol layers in the operating system to the network device In contrast USO implements the network protocol stack in the adapter and t...

Страница 200: ...ver is available for the following versions RHEL 7 2 3 10 0 327 el7 RHEL 7 1 3 10 0 229 el7 RHEL 6 7 2 6 32 573 el6 RHEL 6 6 2 6 32 504 el6 RHEL 6 5 2 6 32 431 el6 SLES 12 SP1 3 12 49 11 default SLES...

Страница 201: ...ver as a regular user will fail Run the following commands to load the driver root host modprobe cxgb4 root host modprobe t4_tom Though normally associated with the Chelsio TCP Offload engine the t4_t...

Страница 202: ...n Offload and Pacing Chelsio T5 T4 Unified Wire for Linux Page 202 3 Software Driver Unloading Reboot the system to unload the driver To unload without rebooting refer Unloading the TOE driver section...

Страница 203: ...n the data stream to This value needs to be in the range of 0 to 14 for T4 series of adapters and a range of 0 to 15 for T5 series of adapters The application will function according to the parameters...

Страница 204: ...and sends out the data In order to use the UDP offload functionality for RTP data make the following additions to the steps mentioned above 1 In step ii declare and initialize a new variable in the ap...

Страница 205: ...hannel Channel No class scheduler class index max rate maximum rate pkt size Packet size Here ethX is the Chelsio interface Channel No is the port on which data is flowing 0 3 scheduler class index is...

Страница 206: ...type packet level cl rl mode flow rate unit bits rate mode absolute channel 0 class 1 max rate 10000 pkt size 1316 To get an accurate bit rate per class data sent by the application to the sockets sh...

Страница 207: ...Chapter XV Offload IPv6 driver Chelsio T5 T4 Unified Wire for Linux Page 207 XV Offload IPv6 driver...

Страница 208: ...1 1 Hardware Requirements 1 1 1 Supported Adapters The following are the currently shipping Chelsio Adapters that are compatible with Chelsio Offload IPv6 feature T520 BT T580 CR T520 LL CR T520 CR T...

Страница 209: ...ES 12 3 12 28 4 default SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76 0 11 default Ubuntu 14 04 3 3 19 0 25 generic Ubuntu 14 04 2 3 16 0 30 generic Kernel org linux 4 1 Kernel org linux 3 18 Kern...

Страница 210: ...upport see Software Driver Installation After installing Unified Wire package and rebooting the host load the NIC cxgb4 and TOE t4_tom drivers The drivers must be loaded by the root user Any attempt t...

Страница 211: ...load IPv6 feature unload NIC and TOE drivers 3 1 Unloading the NIC driver To unload the NIC driver run the following command root host rmmod cxgb4 3 2 Unloading the TOE driver Please reboot the system...

Страница 212: ...Chapter XVI Bypass Driver Chelsio T5 T4 Unified Wire for Linux Page 212 XVI Bypass Driver...

Страница 213: ...re programmable behavior on power fails either Bypass Mode or Drop Mode Firmware control of Bypass Normal Drop Modes when T4 timer expires Bypass control via software Drop Mode control by putting the...

Страница 214: ...s called a rule When a rule is matched an action is applied to the ingress packet The actions that are supported are drop forward and input The drop action causes the packet to be discarded The forwar...

Страница 215: ...RHEL 6 7 2 6 32 573 el6 RHEL 6 6 2 6 32 504 el6 RHEL 6 5 2 6 32 431 el6 SLES 12 SP1 3 12 49 11 default SLES 12 3 12 28 4 default SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76 0 11 default Ubuntu 1...

Страница 216: ...with Bypass support as mentioned in CLI mode individual drivers section The driver must be loaded by the root user Any attempt to load the driver as a regular user will fail Run the following command...

Страница 217: ...Chapter XVI Bypass Driver Chelsio T5 T4 Unified Wire for Linux Page 217 3 Software Driver Unloading Run the following command to unload the Bypass driver root host rmmod cxgb4...

Страница 218: ...e created that implements the Bypass API as specified below This CLI will then communicate the requests to the SDK server The API will contain the following elements Bypass Management watchdog state R...

Страница 219: ...watchdog enable disable lock ping bypass ethX get watchdog_timeout timeout in milliseconds bypass ethX set watchdog_timeout timeout in milliseconds maximum is 60000 4 2 2 Operating the Switch Example...

Страница 220: ...nds root host bypass ethX set watchdog_timeout 3000 Start pinging the watchdog root host while true do bypass ethX set watchdog ping sleep 1 done Enable the watchdog root host bypass ethX set watchdog...

Страница 221: ...to any srcaddr Source IP address dstaddr Destination IP address vlan VLAN id action input forward drop default input port If action is input then this is the port to which the packet is directed srcm...

Страница 222: ...e that is used to hold a set of rules redirect ethX activate_table table table id Activate a table so that all the rules in it will be active redirect ethx deactivate_table table table id Deactivate a...

Страница 223: ...e current configured rules tables persistent redirect the output to etc ba cfg file only root host redirect ethX dump etc ba cfg where the etc ba cfg is read by the bad service at boot time To apply t...

Страница 224: ...Chapter XVII WD Sniffing and Tracing Chelsio T5 T4 Unified Wire for Linux Page 224 XVII WD Sniffing and Tracing...

Страница 225: ...icast traffic and sending it directly to user space a Get a Queue raw QP idx b Program a filter to redirect specific traffic to the raw QP queue Tracer All tapped traffic is forwarded to user space an...

Страница 226: ...ed Wire for Linux Page 226 Schematic diagram of sniffer and tracer 1 1 Hardware Requirements 1 1 1 Supported Adapters The following are the currently shipping Chelsio Adapters that are compatible with...

Страница 227: ...g version RHEL 7 2 3 10 0 327 el7 RHEL 7 1 3 10 0 229 el7 RHEL 6 7 2 6 32 573 el6 RHEL 6 6 2 6 32 504 el6 RHEL 6 5 2 6 32 431 el6 SLES 12 SP1 3 12 49 11 default SLES 12 3 12 28 4 default SLES 11 SP4 3...

Страница 228: ...s with one machine having a T5 T4 card The machines should be setup in the following manner Machine A Machine B 192 168 1 100 192 168 1 200 2 Procedure On the Device Under Test DUT start sniffer root...

Страница 229: ...Procedure Run wd_tcpdump_trace i iface on the command prompt where iface is one of the interfaces whose traffic you want to trace In the above diagram its port 0 or port 1 root host wd_tcpdump_trace...

Страница 230: ...Chapter XVIII Classification and Filtering Chelsio T5 T4 Unified Wire for Linux Page 230 XVIII Classification and Filtering...

Страница 231: ...th to Steer ingress packets that meet ACL Access Control List accept criteria to a particular receive queue Switch proxy ingress packets that meet ACL accept criteria to an output port with optional h...

Страница 232: ...L 7 1 3 10 0 229 el7 RHEL 6 7 2 6 32 573 el6 RHEL 6 6 2 6 32 504 el6 RHEL 6 5 2 6 32 431 el6 SLES 12 SP1 3 12 49 11 default SLES 12 3 12 28 4 default SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76...

Страница 233: ...is set by default and packets will be matched accordingly i For T5 filterMode fcoemask srvrsram fragmentation mpshittype protocol vlan port fcoe ii For T4 filterMode fragmentation mpshittype protocol...

Страница 234: ...xgbtool ethx filter index action pass drop switch Where ethX Chelsio interface index positive integer set as filter id action Ingress packet disposition pass Ingress packets will be passed through set...

Страница 235: ...s use the prio argument with the above command root host cxgbtool ethx filter index action pass drop switch prio 1 2 3 Listing Filter Rules To list the filters set run the following command root host...

Страница 236: ...ost ifconfig eth0 eth0 Link encap Ethernet HWaddr 00 07 43 04 7D 50 inet addr 102 1 1 1 Bcast 102 1 1 255 Mask 255 255 255 0 inet6 addr fe80 207 43ff fe04 7d50 64 Scope Link UP BROADCAST RUNNING PROMI...

Страница 237: ...onfig eth0 3 102 1 2 3 24 up root host ifconfig eth0 eth0 Link encap Ethernet HWaddr 00 07 43 12 D4 88 inet addr 102 1 2 1 Bcast 102 1 2 255 Mask 255 255 255 0 inet6 addr fe80 7 4300 112 d488 64 Scope...

Страница 238: ...729 60 2 KiB Interrupt 16 root host ifconfig eth1 102 1 2 250 24 up root host ifconfig eth1 eth1 Link encap Ethernet HWaddr 00 07 43 04 96 48 inet addr 102 1 2 250 Bcast 102 1 2 255 Mask 255 255 255 0...

Страница 239: ...24 hitcnts 1 action switch eport 0 smac 00 07 43 04 96 40 dmac 00 07 43 04 7D 50 Where smac is the MAC address of eth0 interface on T5 adapter machine and dmac is the MAC address of eth0 interface on...

Страница 240: ...ns 0 carrier 0 collisions 0 txqueuelen 1000 RX bytes 1585952 1 5 MiB TX bytes 4798122 4 5 MiB Interrupt 16 ii Setup ARP entry to reach 102 1 1 2 root host arp s 102 1 1 2 00 07 43 12 D4 88 Follow thes...

Страница 241: ...h0 up promisc root host ifconfig eth1 up promisc iv Build and install latest iproute2 package v Add fdb entry corresponding to Node 2 on T5 s eth0 interface root host bridge fdb add 00 07 43 12 D4 88...

Страница 242: ...helsio T5 T4 Unified Wire for Linux Page 242 ix Create a filter to match incoming packet s dst mac 00 07 43 04 7d 50 with particular mac idx and switch it out via eport 0 root host cxgbtool eth0 filte...

Страница 243: ...ex action pass drop switch fip source ip of incoming packet lip destination ip of incoming packet fport source port lport destination port hitcnts 1 cap maskless Where ethX Chelsio interface index Fil...

Страница 244: ...ort 12000 hitcnts 1 cap maskless proto 6 Hash Filter Index 308184 The above filter rule will pass all TCP packets matching above 4 tuple Switch action root host cxgbtool ethX filter 496 action switch...

Страница 245: ...ses This is applicable only for switch filter rules Here s an example root host cxgbtool eth2 filter 1 action switch lip 102 2 2 1 fip 102 2 2 2 lport 5001 fport 14000 hitcnts 1 iport 1 eport 0 swapma...

Страница 246: ...s_id trace0 iii Configure RSS Queue to send trace packets Determine the RspQ ID of the queues by looking at Trace QType in sys kernel debug cxgb4 bus id sge_qinfo file root host cxgbtool ethX reg 0x0a...

Страница 247: ...Trace Queue0 RspQ ID iv Similarly for other direction and for multiple ports run the follow commands root host echo rx0 snaplen 40 sys kernel debug cxgb4 bus_id trace1 root host echo tx1 snaplen 40 s...

Страница 248: ...XIX Traffic Management Chelsio T5 T4 Unified Wire for Linux Page 248 XIX Traffic Management...

Страница 249: ...esence of other traffic Control max bandwidth that a connection or a flow a group of connections can use Allocate available bandwidth to several connection or flows based on desired levels of performa...

Страница 250: ...9 el7 RHEL 6 7 2 6 32 573 el6 RHEL 6 6 2 6 32 504 el6 RHEL 6 5 2 6 32 431 el6 SLES 12 SP1 3 12 49 11 default SLES 12 3 12 28 4 default SLES 11 SP4 3 0 101 63 default SLES 11 SP3 3 0 76 0 11 default Ub...

Страница 251: ...ections as well as on offloaded connections The drivers must be loaded by the root user Any attempt to load the drivers as a regular user will fail Run the following commands to load the TOE driver ro...

Страница 252: ...agement Chelsio T5 T4 Unified Wire for Linux Page 252 3 Software Driver Unloading Reboot the system to unload the driver To unload without rebooting refer Unloading the TOE driver section of Network N...

Страница 253: ...te mode channel Channel No class scheduler class index max rate maximum rate pkt size Packet size Here ethX is the Chelsio interface scheduler mode specifies whether the rule is configured for individ...

Страница 254: ...bin scheduling hierarchy Possible values include 1 to 99 4 1 3 Channel Rate Limiting This scheduler hierarchy level can be used to rate limit individual channels Channel rate limiting can be configure...

Страница 255: ...hX up ii Bind connections to queues root host tc qdisc add dev ethX root handle 1 multiq root host tc filter add dev ethX parent 1 protocol ip prio 1 u32 match ip dst IP address of destination action...

Страница 256: ...4_tom root host ifconfig ethX up ii Create a new policy file say new_policy_file and add the following line to associate connections with the given scheduling class E g src host 102 1 1 1 offload clas...

Страница 257: ...ll function according to the parameters set for that traffic class iii Add socket option definitions In order to use setsockopt to set the options to the TCP socket the following two definitions need...

Страница 258: ...1 multiq root host tc filter add dev eth0 parent 1 protocol ip prio 1 u32 match ip dst 192 168 5 3 action skbedit queue_mapping 3 iii Bind the NIC TX queue to class 0 root host cxgbtool eth0 sched qu...

Страница 259: ...rl mode class rate unit bits rate mode absolute channel 0 class 0 max rate 300000 pkt size 1460 5 3 Offloaded Connections with Modified Application The following example demonstrates the method to rat...

Страница 260: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 260 XX Unified Wire Manager UM...

Страница 261: ...manage Option ROM PXE and iSCSI for T3 PXE FCoE and iSCSI for T5 and T4 capability for Chelsio cards using various tools available in the software Additionally Unified Wire Manager allows Chelsio adap...

Страница 262: ...radation issues will not be observed when using the Web GUI since it s lightweight and utilizes very less system resources Figure 1 2 Chelsio Unified Wire Manager with web interface Web GUI 1 3 Unifie...

Страница 263: ...ng a web browser The management interface uses a secure 256 bit encrypted HTTP connection ensuring that authentication and configuration data are protected during transmission from the web browser to...

Страница 264: ...ers that are compatible with Chelsio Unified Wire Manager T520 BT T580 CR T520 LL CR T520 CR T580 LP CR T420 CR T440 CR T422 CR T420 SO CR T404 BT T420 BCH T440 LP CR T420 BT T420 LL CR T420 CX S302E...

Страница 265: ...S 11 SP3 3 0 76 0 11 default Management Agent Management Client Web Management Interface 2 3 Platform Driver Matrix The table below lists the Chelsio drivers and their supported versions Chelsio drive...

Страница 266: ...lsio Unified Wire has been designed to install Unified Wire Manager UM by default All the three UM components i e Management Agent Client and Station will be installed on selecting any of the Terminat...

Страница 267: ...ld confirm that Management Agent is running by displaying a similar result root 30531 1 0 09 27 00 00 00 UWMgrServer root 30534 1 0 09 27 00 00 00 UWMgrServer run slp root 30537 1 0 09 27 00 00 00 UWM...

Страница 268: ...following query command to determine the status of Management Station root host etc init d chelsio mgmtstd status The above command will display one of the following messages UM Management Station Run...

Страница 269: ...e parameter available for the agent is the TCP listening port which can be specified with syntax similar to the example below PORT 35001 After changing the port please restart Management Agent for cha...

Страница 270: ...such as iptables it should be configured to allow traffic to the management agent TCP port configured above in the configuration section or the default port that the management agent uses 35001 Revie...

Страница 271: ...1 1 Viewing help Use the chelsio_uwcli command to view the help file as shown below root host chelsio_uwcli 6 2 Client conflict resolution The CLI and Web GUI cannot manage the same system at the same...

Страница 272: ...d chelsio mgmtstd start restart 7 1 2 Running Management Station on SLES11SP3 i On SLES11SP3 Management Station needs to be configured before running Hence execute the following in command prompt and...

Страница 273: ...sing Web Management Interface i To access the Web GUI type in the URL https management station IP address in a web browser ii The security certificate used by the web server is a generic one It may ca...

Страница 274: ...UM Chelsio T5 T4 Unified Wire for Linux Page 274 Figure 7 2 b Security Certificate prompt in Mozilla Firefox Figure 7 2 c Security Certificate prompt in Apple Safari Figure 7 2 d Security Certificate...

Страница 275: ...ization to be accessed Enter the administrator root credentials that were set up on the management station system and click on the Login button Figure 7 2 e Web GUI Login page Not performing any opera...

Страница 276: ...ation Pane with a cascading tree of links to various configuration modules for a UM Agent You can navigate between connected agents and various sections of the managed agent s interface You can view a...

Страница 277: ...e home page Bookmarks and History A history of the last 128 systems that were managed from this system by the current user will be shown here in a list Each system s management IP address TCP port and...

Страница 278: ...nected the system will appear on the left pane with different related modules on the right to view and manage Removing a system Select the system from the Bookmark list and click Delete system to remo...

Страница 279: ...agent s IP or hostname is known Select the appropriate discovery method and provide the relevant information For example to search using hostname select Hostname as the Input Type and provide the agen...

Страница 280: ...ect T3 or T4 T5 depending on the chip revision of the network card 2 Select the operating system for which drivers are to be installed in the Choose the OS Type field All the systems with the selected...

Страница 281: ...rrect user credentials for the agent in order to connect successfully After connecting to the Agent the menu bar on the left will display the connected system and its related modules If you deselect t...

Страница 282: ...any changes made to system settings like load unload drivers 7 4 5 Subscribe Email Alerts This feature is available only on the Web Management Interface Using this option you can receive email alerts...

Страница 283: ...veniently perform bulk operations like installing option ROM setting MTU and VLAN ID changing adapter and port parameters on various devices without having to access multiple modules and thus saving c...

Страница 284: ...e Boot Configuration module create a group with group type t4adapter Here is a list of available configuration modules and corresponding group type Boot Configuration t3adapter t4adapter t5adapter Net...

Страница 285: ...5 Figure 7 4 6 b Managing a group Boot Configuration Using this module you can install option ROM or erase option ROM on Chelsio network devices The Set Default Boot Settings button will reset the ada...

Страница 286: ...tion module you can set Maximum Transfer Unit MTU Virtual LAN VLAN ID and change the IP address type for the members network interfaces of the Network group MTU can be set between 1500 9000 bytes VLAN...

Страница 287: ...ion The Card Configuration module allows you to set various adapter settings including TCP Offload Offload settings are only available when using the TOE capable drivers t4_tom and toecore for T5 and...

Страница 288: ...rt Configuration In the Port Configuration module you can set various port settings like enabling Tx checksum and TCP segmentation offload setting Link speed and link duplex mode etc The settings depe...

Страница 289: ...89 Bypass Configuration Use the Bypass Configuration module to configure Chelsio s bypass adapters like B420 SR and B404 BT For more information on different bypass modes and configurational parameter...

Страница 290: ...n the tree menu on the left On adding a system this item is automatically selected and this page is displayed The system page contains generic system and support modules which are discussed below 7 5...

Страница 291: ...inux Page 291 7 5 2 Drivers Installation Using this module one can install various Chelsio drivers for different operating systems You can choose the configuration file type Linux Agents only Figure 7...

Страница 292: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 292 Figure 7 5 2 b Drivers Installation module connected to FreeBSD Agent...

Страница 293: ...installation date is shown in this module To load or unload a particular driver select the appropriate option Yes to load No to unload in the corresponding cell of the Loaded column To reload a driver...

Страница 294: ...n Chelsio adapters to troubleshoot adapter related issues Select the adapter s from the list for which you want to run the test select the operation type of test you can run more than one test at a ti...

Страница 295: ...related operations Once enabled two related modules VM Configurations and VF Configurations will be available and you can manage VMs and related settings While enabling you will have to provide the n...

Страница 296: ...uired in order to asssign VFs to VMs iii Finally access WebGUI Remove the Agent using the Remove System button and connect to it again from the Bookmarks and History module You should now be able to s...

Страница 297: ...tual machines To do so click on the machine names in the list The properties box will display the domain state of the machines selected Now click on any of the system power actions provided at the bot...

Страница 298: ...Linux Page 298 7 5 8 VF Configurations Linux The VF Configurations module lists all the VMs Virtual Functions mapped to each Virtual Machine and all the available VFs You can also add and remove VFs...

Страница 299: ...power options like start resume if VM is paused turn off restart or suspend pause a VM You can perform similar actions on multiple virtual machines To do so click on the machine names in the list The...

Страница 300: ...lected VFs to the hosts To enable SR IOV support IOMMU must be enabled To do this select Enable for IOMMU and then click Set IOMMU Reboot the host machine for changes to take effect Figure 7 5 10 a Xe...

Страница 301: ...x and FreeBSD and in the Event log in Windows This log can be obtained in this module Only 20 entries can be obtained and viewed at a time Logs can be viewed by either choosing from a list of fixed ra...

Страница 302: ...Chelsio interfaces and VLANs Figure 7 6 1 a Network Summary module 7 6 2 Chelsio card page When a Chelsio card is selected in the tree menu on the left this page is displayed It provides details of th...

Страница 303: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 303 Figure 7 6 2 a Card Summary module...

Страница 304: ...g the TOE capable drivers t3_tom and toecore for T3 adapters t4_tom and toecore for T4 and T5 adapters On changing the settings the changed settings may not reflect immediately on refreshing the data...

Страница 305: ...card are shown here For Chelsio T5 and T4 adapters only the MaxVMQueues field will be displayed On changing the settings the changed settings may not reflect immediately on refreshing the data Highlig...

Страница 306: ...re maintained on a per card basis instead of a per port basis since the card has a TCP IP offload capability The statistics are for TCP and IP protocol processing done in the card s hardware These sta...

Страница 307: ...listed in the tree menu on the left It provides details of the port and port settings It also displays any port specific statistics that the hardware provides The modules available on this page are a...

Страница 308: ...T5 T4 Unified Wire for Linux Page 308 Port settings Port settings such as MTU Link speed and others can be set in this module The settings depend on the device driver installed Figure 7 6 2 1 b Port S...

Страница 309: ...ds DNS and default gateway settings can be viewed and modified here Network adapters can also be enabled or disabled as required The modules available on this page are as below System Network configur...

Страница 310: ...ses configured on the same adapter for the same network may result in unpredictable behavior of the system s networking stack Maximum Transfer Unit MTU can be set between 1500 9000 bytes VLAN id can a...

Страница 311: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 311 Figure 7 6 3 b Managing IP aliases...

Страница 312: ...ghput Mbs Receive Transmit Bi direction in Table and Graph format for a network adapter A report for hardware statistics can be generated based on different parameters only in the Table view in the Ad...

Страница 313: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 313 Figure 7 6 3 d Network Throughput Vs Time instant Graph Figure 7 6 3 e Network Throughput Vs Time instant Table...

Страница 314: ...mote networks and the Internet can also be set here On Linux and FreeBSD only one default gateway is allowed On Windows you may set multiple default gateways Use the option to set multiple default gat...

Страница 315: ...is allowed when creating the team although both DHCP and Static IP addressing is supported for the team adapter after it is created successfully Please check with the driver documentation for the sup...

Страница 316: ...o send and packet timeout The result of the ping can be viewed by clicking on the Ping Result button Using TraceRoute one can determine the route taken by packets across an IP network Use the GetConne...

Страница 317: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 317 Figure 7 6 3 i TraceRoute Utility...

Страница 318: ...d Clicking on a bridge name will display related properties on the right If a virtual interface is attached to a particular bridge a link appears next to the bridge name Expanding the link will displa...

Страница 319: ...tual network interface is attached to a particular bridge a link appears for that bridge name Expanding the link will display the virtual network interface and expanding the link for that virtual netw...

Страница 320: ...Create Bridge section All other parameters are optional If not specified the bridge will be created with default values Except STP and Priority you can change all of the other parameters in the Bridg...

Страница 321: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 321 Figure 7 6 3 1 c Creating Bridge Figure 7 6 3 1 d Adding Bridge to VM Figure 7 6 3 1 e Adding interfafe to Bridge...

Страница 322: ...e MTU and Name Description fields are optional The bridge name will be generated automatically by the operating system Once created it will appear in the Xen Bridge Configuration module You will have...

Страница 323: ...you will have to detach the virtual machine first To do so click on the virtual machine and click Detach Similarly detach all the virtual machines and then use the Delete Switch to delete the virtual...

Страница 324: ...rnal Network guest operating systems can only communicate with guest operating systems in the same private network and not with the host The host operating system cannot access the virtual machines on...

Страница 325: ...P iWARP Settings On Linux Agents iWARP parameter settings for Chelsio s RDMA capable NICs can be set using this module These settings can be set only when iWARP driver iw_cxgb4 for T4 and T5 iw_cxgb3...

Страница 326: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 326 Figure 7 6 4 a iWARP settings for T4 CNA for FreeBSD Agent...

Страница 327: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 327 Figure 7 6 4 b iWARP settings for T4 CNA for Linux Agent...

Страница 328: ...rocess Statistics Attributes The WD UDP module lists the process ids pid of UDP traffic running on the agent and displays the corresponding statistics and attributes Figure 7 6 5 a WD UDP Process Stat...

Страница 329: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 329 Figure 7 6 5 b WD UDP Process Attributes...

Страница 330: ...The WD TOE module lists the process ids pid of TOE traffic running on the agent and displays the corresponding statistics and attributes Figure 7 6 5 c WD TOE Process Statistics Figure 7 6 5 d WD TOE...

Страница 331: ...itiators available on the operating system can be managed from this page FCoE support is extended on Linux Windows and XenServer platforms Please refer to Platform Driver matrix section on the list of...

Страница 332: ...ry Details pertaining to the card used such as model firmware hardware version etc are provided in this module Figure 7 7 1 1 a FCoE Card Summary module FCoE Attributes Information such as Interrupt m...

Страница 333: ...orms FIP and FCoE device discovery This page lets the user to retrieve all the FCoE specific port information and also extend NPIV management support It contains the following sections FCoE Port Summa...

Страница 334: ...s fabric information such as fabric name VLAN on which the FCoE service is currently running and the number of SCSI targets that are being discovered by this port Port speed being mentioned in this se...

Страница 335: ...create a virtual port select the option Create and the GUI allows two ways of creating a virtual port i Manual Where the user can manually create a virtual port by providing a value to the WWPN and WW...

Страница 336: ...ctive N_port virtual ports The GUI conveys the same via a tree structure so that the end user knows the initiator target mapping FCoE Remote Port Attributes This module provides details about the disc...

Страница 337: ...his module provides the LUN information such as size of the LUN SCSI address and LUN address For Linux the SCSI address is displayed in H C T L Host Channel Target Lun format and for Windows it is dis...

Страница 338: ...ecially where virtual SANs are called for The virtual ports appear under their respective N_Ports after creation and the GUI conveys it via a tree structure so that the end user knows the N_port VN_Po...

Страница 339: ...contains fabric information such as fabric name VLAN on which the FCoE service is currently running and the number of SCSI targets that are being discovered by this virtual port Port speed being menti...

Страница 340: ...ntify the discovered target accordingly Figure 7 7 1 4 c FCoE Remort Port Attributes module FCoE Remote Port Lun Details This module provides LUN information for remote port associate with virtual por...

Страница 341: ...pters configured in the initiator stack The node can be enabled or disabled Chelsio node cannot be disabled in Windows and its properties can be viewed and edited in this module In the Chelsio Linux s...

Страница 342: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 342 Figure 7 7 2 b Microsoft iSCSI initiator...

Страница 343: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 343 Figure 7 7 2 c Chelsio iSCSI initiator...

Страница 344: ...port The discovery operation also fetches all the other Portals that the target s are listening on The discovered target can be deleted if required Please note that all the Portals that the target se...

Страница 345: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 345 Figure 7 7 2 e Discover targets module...

Страница 346: ...ion can be added or deleted For the Microsoft iSCSI initiator or the Open iSCSI initiator you may specify the authentication details and digest settings while logging in For Chelsio Linux initiator th...

Страница 347: ...er related details are provided in this module Select the Chelsio adapter for which you want to view properties from the Select a T4 Card drop down list and the module will expand to display related p...

Страница 348: ...select the port for which you want set any of the aforementioned properties MTU can be set between 1500 9000 bytes VLAN id can be set within the range 0 4094 enter 0 to disable it The IP type can be I...

Страница 349: ...49 FO iSCSI Initiator Properties In the FO iSCSI Initiator Properties module you can configure FO iSCSI Initiator by setting different properties like enabling disabling CHAP authentication setting He...

Страница 350: ...iSCSI Initiator service maintains multiple instances of a target depending on the discovery method In this module you can set upto 8 instances Configurable parameters include initiator node name IQN...

Страница 351: ...Chelsio adapter and initiator instance using which you want to discover targets Next provide the source initiator and destination target IP Finally click Discover After successful discovery all the d...

Страница 352: ...dapter initiator instance Target Name Source Initiator IP Destination Target IP and Destination Port are mandatory After providing values for these fields click Login By default no authentication mech...

Страница 353: ...login details of the established iSCSI session will be displayed under the Established sessions section Select the Adapter and session id Details of the selected session will be displayed To end the...

Страница 354: ...s also available The modules available on this page are as below Target Stack Globals This module displays various global properties of a currently connected iSCSI target Authentication priority betwe...

Страница 355: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 355 Figure 7 7 4 b Target properties module...

Страница 356: ...sio T5 T4 Unified Wire for Linux Page 356 Session details Details including Session ID Initiator IQN and Connections List of all discovered and currently connected iSCSI targets are listed here Figure...

Страница 357: ...Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 357 New Target Creation New iSCSI target can be created here by specifying the Target IQN and Target Alias name Figure 7 7 4 d New Target Crea...

Страница 358: ...us Logical Units created in an iSCSI Target can be managed here The modules available on this page are as below View Edit iSCSI Target LUNs This module displays various Logical Units created in an iSC...

Страница 359: ...UNs can be added here by providing various parameters like Target Name Target Device and RAM Disk Size etc RW Read Write and RO Read Only are the two kinds of permissions that can be set If Ram Disk i...

Страница 360: ...viewed and added here The modules available on this page are as below View Edit iSCSI Target Portals Portal List on the left displays details of the portal group on which an iSCSI target is listening...

Страница 361: ...anager UM Chelsio T5 T4 Unified Wire for Linux Page 361 Add Portal New Portals can be added here by choosing the specific target and Portal IP address The Port number should be 3260 Figure 7 7 6 b Add...

Страница 362: ...figured for currently connected iSCSI Targets can be managed here The modules available on this page are as below View Edit iSCSI Target ACLs This module displays details for all the ACLs configured f...

Страница 363: ...ied Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 363 Add ACL New ACLs can be configured by specifying Target name initiator IQN name IP address and permission type Figure 7 7 7 b Adding n...

Страница 364: ...nly when offload driver t3_tom is not loaded This module lists various parameters which can be set while determining filtering options for a system IP You can set the maximum number of filters and als...

Страница 365: ...nation You can create filter rules for any combination in the list However filter rule created only for the Active Combination will apply To create a new rule select the adapter type T5 or T4 in the S...

Страница 366: ...presence of offload driver t3_tom for T3 adapters t4_tom for T5 and T4 adapters Traffic Management configuration The Chelsio Card section on the left displays all the cards available in the server and...

Страница 367: ...odule displays the current T5 T4 configuration tuning option selected You can also change the tuning option by selecting the config file for each option located in ChelsioUwire x xx x x src network fi...

Страница 368: ...e module T5 T4 Boot Option ROM management This module allows managing the PXE and FCoE boot capability for Chelsio T5 and T4 adapters The Option ROM PXE and FCoE may be installed to or erased from the...

Страница 369: ...on target will list assigned LUNs on the right Select a LUN from the list to view details Show WWPN parameter will display the WWPNs of all the ports There are four configurable parameters available...

Страница 370: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 370 Figure 7 8 3 c PXE Boot configuration for T4 CNAs...

Страница 371: ...nified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 371 Figure 7 8 3 d FCoE Boot configuration for T4 CNAs Function parameter Figure 7 8 3 e FCoE Boot configuration for T4 CNAs Boot param...

Страница 372: ...ied Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 372 Figure 7 8 3 f FCoE Boot configuration for T4 CNAs Show WWPN parameter Figure 7 8 3 g iSCSI Boot configuration for T4 CNAs Function pa...

Страница 373: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 373 Figure 7 8 3 h iSCSI Boot configuration for T4 CNAs Initiator parameter...

Страница 374: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 374 Figure 7 8 3 i iSCSI Boot configuration for T4 CNAs Network parameter...

Страница 375: ...ver etc There are two modules available Bypass Configuration and Redirect Configuration Bypass Configuration In the Bypass Configuration module you can view the status and start stop the BA server acc...

Страница 376: ...p rules into tables You can save the currently configured tables and rules for a bypass adapter into a shell script using the Download Configuration button The Table Configuration tab displays BA serv...

Страница 377: ...ton to add a new rule by specifying the rule id in the INDEX field and providing the required parameters Finally click Save Changes To edit an existing rule select the corresponding checkbox change th...

Страница 378: ...XX Unified Wire Manager UM Chelsio T5 T4 Unified Wire for Linux Page 378 Figure 7 8 4 c Redirect Configuration module Rules configuration tab...

Страница 379: ...s to Tx Scheduler classes 7 8 5 a Egress Queue Map module Egress Packet Scheduler Using this module you can configure different scheduler hierarchy levels i e Class Rate Limiting Class Weighted Round...

Страница 380: ...gmt agent Now execute the following command with the result from the above query to uninstall Management Agent E g for RHEL 6 3 root host rpm e chelsio uwire_mgmt agent rhel6u3 2 2 xyz x86_64 8 2 Unin...

Страница 381: ...he following query command to determine the name of the Management Station RPM root host rpm qa grep chelsio uwire_mgmt station 2 Now execute the following command with the result from the above query...

Страница 382: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 382 XXI Unified Boot...

Страница 383: ...SI SAN boot This section of the guide also describes the use and configuration of Chelsio s DUD for OS installations via PXE server on FC FCoE LUN and iSCSI LUN This solution can be used for installin...

Страница 384: ...a DCS 7124S F Mellanox SX_PPC_M460EX Other platforms switches have not been tested and are not guaranteed to work 1 1 3 Supported Adapters Following are the currently shipping Chelsio Adapters that ar...

Страница 385: ...he list of Drivers Software and supported Linux distributions Linux Distribution Driver Software DUDs RHEL 7 2 3 10 0 327 el7 PXE RHEL 7 1 3 10 0 229 el7 PXE RHEL 6 7 2 6 32 573 el6 PXE RHEL 6 6 2 6 3...

Страница 386: ...e necessary files Follow the steps below to prepare the drive i Create a DOS bootable USB flash drive Click here for instructions ii Create a directory CHELSIO on the USB flash drive iii If you haven...

Страница 387: ...stem having Chelsio CNA to boot in Legacy mode ii Once the system boots from the USB flash drive change your working directory to CHELSIO directory C cd CHELSIO iii Run the following command to list a...

Страница 388: ...case v Delete any previous firmware using the following command C CHELSIO cfut4 d idx xh xf vi Delete any previous Option ROM settings C CHELSIO cfut4 d idx xc vii Run the following command to flash t...

Страница 389: ...Flash the unified option ROM onto the Chelsio CNA using the following command C CHELSIO cfut4 d idx ub cubt4 bin Here cubt4 bin is the unified option ROM image file present in the CHELSIO directory ix...

Страница 390: ...T4 Unified Wire for Linux Page 390 x Reboot the system for changes to take effect 2 3 uEFI i In BIOS configure the system having Chelsio CNA to boot in uEFI mode For Supermicro systems enable Network...

Страница 391: ...i Boot to EFI Shell iii Issue command drivers to determine if Chelsio uEFI driver is loaded If the driver is loaded as shown in the image below continue to step iv If the driver is not loaded load the...

Страница 392: ...setup v Chelsio HII should be listed as Chelsio T4 T5 Highlight it and press Enter vi Highlight the Chelsio adapter to be configured and press Enter If Chelsio T4 T5 is not listed please ensure that C...

Страница 393: ...393 vii Highlight Flash Utility and press Enter viii Erase or update firmware using the methods explained below Erase existing firmware a Select Erase as Flash Operation b Select FW File as Flash Fil...

Страница 394: ...FW File as Flash File Type c Enter full path to the firmware file for Enter File Name For e g CHELSIO t5fw 1 13 32 0 bin d Press Enter e Select Update Erase f Press Y to confirm g Reboot system Simil...

Страница 395: ...ng pxeboot html http www howtoforge com ubuntu_pxe_install_server PXE server configuration steps for Windows can be found on following links http technet microsoft com en us library cc771670 28WS 10 2...

Страница 396: ...oot i After configuring the PXE server make sure the PXE server works Then reboot the client machine ii Press Alt C when the message Chelsio Unified Boot BIOS vX X X XX Copyright C 2003 2015 Chelsio C...

Страница 397: ...for Linux Page 397 v Enable the Adapter BIOS using arrow keys if not already enabled Hit ENTER vi Choose PXE from the list to configure Hit Enter Use the default values for Boot Mode EDD and EBDA Rel...

Страница 398: ...oot Chelsio T5 T4 Unified Wire for Linux Page 398 vii Use the arrow keys to highlight the appropriate function among the supported NIC functions and hit Enter to select viii Enable NIC function bios i...

Страница 399: ...NIC Func 00 will enable port 0 for PXE enabling NIC Func 01 will enable port 1 and so on for NIC function Please refer the table below NIC Function enabled Ports enabled NIC Func00 00 NIC Func01 01 N...

Страница 400: ...4 Unified Wire for Linux Page 400 xiii In the system setup choose any of the Chelsio PXE devices as the first boot device xiv Reboot DO NOT PRESS ALT S to skip Chelsio option ROM during POST xv Hit F1...

Страница 401: ...m and go into the BIOS setup ii Chelsio HII should be listed as Chelsio T4 T5 Highlight it and press Enter If Chelsio T4 T5 is not listed please ensure that Chelsio uEFI driver is loaded correctly as...

Страница 402: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 402 iii Select the Chelsio adapter to be configured and press Enter iv Select Configuration Utility and press Enter...

Страница 403: ...Unified Wire for Linux Page 403 v Enable adapter BIOS if not already enabled vi Select Chelsio Protocol Selection and press Enter It is highly recommended that you use the Save Changes option every t...

Страница 404: ...commended to enable only those functions and ports which are going to be used Please note that enabling PXE Function 0 will enable port 0 for PXE enabling PXE Function 1 will enable port 1 and so on f...

Страница 405: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 405 ix Select Save Changes and press Enter...

Страница 406: ...Unified Wire for Linux Page 406 x Reboot the system and choose any of the available Chelsio PXE devices for PXE boot xi Reboot and hit F12 key when prompted to start PXE boot xii Chelsio option ROM wi...

Страница 407: ...irmware and option ROM 5 1 Legacy FCoE boot i Reboot the system ii Press Alt C when the message Chelsio Unified Boot BIOS vX X X XX Copyright C 2003 2015 Chelsio Communications Press Alt C to Configur...

Страница 408: ...d Wire for Linux Page 408 v Enable the Adapter BIOS if not already enabled Hit ENTER vi Choose FCoE from the list to configure and hit Enter Use the default values for Boot Mode EDD and EBDA Relocatio...

Страница 409: ...I Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 409 vii Choose the first option Configure function parameters from the list of parameter type and hit Enter viii Enable FCoE BIOS if not alread...

Страница 410: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 410 ix Choose the order of the ports to discover FCoE targets x Set discovery timeout to a suitable value Recommended value is 30...

Страница 411: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 411 xi Hit F10 or Esc and then Y to save the configuration xii Choose Configure boot parameters...

Страница 412: ...e 412 xiii Select the first boot device and hit Enter to discover FC FCoE targets connected to the switch Wait till all reachable targets are discovered xiv List of discovered targets will be displaye...

Страница 413: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 413 xv From the list of LUNs displayed for the selected target choose one on which operating system has to be installed Hit Enter...

Страница 414: ...Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 414 xvi Hit F10 or Esc and then Y to save the configuration xvii Reboot the machine xviii During POST allow the Chelsio option ROM to discover F...

Страница 415: ...ot Chelsio T5 T4 Unified Wire for Linux Page 415 xix Enter BIOS setup and choose FCoE disk discovered via Chelsio adapter as the first boot device xx Reboot and boot from the FCoE disk or install the...

Страница 416: ...etup ii Select Chelsio T4 T5 and press Enter Only uEFI v2 1 and v2 3 1 supported Any other uEFI version is NOT SUPPORTED and may render your system unusable Important If Chelsio T4 T5 is not listed pl...

Страница 417: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 417 iii Select the Chelsio adapter to be configured and press Enter iv Select Configuration Utility and press Enter...

Страница 418: ...Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 418 v Enable adapter BIOS if not already enabled It is highly recommended that you use the Save Changes option every time a parameter option is c...

Страница 419: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 419 vi Select Chelsio Protocol Selection and press Enter vii Select FCoE and press Enter...

Страница 420: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 420 viii Under Function Parameters enable FCoE BIOS if not already enabled...

Страница 421: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 421 ix Set discovery timeout to a suitable value Recommended value is 30...

Страница 422: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 422 x Choose the order of the ports to discover FCoE targets...

Страница 423: ...423 xi Under the first boot device select Discover Target and press Enter to discover FC FCoE targets connected to the switch Wait till all reachable targets are discovered xii List of discovered targ...

Страница 424: ...o T5 T4 Unified Wire for Linux Page 424 xiii List of LUNs for the selected target will be displayed Highlight a LUN to select it and hit Enter xiv Select Save Changes and press Enter xv Reboot the sys...

Страница 425: ...ed Wire for Linux Page 425 xvi The discovered LUN should appear in the Boot Configuration section and system BIOS section xvii Select the LUN as the first boot device and exit from BIOS xviii Either b...

Страница 426: ...irmware and option ROM 6 1 Legacy iSCSI boot i Reboot the system ii Press Alt C when the message Chelsio Unified Boot BIOS vX X X XX Copyright C 2003 2015 Chelsio Communications Press Alt C to Configu...

Страница 427: ...Wire for Linux Page 427 v Enable the Adapter BIOS if not already enabled Hit Enter vi Choose iSCSI from the list to configure and hit Enter Use the default values for Boot Mode EDD and EBDA Relocatio...

Страница 428: ...tion Configure Function Parameters from the list of parameter type and hit Enter viii Enable iSCSI BIOS if not already enabled iBFT iSCSI Boot Firmware Table will be selected by default You can also c...

Страница 429: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 429 ix Choose the order of the ports to discover iSCSI targets x Set discovery timeout to a suitable value Recommended value is 30...

Страница 430: ...XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 430 xi Hit Esc and then Y to save the configuration xii Go back and choose Configure Initiator Parameters to configure initiator related pro...

Страница 431: ...nitiator properties like IQN Header Digest Data Digest etc will be displayed Change the values appropriately or continue with the default values Hit F10 to save xiv CHAP authentication is disabled by...

Страница 432: ...ENABLED in the CHAP Policy field Next choose either one way or mutual as the authentication method Finally provide Initiator and Target CHAP credentials according to the authentication method selected...

Страница 433: ...T4 Unified Wire for Linux Page 433 xvii Select the port using which you want to connect to the target Hit Enter xviii Select Yes in the Enable DHCP field to configure port using DHCP or No to manually...

Страница 434: ...nfigure Target Parameters to configure iSCSI target related properties xx If you want to discover target using DHCP select Yes in the Discover Boot Target via DHCP field To discover target via static...

Страница 435: ...XI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 435 xxi Go back and choose Discover iSCSI Target s to connect to a target xxii Select the portal group on which iSCSI service is provided by t...

Страница 436: ...for Linux Page 436 xxiii A list of available targets will be displayed Select the target you wish to connect to and hit Enter xxiv A list of LUNs configured on the selected target will be displayed S...

Страница 437: ...XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 437 xxv Hit Esc and then Y to save the configuration xxvi Reboot the machine xxvii During POST allow the Chelsio option ROM to discover iSCSI...

Страница 438: ...o T5 T4 Unified Wire for Linux Page 438 xxviii Enter BIOS setup and choose iSCSI target LUN discovered via Chelsio adapter as the first boot device xxix Reboot and boot from the iSCSI Target LUN or in...

Страница 439: ...i Reboot the system and go into BIOS setup ii Select Chelsio T4 T5 and press Enter If Chelsio T4 T5 is not listed please ensure that Chelsio uEFI driver is loaded correctly as mentioned here in the Fl...

Страница 440: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 440 iii Select the Chelsio adapter to be configured and press Enter iv Select Configuration Utility and press Enter...

Страница 441: ...Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 441 v Enable adapter BIOS if not already enabled It is highly recommended that you use the Save Changes option every time a parameter option is c...

Страница 442: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 442 vi Select Chelsio Protocol Selection and press Enter vii Select iSCSI and press Enter...

Страница 443: ...r XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 443 viii Under Function Parameters enable iSCSI BIOS if not already enabled ix Set discovery timeout to a suitable value Recommended value...

Страница 444: ...Linux Page 444 x Choose the order of the ports to discover iSCSI targets xi Under Initiator Parameters iSCSI Initiaitor properties like IQN Header Digest Data Digest etc will be displayed Change the v...

Страница 445: ...i Under the first port select Enable DHCP field hit Enter and select Enabled This will configure port using DHCP Select Disabled to manually configure the port xiii Under Target Parameters select Enab...

Страница 446: ...age 446 To discover target via static IP select Disabled and provide the target IP xiv CHAP authentication is disabled by default To enable and configure highlight CHAP Policy and hit Enter Select the...

Страница 447: ...re for Linux Page 447 xv Provide Initiator and Target CHAP credentials according to the CHAP policy selected xvi Select Discover Target and press Enter to discover iSCSI targets connected to the switc...

Страница 448: ...for Linux Page 448 xvii A list of available targets will be displayed Select the target you wish to connect to and hit Enter xviii A list of LUNs configured on the selected target will be displayed S...

Страница 449: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 449 xix Select Save Changes and press Enter xix Reboot the system for changes to take effect...

Страница 450: ...Unified Wire for Linux Page 450 xx The discovered LUN should appear in the Boot Configuration section and system BIOS xxi Select the LUN as the first boot device and exit from BIOS xxii Either boot f...

Страница 451: ...ChelsioUwire x xx x x tar gz iii Change your current working directory to LinuxDUD directory root host cd ChelsioUwire x xx x x Uboot LinuxDUD iv Insert a blank formatted USB flash drive v Depending...

Страница 452: ...USB drive root host mkfs vfat dev sda1 v Depending on the distribution to be installed copy the corresponding image file to the USB stick For example execute the following command for SLES11sp3 root h...

Страница 453: ...se Network Boot PXE Boot media to install the OS and provide the Driver Update Disk as per the detailed instructions for each OS The DUD supports installation of Linux distributions using Chelsio adap...

Страница 454: ...The dd option specifies that you will be providing a Driver Update Disk during the installation ii You will be asked to select the Driver Update Disk device from a list USB drives usually show up as...

Страница 455: ...x or enter C to start the loading process Hit Enter The selected driver s will now be loaded vi The Driver disk prompt will be displayed again Follow the same procedure mentioned above to select any o...

Страница 456: ...hat the USB drive with DUD image is inserted Press Tab and then type dd at the boot prompt for the installation media The dd option specifies that you will be providing a Driver Update Disk during the...

Страница 457: ...e would assume the first drive letter a Hence the drive name would be sda You can view the messages from the Linux kernel and drivers to determine the name of the USB drive by pressing Alt F3 or Alt F...

Страница 458: ...helsio T5 T4 Unified Wire for Linux Page 458 v The installer will ask if you wish to load more drivers Choose Yes to load if you have any other drivers to load Otherwise choose No vi Select the requir...

Страница 459: ...Chelsio T5 T4 Unified Wire for Linux Page 459 vii Select the type of keyboard you have from the list viii In this step you can choose the source which contains the OS installation ISO image In this c...

Страница 460: ...o detwork devices will be displayed Select the appropriate Chelsio NIC interface to proceed with installation x Here you can specify if you want to configure your network interfaces using DHCP or manu...

Страница 461: ...on Then the graphical Installation screens for RHEL will appear Proceed with the installation as usual 8 1 3 SLES11 SPx SLES12 installation i In case of SLES11 SPx PXE FCoE and iSCSI and SLES12 FCoE p...

Страница 462: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 462 iii Select Start Installation and then Start Installation or Update...

Страница 463: ...Operating System v Select the desired Network protocol from the list presented vi Select the appropriate Chelsio interface from the list to proceed with installation You can view the messages from th...

Страница 464: ...f you are installing using CD DVD please make sure that the USB drive with DUD image is inserted Also change the boot priority to boot from CD DVD in the BIOS setup i Insert the OS installation disc i...

Страница 465: ...ng Chelsio DUD PXE boot Click here for RHEL 7 x Click here for RHEL6 x Click here for SLES11 SPx SLES12 section to load Chelsio Driver Update Disk After successfully loading Chelsio DUD follow the pro...

Страница 466: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 466 ii Click INSTALLATION DESTINATION under SYSTEM...

Страница 467: ...Page 467 iii The discovered FC FCoE LUNs will appear as local storage in the Local Standard Disks section Select the LUN which was saved as boot device in system BIOS Make sure the same LUN discovered...

Страница 468: ...Under Other Storage Options you can either chose to configure partition automatically or manually Select the appropriate option and click Done Then proceed with the installation as usual 8 2 2 RHEL 6...

Страница 469: ...pecialized Storage Devices radio button and click Next iii Select the FC FCoE LUN which was saved as boot device in system BIOS and click Next Then proceed with the installation as usual Make sure the...

Страница 470: ...I Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 470 8 2 3 SLES11 SPx Installation i Choose installation language and Keyboard layout type Select the checkbox I Agree to the License terms and...

Страница 471: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 471 ii Select New Installation to perform a fresh installation and click Next...

Страница 472: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 472 iii Choose from the available base scenarios and click Next...

Страница 473: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 473 iv Configure Clock and Time Zone settings Click Next...

Страница 474: ...inux Page 474 v The discovered FC FCoE LUNs will appear in the Preparing Hard Disk screen Select the LUN which was saved as boot device in system BIOS Click Next Make sure the same LUN discovered at t...

Страница 475: ...summary of user selected and YaST suggested options for the installation You can review and modify them if required Basic settings can be changed in the Overview tab and advanced settings can be chang...

Страница 476: ...lsio T5 T4 Unified Wire for Linux Page 476 vii The Expert Partitioner screen displays the partition setup suggested by the installer Click on the device selected in step v and click Accept viii Procee...

Страница 477: ...stallation i Choose installation language and keyboard layout type Select the checkbox I Agree to the License terms and click Next ii During system probe the YaST installer will detect Chelsio FCoE dr...

Страница 478: ...perating system and technical support you will need to register your system Enter the registration or evaluation code for your copy of SLES12 and email id associated with your Suse Customer Care SCC a...

Страница 479: ...e 479 iv The next screen will display a list of add ons and extensions available for SLES12 To install select the checkbox I would like to install an additional Add On Product then select the radio bu...

Страница 480: ...ggested Partitioning screen YaST generated partition setup will be displayed To change the suggested settings click Edit Proposal Settings To select the disk on which to apply the proposed settings cl...

Страница 481: ...4 Unified Wire for Linux Page 481 vi Click Create Partition Setup and select the LUN which was saved as boot device in system BIOS Click Next Make sure the same LUN discovered at the Option ROM stage...

Страница 482: ...Linux Page 482 vii To use the entire LUN for installation click User Entire Hard Disk Please note that this will delete all the existing partitions To install operating system on an existing partition...

Страница 483: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 483 viii The selected LUN should now appear in the Suggested Partitioning screen Click Next ix Proceed with installation as usual...

Страница 484: ...m option if not already selected iii Type e and then dd at the boot prompt for RHEL 7 For RHEL 6 and SLES distributions press Tab and then dd iv Load Chelsio Driver Update Disk depending on the Linux...

Страница 485: ...e for Linux Page 485 After successfully loading Chelsio DUD follow the procedure mentioned below to continue installation based on the distribution 8 3 1 RHEL 7 x i On the installer welcome screen cho...

Страница 486: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 486 ii Click Installation Destination under SYSTEM...

Страница 487: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 487 iii Click Add a disk...

Страница 488: ...Chelsio T5 T4 Unified Wire for Linux Page 488 iv The discovered iSCSI LUNs will appear in the Search tab Select it and click Done Make sure the same LUN discovered at the Option ROM stage is selected...

Страница 489: ...489 v Under Other Storage Options you can either chose to configure partition automatically or manually Select the appropriate option and click Done Then proceed with the installation as usual 8 3 2...

Страница 490: ...ces radio button and click Next iii The discovered LUNs will appear in the Basic Devices tab Select the LUN which was saved as boot device in system BIOS and click Next iv Proceed with the installatio...

Страница 491: ...I Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 491 8 3 3 SLES11 SPx installation i Choose installation language and Keyboard layout type Select the checkbox I Agree to the License terms and...

Страница 492: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 492 ii Click Configure iSCSI Disks in the Disk Activation screen...

Страница 493: ...er XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 493 iii The discovered LUNs will appear in the Connected Targets tab Select the LUN which was saved as boot device in system BIOS and clic...

Страница 494: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 494 iv Select New Installation to perform a fresh installation and click Next...

Страница 495: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 495 v Configure Clock and Time Zone settings Click Next...

Страница 496: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 496 vi Choose from the available server base scenarios and click Next...

Страница 497: ...ected and YaST suggested options for the installation You can review and modify them if required Basic settings can be changed in the Overview tab and advanced settings can be changed in the Expert ta...

Страница 498: ...XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 498 8 3 4 SLES12 Installation i Choose installation language and Keyboard layout type Select the checkbox I Agree to the License terms and cl...

Страница 499: ...Chapter XXI Unified Boot Chelsio T5 T4 Unified Wire for Linux Page 499 ii Click Configure iSCSI Disks in the Disk Activation screen...

Страница 500: ...i The discovered LUNs will appear in the Connected Targets tab Select the LUN which was saved as boot device in system BIOS and click OK iv Proceed with the installation as usual Make sure the same LU...

Страница 501: ...Chapter XXII Lustre File System Chelsio T5 T4 Unified Wire for Linux Page 501 XXII Lustre File System...

Страница 502: ...uting clusters Lustre Clusters Lustre clusters contain three kinds of systems File system clients which can be used to access the file system Object storage servers OSS which provide file I O service...

Страница 503: ...LL CR 1 2 Software Requirements 1 2 1 Lustre Requirements Chelsio Unified Wire currently supports Lustre 2 6 0 1 2 2 Linux Requirements Currently Lustre File System is supported on following distribut...

Страница 504: ...iv Load the Network and iWARP driver as per requirement To load Network driver in NIC mode root host modprobe cxgb4 To load Network driver in TOE mode root host modprobe cxgb4 root host modprobe t4_to...

Страница 505: ...fsname fsname mgs mdt block_device ix Mount the file system created in the previous step Run the following command on the MDS node root host mount t lustre block_device mount_point x Create the OST on...

Страница 506: ...Chapter XXIII Appendix Chelsio T5 T4 Unified Wire for Linux Page 506 XXIII Appendix A...

Страница 507: ...as ping If you get a return value of 0 when doing a cat proc sys net ipv4 icmp_echo_ignore_all on the remote host that means it is configured to reply to incoming pings Change ipv4 to ipv6 in the path...

Страница 508: ...k mode Binding VFC to MAC If you are binding the VFC to MAC address in case of Cisco Nexus switch then make sure you make the Ethernet interface part of both Ethernet VLAN and FCoE VLAN Cisco nexus sw...

Страница 509: ...f or ii make available the Software or any portion thereof in any form on the Internet The Software contains trade secrets and in order to protect them you may not decompile reverse engineer disassemb...

Страница 510: ...R LOSS OF ANTICIPATED PROFITS EVEN IF CHELSIO HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES IN NO EVENT SHALL CHELSIO S LIABILITY ARISING OUT OF OR RELATED TO THE LICENSE OR USE OF THE SOFTWARE...

Страница 511: ...rnia law except as to copyright matters which are covered by Federal law You hereby irrevocably submit to the personal jurisdiction of and irrevocably waive objection to the laying of venue including...

Отзывы:

Нет отзывов

Бренды по названию

0 1 2 3 4 5 6 7 8 9 A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Популярные бренды

Загрузить еще бренды