Chelsio Communications Terminator 6, Инструкция по установке и эксплуатации, Страница: 89 / 432

Chapter IV. iWARP (RDMA)
Chelsio Unified Wire for Linux 89
vi. Set IntelMPI with mpi-selector (do this on all nodes).
[root@host~]# mpi-selector --register intelmpi --source-dir
/opt/intel/impi/3.1/bin/
[root@host~]# mpi-selector --set intelmpi
vii. Edit
.bashrc
and add these lines:
export RSH=ssh
export DAPL_MAX_INLINE=64
export I_MPI_DEVICE=rdssm:chelsio
export MPIEXEC_TIMEOUT=180
export MPI_BIT_MODE=64
viii. Logout & log back in.
ix. Populate
mpd.hosts
with node names.
x. Contact Intel for obtaining their MPI with DAPL support.
xi. To run Intel MPI over RDMA interface, DAPL 2.0 should be set up as follows:
Enable the Chelsio device by adding an entry at the beginning of the /
etc/dat.conf file for
the Chelsio interface. For instance, if your Chelsio interface name is eth2, then the following
line adds a DAT version 2.0 device named
“chelsio2" for that interface:
chelsio2 u2.0 nonthreadsafe default libdaplofa.so.2 dapl.2.0 "eth2 0" ""
Open MPI (Installation and Setup)
Open MPI iWARP support is only available in Open MPI version 1.3 or greater.
Open MPI will work without any specific configuration via the openib btl. Users wishing to
performance tune the configurable options may wish to inspect the receive queue values. Those
can be found in the "Chelsio T4" section of
mca-btl-openib-device-params.ini . Follow the
steps mentioned below to install and configure Open MPI.
i. If not alreay done, install mpi-selector tool.
ii. Download the latest stable/feature version of openMPI from OpenMPI website .
•
The hosts in this file should be Chelsio interface IP addresses.
•
I_MPI_DEVICE=rdssm:chelsio
assumes you have an entry in
/etc/dat.conf
named
chelsio
.
•
MPIEXEC_TIMEOUT
value might be required to increase if heavy traffic is
going across the systems.
Note