Qlogic OFED+ Host, Software User'S Manual

Page: 142 / 284

7 – Virtual Fabric support in PSM
Virtual Fabric Support
7-2 IB0054606-02 A
Virtual Fabric Support
Virtual Fabric (vFabric) in PSM is supported with the QLogic Fabric Manager. The
latest version of the QLogic Fabric Manager contains a sample
qlogic_fm.xml
file with pre-configured vFabrics for PSM. Sixteen unique Service IDs have been
allocated for PSM enabled MPI vFabrics to ease their testing however any
Service ID can be used. Refer to the
QLogic Fabric Manager User Guide on how
to configure vFabrics.
There are two ways to use vFabric with PSM. The “legacy” method requires the
user to specify the appropriate SL and Pkey for the vFabric in question. For
complete integration with vFabrics, users can now specify a Service ID (SID) that
identifies the vFabric to be used. PSM will automatically obtain the SL and Pkey to
use for the vFabric from the QLogic Fabric Manager via path record queries.
Using SL and PKeys
SL and Pkeys can be specified natively for Open MPI. For other MPIs use the
following list of environment variables to specify the SL and Pkey. The
environment variables need to be propagated across all processes for correct
operation.
 Open MPI : Use mca parameters (
mtl_psm_ib_service_level
and
mtl_psm_ib_pkey
) to specify the pkey on the mpirun command line.
Example:
mpirun –np 2 –machinefile machinefile -mca
mtl_psm_ib_service_level SL -mca mtl_psm_ib_pkey Pkey
prog prog_args
 Other MPIs can use the following environment variables that are propagated
across all processes. This process is MPI library specific but samples on
how to do this for Open MPI and MVAPICH2 are listed in the
“Introduction”
on page 7-1 .

IPATH_SL= SL # Service Level to Use 0-15

PSM_PKEY= Pkey # Pkey to use
NOTE
This is available with Open MPI v1.3.4rc4 and above only!