
3
–
InfiniBand
®
Cluster Setup and Administration
QLogic Distributed Subnet Administration
IB0054606-02 A
3-17
Second, the Distributed SA handles overlaps by taking advantage of the fact that
Virtual Fabrics have unique numeric indexes. These indexes are assigned by the
QLogic Fabric Manager in the order which the Virtual Fabrics appear in the
configuration file. These indexes can be seen by using the command
iba_saquery -o vfinfo
command. The Distributed SA will always assign a
SID to the Virtual Fabric with the lowest index, as shown in
. This
ensures that all copies of the Distributed SA in the IB fabric will make the same
decisions about assigning SIDs. However, it also means that the behavior of your
fabric can be affected by the order you configured the virtual fabrics.
Figure 3-8. Virtual Fabrics with Unique Numeric Indexes
, the Distributed SA assigns all overlapping SIDs to the “PSM_MPI”
fabric because it has the lowest Index
Distributed SA Configuration File
The Distributed SA configuration file is
/etc/sysconfig/iba/qlogic_sa.conf
. It has several settings, but normally
administrators will only need to deal with two or three of them.
NOTE
The Distributed SA makes these assignments not because they are right,
but because they allow the fabric to work even though there are
configuration ambiguities. The correct solution in these cases is to redefine
the fabric so that no node will ever be a member of two Virtual Fabrics that
service the same SID.
9LUWXDO)DEULF³'HIDXOW´
3NH\[IIII
6,'5DQJH[[IIIIIIIIIIIIIIII
,QILQLEDQG)DEULF
9LUWXDO)DEULF³'HIDXOW´
3NH\[IIII
6,'5DQJH[[I
6,'5DQJH[
[I
'LVWULEXWHG6$
9LUWXDO)DEULF³'HIDXOW´3NH\[IIII
6,'5DQJH[[IIIIIIIIIIIIIIII
9LUWXDO)DEULF³360B03,´
,'3NH\[
6,'5DQJH[[I
6,'5DQJH
[
[I
9LUWXDO)DEULF³5HVHUYHG´
,'3NH\[
6,'5DQJH[[I
9LUWXDO)DEULF³360B03,´
3NH\[
6,'5DQJH[[I
6,'5DQJH[
[I
Summary of Contents for OFED+ Host
Page 1: ...IB0054606 02 A OFED Host Software Release 1 5 4 User Guide...
Page 14: ...xiv IB0054606 02 A OFED Host Software Release 1 5 4 User Guide...
Page 22: ...1 Introduction Interoperability 1 4 IB0054606 02 A...
Page 96: ...4 Running MPI on QLogic Adapters Debugging MPI Programs 4 24 IB0054606 02 A...
Page 140: ...6 SHMEM Description and Configuration SHMEM Benchmark Programs 6 32 IB0054606 02 A...
Page 148: ...8 Dispersive Routing 8 4 IB0054606 02 A...
Page 164: ...9 gPXE HTTP Boot Setup 9 16 IB0054606 02 A...
Page 176: ...A Benchmark Programs Benchmark 3 Messaging Rate Microbenchmarks A 12 IB0054606 02 A...
Page 202: ...B SRP Configuration OFED SRP Configuration B 26 IB0054606 02 A Notes...
Page 206: ...C Integration with a Batch Queuing System Clean up PSM Shared Memory Files C 4 IB0054606 02 A...
Page 238: ...E ULP Troubleshooting Troubleshooting SRP Issues E 20 IB0054606 02 A...
Page 242: ...F Write Combining Verify Write Combining is Working F 4 IB0054606 02 A Notes...
Page 280: ...G Commands and Files Summary of Configuration Files G 38 IB0054606 02 A...
Page 283: ......