
3
–
InfiniBand
®
Cluster Setup and Administration
Performance Settings and Management Tips
3-38
IB0054606-02 A
rpm
(see
)
strings
(see
)
Adapter and Other Settings
The following adapter and other settings can be adjusted for better performance.
Use an IB MTU of 4096 bytes instead of 2048 bytes, if available, with
the QLE7340, and QLE7342.
4K MTU is enabled in the ib_qib driver by
default. To change this setting for the driver, see
.
Make sure that write combining is enabled.
The x86 Page Attribute Table
(PAT) mechanism that allocates Write Combining (WC) mappings for the
PIO buffers has been added and is now the default. If PAT is unavailable or
PAT initialization fails for some reason, the code will generate a message in
the log and fall back to the MTRR mechanism. See
for more information.
Check the PCIe bus width.
If slots have a smaller electrical width than
mechanical width, lower than expected performance may occur. Use this
command to check PCIe Bus width:
$
ipath_control -iv
This command also shows the link speed.
Experiment with non-default CPU affinity while running
single-process-per-node latency or bandwidth benchmarks.
Latency
may be slightly lower when using different CPUs (cores) from the default. On
some chipsets, bandwidth may be higher when run from a non-default CPU
or core. For the MPI being used, look at its documentation to see how to
force a benchmark to run with a different CPU affinity than the default. With
OFED micro benchmarks such as from the qperf or perftest suites, taskset
will work for setting CPU affinity.
NOTE
Run these tools to gather information before reporting problems and
requesting support.
NOTE
For the most current information on performance tuning refer to the
QLogic
OFED+ Host Software Release Notes
.
Summary of Contents for OFED+ Host
Page 1: ...IB0054606 02 A OFED Host Software Release 1 5 4 User Guide...
Page 14: ...xiv IB0054606 02 A OFED Host Software Release 1 5 4 User Guide...
Page 22: ...1 Introduction Interoperability 1 4 IB0054606 02 A...
Page 96: ...4 Running MPI on QLogic Adapters Debugging MPI Programs 4 24 IB0054606 02 A...
Page 140: ...6 SHMEM Description and Configuration SHMEM Benchmark Programs 6 32 IB0054606 02 A...
Page 148: ...8 Dispersive Routing 8 4 IB0054606 02 A...
Page 164: ...9 gPXE HTTP Boot Setup 9 16 IB0054606 02 A...
Page 176: ...A Benchmark Programs Benchmark 3 Messaging Rate Microbenchmarks A 12 IB0054606 02 A...
Page 202: ...B SRP Configuration OFED SRP Configuration B 26 IB0054606 02 A Notes...
Page 206: ...C Integration with a Batch Queuing System Clean up PSM Shared Memory Files C 4 IB0054606 02 A...
Page 238: ...E ULP Troubleshooting Troubleshooting SRP Issues E 20 IB0054606 02 A...
Page 242: ...F Write Combining Verify Write Combining is Working F 4 IB0054606 02 A Notes...
Page 280: ...G Commands and Files Summary of Configuration Files G 38 IB0054606 02 A...
Page 283: ......