3 – Getting Started
Complete Installation of additional IB Management Nodes
3-18
D000006-000 Rev A
Q
7.
(Host)
"Verify Hosts see each other" will verify that each host can see all the
others via queries to the Subnet Administrator and the SA replica on each host
has been fully populated.
8.
(Host)
"Verify Hosts ping via IPoIB" will verify that IPoIB is properly configured
and running on all the hosts. This is accomplished via the IB management
node pinging each host via IPoIB.
9.
(Linux)
"Refresh ssh Known Hosts" will refesh the ssh knowhosts file on the
IB management node to include the IPoIB hostnames of all the hosts
10.
(Host)
"Check MPI Performance" will do a quick check of PCI and MPI
performance.
This displays the MPI latency and bandwidth between pairs of hosts (1-2, 3-4,
5-6, etc). The results are also written to the test.res file which may be viewed
via the "View ibtest result files". Refer to the section “Interpreting the ibtest log
files” on page 5-68 for more details.
The numbers reported should be checked against the practical PCI speeds in
the Performance Impact table below. If any pairs are not in the expected
performance range, carefully examine the two hosts involved to verify that the
PCI slot used, BIOS settings and any motherboard jumpers related to devices
on PCI buses or slot speeds. Also verify HCA and riser cards are properly seated.
Table 3-1. Performance Impact
3.9
Complete Installation of additional IB Management Nodes
If the fabric is to have more than one IB Management Node, the setup of the
additional management nodes may be completed now. The previous steps will
have performed basic software installation, setup and verification on those nodes.
Now the management software itself must be installed and configured.
NOTE:
The steps below assume a symmetrical configuration where all IB
management nodes have the same connectivity and capabilities. In
assymetrical configurations where the IB management nodes are not all
connected to the same set of management networks and IB subnets, the
files copied to each management node may need to be slightly different.
For example configuration files for fabric_analysis may indicate different
port numbers, or host files used for FastFabric and MPI may need to list
different hosts. For multiple subnet configurations, refer to “Multi-Subnet
Fabrics” on page D-1.
PCI Speed
Theoretical Max
Practical Bandwidth
133
1024MB/sec
800-900 MB/sec
100
770MB/sec
600-680 MB/sec
66
512MB/sec
400-450 MB/sec
Содержание Fast Fabric
Страница 1: ...D000006 000 Rev A Page i Q S i m p l i f y Fast Fabric Users Guide...
Страница 2: ...Fast Fabric Users Guide Q Page ii D000006 000 Rev A...
Страница 38: ...3 Getting Started Upgrading IB software 3 24 D000006 000 Rev A Q...
Страница 148: ...6 MPI Sample Applications Pallas 6 6 D000006 000 Rev A Q...
Страница 159: ...B Fast Fabric Configuration Files D000006 000 Rev A B 7 Q NOTE Do not edit etc sysconfig iba iba_mon conf sample...
Страница 166: ...B Fast Fabric Configuration Files Port List Files B 14 D000006 000 Rev A Q...
Страница 168: ...C Configuration of IPoIB Name Mapping C 2 D000006 000 Rev A Q...