D000006-000 Rev A
D-1
Appendix D
Multi-Subnet Fabrics
Fast Fabric is designed primarily to manage a single subnet fabric. However many
powerful functions of FastFabric are also available when installing and operating
multi-subnet fabrics.
When operating a multi-subnet fabric, an subnet manager (SM) is required for each
subnet. An SM may be run within switches within each subnet, or a host-based SM
may be run. A host-based SM can manage multiple subnets (assuming the host
server is connected to more than one subnet).
For multi-subnet fabrics a number of combinations are possible:
1.
All subnets are completely independent (except for any interconnecting
routers)
: If a separate Fast Fabric node is being used per subnet and servers
are not installed in more than one subnet, the individual subnets can be treated
completely separately. In this case, follow all the previous Fast Fabric
instructions for each fabric.
2.
The subnets are primarily independent
: If the only IB components common
to more than one subnet are the Fast Fabric node (and possibly SM nodes)
and no servers are installed in more than one subnet, consult the instructions
below for
Primarily Independent Subnets
.
3.
The subnets are overlapping
: If multiple IB components are common to more
than one subnet, such as Fast Fabric node(s), servers, etc., consult the
instructions below for
Overlapping Subnets
.
D.1
Primarily Independent Subnets
If the Fast Fabric node (and possible SM nodes) is the only common IB servers
between subnets, Fast Fabric may be used to assist in server installation and fabric
operation. Follow the installation instructions outlined in “Getting Started” on
page 3-1 with the following adjustments:
From “Design the Fabric” on page 3-1, design the cabling such that the Fast Fabric
node will be connected to each IB subnet it will manage. The Fast Fabric node
must also have a management network path to all the nodes in all the subnets that
it will manage. As part of the design consider where routes between subnets are
desired between IB routers, IPoIB routers, etc.
“Design the Fabric” on page 3-1 can be performed as per the instuctions. When
installing the Fabric Access Software on the IB management node, IPoIB will need
to be configured such that each IB subnet is an independent IPoIB network interface,
Summary of Contents for Fast Fabric
Page 1: ...D000006 000 Rev A Page i Q S i m p l i f y Fast Fabric Users Guide...
Page 2: ...Fast Fabric Users Guide Q Page ii D000006 000 Rev A...
Page 38: ...3 Getting Started Upgrading IB software 3 24 D000006 000 Rev A Q...
Page 148: ...6 MPI Sample Applications Pallas 6 6 D000006 000 Rev A Q...
Page 166: ...B Fast Fabric Configuration Files Port List Files B 14 D000006 000 Rev A Q...
Page 168: ...C Configuration of IPoIB Name Mapping C 2 D000006 000 Rev A Q...
