Oracle SuperCluster T5-8, Owner'S Manual

Page: 66 / 356

Understanding the Software Configurations
■
First Medium Domain: NET0-1
■
Second Medium Domain, if applicable: NET2-3
10-GbE Client Access Network
Two PCI root complex pairs, and therefore two 10-GbE NICs, are associated with the Medium
Domain on the SPARC T5-8 server in the Half Rack. One port is used on each dual-ported 10-
GbE NIC. The two ports on the two separate 10-GbE NICs would be part of one IPMP group.
The following 10-GbE NICs and ports are used for connection to the client access network for
this configuration:
■
First Medium Domain:
■
PCIe slot 1, port 0 (active)
■
PCIe slot 9, port 1 (standby)
■
Second Medium Domain, if applicable:
■
PCIe slot 6, port 0 (active)
■
PCIe slot 14, port 1 (standby)
A single data address is used to access these two physical ports. That data address allows traffic
to continue flowing to the ports in the IPMP group, even if one of the two 10-GbE NICs fail.
Note -
You can also connect just one port in each IPMP group to the 10-GbE network rather
than both ports, if you are limited in the number of 10-GbE connections that you can make to
your 10-GbE network. However, you will not have the redundancy and increased bandwidth in
this case.
InfiniBand Network
The connections to the InfiniBand network vary, depending on the type of domain:
■
Database Domain:
■
Storage private network : Connections through P1 (active) on the InfiniBand HCA
associated with the first CPU in the domain and P0 (standby) on the InfiniBand HCA
associated with the second CPU in the domain.
So, for the first Medium Domain in a Half Rack, these connections would be through
P1 on the InfiniBand HCA installed in slot 3 (active) and P0 on the InfiniBand HCA
installed in slot 11 (standby).
■
Exadata private network : Connections through P0 (active) and P1 (standby) on all
InfiniBand HCAs associated with the domain.
66 Oracle SuperCluster T5-8 Owner's Guide • May 2016