Oracle SuperCluster T5-8, Owner'S Manual

Page: 36 / 356

Understanding the Hardware Components and Connections
■
PCIe slot 1
■
PCIe slot 6
■
PCIe slot 9
■
PCIe slot 14
See “Card Locations (SPARC T5-8 Servers)” on page 29 for the location of the 10-GbE
NICs.
Depending on the configuration, one or two of the ports on the 10-GbE NICs (ports 0 and 1)
will be connected to the client access network. In some configurations, both ports on the same
10-GbE NIC will be part of an IPMP group to provide redundancy and increased bandwidth. In
other configurations, one port from two separate 10-GbE NICs will be part of an IPMP group.
The number of physical connections to the 10-GbE client access network varies, depending
on the type of domains created on each SPARC T5-8 server. For more information, see
“Understanding the Software Configurations” on page 46 .
Understanding the Exadata Storage Server Physical
Connections
Each Exadata Storage Server contains three sets of physical connections:
■
“InfiniBand Private Network Physical Connections (Exadata Storage
Servers)” on page 36
■
“Oracle ILOM Management Network Physical Connections (Exadata Storage
Servers)” on page 38
■
“1-GbE Host Management Network Physical Connections (Exadata Storage
Servers)” on page 39
InfiniBand Private Network Physical Connections (Exadata Storage
Servers)
Each Exadata Storage Server contains one dual-ported Sun QDR InfiniBand PCIe Low Profile
host channel adapter (HCA). The two ports in the InfiniBand HCA are bonded together to
increase available bandwidth. When bonded, the two ports appear as a single port, with a single
IP address assigned to the two bonded ports, resulting in one IP address for InfiniBand private
network connections for each Exadata Storage Server.
The two ports in the InfiniBand HCA connects to a different leaf switch to provide redundancy
between the Exadata Storage Servers and the leaf switches. The following figures show how
36 Oracle SuperCluster T5-8 Owner's Guide • May 2016