IPU-POD128 build and test guide
2.4 Switches
Each IPU-POD
64
contains two network switches serving different purposes.
2.4.1 100GE RoCE/RDMA switch (ToR switch)
The 100GbE RoCE/RDMA switch (also referred to as the ToR switch) is used by the end user’s machine learning
(ML) jobs as a data-plane, connecting the host servers running the Poplar® SDK with the IPUs running the ML
model in the IPU-M2000s. The default ToR switch is an Arista DCS-7060CX-32S-F. Contact Graphcore sales for
details of other supported switch types. This document describes the default switch (7060CX) installation only.
Other switches may have different installation requirements.
2.4.2 1GE management switch
The 1GbE management switch is used for connecting the management ports together inside the rack. The default
management switch is an Arista DCS-7010T-48-F. Contact Graphcore sales for details of other supported switch
types. This document describes the default switch (7010T) installation only. Other switches may have different
installation requirements.
2.5 Power distribution units
Two power distribution units (PDUs) are installed in each IPU-POD
64
. The default unit is an APC AP8886.
2.6 Rack
The IPU-M2000s, servers, switches, and PDUs for each of the two IPU-POD
64
racks are installed in an APC
rack. This rack has a packing system designed to safely transport and unload the rack.
It is important to follow the
carefully when packing or unpacking the rack.
2.7 Supplementary mounting components
The supplementary components listed below also need to be installed in each rack.
• Cable organizer
• Blanking panel
2.8 Cables
Each of the two IPU-POD
64
racks has three types of cabling:
1) RJ45 cables
2) OSFP cables
3) QSFP cables
There are also GW-Link cables between the two IPU-POD
64
racks.
Version: latest (2021-11-25)
6