
IPU-POD128 build and test guide
4.2.2 IPU-POD
64
network interfaces
Table 4.11: Network configuration
Port
Role
Speed
IP address
Config
from
VLAN
(see
note)
IPU-M2000: BMC
BMC only management
(future)
1GbE
10.1.1.1-16/22
Static
DHCP
14
IPU-M2000: GW
BMC+GW management
1GbE
10.1.2.1-16/22
Static
DHCP
13
Server: Port1
Mgmt IPU-M2000
1GbE
10.1.3.101/22
Local net-
plan file
13
Server: Port2
Div management iDRAC,
switches & PDUs
1GbE
10.1.6.1/22
Local net-
plan file
99
Server: iDRAC
Server BMC
1GbE
10.1.6.4-7/22
Manual
setup
99
Server: RNIC/Port0
RDMA IPU-M2000
100GbE
10.1.5.101/23
Local net-
plan file
11
Server: RNIC/Port1
RDMA NAS
100GbE
Site specific
Site spe-
cific
Site
specific
48x 1GbE + (4x 10G)
Switch management port
CLI + Switch BMC man-
agement
1GbE
10.1.6.2/22
Manual
setup
99
32x (4x 10G)
switch management port
CLI + Switch BMC man-
agement
1GbE
10.1.6.3/22
Manual
setup
99
PDU
Power dist. unit
1GbE
10.1.6.8-11
Dynamic
DHCP
99
Note:
Port based VLAN in switches (VLAN 13,14 and 99 in 1GbE switch, VLAN 11 in 100GbE switch)
4.2.3 Management switch configuration
Several VLANs need to be configured on the switches to separate traffic for the different hardware and integrate
DHCP properly on the system.
The default management switch is Arista DCS-7010T-48-F.
1) Up to 4 interfaces per rack for PDUs and switches management
2) Up to 4 interfaces per rack for server management interfaces
3) Up to 4 interfaces per rack for server facing BMCs and gateways
4) Up to 16 interfaces per rack for combined IPU-M2000 Gateway and BMC
5) Up to 16 interfaces per rack for BMC only connection (future option)
Version: latest (2021-11-25)
71