Chapter 1. Understanding the IBM Power Systems 775 Cluster
19
Figure 1-10 Hub module diagram
EI-
3 PHYs
Torrent
Diff PHYs
L loc
al
H
UB
To HU
B C
opper
Boa
rd Wiri
ng
L remote
4 Drawer Interconnect to Create a Supernode
Optical
LR
0 B
u
s
Op
tic
al
6x
6x
L
R
23 B
u
s
Op
tic
al
6x
6x
LL0 Bus
Copper
8B
8B
8B
8B
LL1 Bus
Copper
8B
8B
LL2 Bus
Copper
8B
8B
LL4 Bus
Copper
8B
8B
LL5 Bus
Copper
8B
8B
LL6 Bus
Copper
8B
8B
LL3 Bus
Copper
Diff P
H
Ys
PX
0 B
u
s
16x
16x
PC
I-
E
IO
P
H
Y
Hot P
lug Ctl
PX
1 B
u
s
16x
16x
PC
I-
E
IO
P
H
Y
Hot P
lug Ctl
PX
2 B
u
s
8x
8x
PC
I-
E
IO
P
H
Y
Hot P
lug Ctl
FS
I
FS
P
1-
A
FS
I
FS
P
1-
B
I2C
TP
M
D
-A
, T
M
P
D
-B
SV
IC
MDC-
A
SV
IC
MDC-
B
I2C
SE
EPR
O
M
1
I2C
SE
EPR
O
M
2
24
L remote
Buses
HUB to QCM Connections
Address/Data
D B
u
s
Inter
conn
ec
t of
S
u
per
nodes
Optic
al
D0 Bus
Optical
12x
12x
D15 Bus
Optical
12x
12x
16
D B
u
s
es
28
I2
C
I2C_0 + Int
Int
I2
C
To Optic
al
Mod
u
le
s
TO
D S
ync
8B
Z
-B
u
s
8B Z
-Bu
s
TO
D S
ync
8B Y
-B
u
s
8B Y-
Bu
s
TO
D S
ync
8B X
-B
u
s
8B X-
Bu
s
TO
D S
ync
8B W
-Bu
s
8B W
-Bu
s
24
F
ib
e
r
D
-L
ink
C
o
nn
e
ct
o
r
48
F
ib
e
r
D
-Li
nk
Co
n
ne
ct
o
r
12 Lanes (10 + 2 spare)
12 Lanes (10 + 2 spare)
O to 16
24 Fiber D-Links
SE
E
P
R
O
M
SE
EP
R
O
M
Ca
p
s
CP
RO
M
CP
RO
M
C
apac
itor
s
Optical
Xmit & Rec
(D-Link)
Optical
Xmit & Rec
(LR-Link)
Optical
Xmit & Rec
(D-Link)
6 Lanes (5 + 1 spare)
6 Lanes (5 + 1 spare)
6 Lanes (5 + 1 spare)
6 Lanes (5 + 1 spare)
6 Lanes (5 + 1 spare)
6 Lanes (5 + 1 spare)
6 Lanes (5 + 1 spare)
6 Lanes (5 + 1 spare)
(Not to Scale)
24
F
ib
e
r
D
-L
ink
C
o
nn
e
ct
o
r
48
F
ib
e
r
D
-Li
nk
Co
n
ne
ct
o
r
12 Lanes (10 + 2 spare)
12 Lanes (10 + 2 spare)
O to 16
24 Fiber D-Links
SE
E
P
R
O
M
SE
EP
R
O
M
Ca
p
s
CP
RO
M
CP
RO
M
C
apac
itor
s
Optical
Xmit & Rec
(D-Link)
Optical
Xmit & Rec
(LR-Link)
Optical
Xmit & Rec
(D-Link)
6 Lanes (5 + 1 spare)
6 Lanes (5 + 1 spare)
6 Lanes (5 + 1 spare)
6 Lanes (5 + 1 spare)
6 Lanes (5 + 1 spare)
6 Lanes (5 + 1 spare)
6 Lanes (5 + 1 spare)
6 Lanes (5 + 1 spare)
(Not to Scale)
Summary of Contents for Power Systems 775
Page 2: ......
Page 170: ...156 IBM Power Systems 775 for AIX and Linux HPC Solution...
Page 256: ...242 IBM Power Systems 775 for AIX and Linux HPC Solution...
Page 278: ...264 IBM Power Systems 775 for AIX and Linux HPC Solution...
Page 326: ...312 IBM Power Systems 775 for AIX and Linux HPC Solution...
Page 357: ......