22
4. DATA REDUCTION
4.1 Pressure Calculation
The basic units utilized by Geokon for measurement and reduction of data from Vibrating Wire
Earth Pressure Cells are "digits". Geokon Readouts display "digits" in the Earth Pressure Cell
reading position. Calculation of digits is based on the following equation:
Digits =
�
1
Period
�
2
x 10
-3
Or
Digits
=
Hz
2
1000
Equation 2 - Digits Calculation
To convert digits to pressure the following equation applies:
Pressure
=
(Current Reading - Initial Reading)
×
Calibration Factor
Or
P = (R
1
- R
0
)
×
G
Equation 3 - Convert Digits to Pressure
The Initial Reading (R
0
) is normally obtained during installation (usually the zero reading). The
Calibration Factor (G, usually in terms of psi or kPa per digit) comes from the supplied
Calibration Sheet (a typical calibration sheet is shown in Figure 18). To convert the output to
other engineering units, multiply the Calibration Factor by the conversion multiplier listed in
Table 2.
From
→
To
↓
psi
"H
2
O
'H
2
O
mm H
2
0
m H
2
0
"HG
mm HG
atm
mbar
bar
kPa
MPa
psi
1
.036127 .43275 .0014223 1.4223
.49116 .019337 14.696 .014503 14.5039 .14503
145.03
"H
2
O
27.730
1
12
.039372
39.372
13.596
.53525
406.78
.40147
401.47
4.0147
4016.1
'H
2
O
2.3108
.08333
1
.003281
3.281
1.133
.044604 33.8983 .033456 33.4558
.3346
334.6
mm H
2
0
704.32
25.399 304.788
1
1000
345.32
13.595
10332
10.197
10197
101.97
101970
m H
2
0
.70432 .025399 .304788
.001
1
.34532 .013595 10.332 .010197 10.197
.10197
101.97
"HG
2.036
.073552 .882624 .0028959 2.8959
1
.03937
29.920 .029529 29.529
.2953
295.3
mm HG
51.706
1.8683 22.4196 .073558
73.558
25.4
1
760
.75008
750.08
7.5008
7500.8
atm
.06805 .0024583 .0294996 .0000968
.0968
.03342 .0013158
1
.0009869 .98692 .009869
9.869
mbar
68.947
2.4908 29.8896 .098068
98.068
33.863
1.3332
1013.2
1
1000
10
10000
bar
.068947 .0024908 .0298896 .0000981 .098068 .033863 .001333 1.0132
.001
1
.01
10
kPa
6.8947
.24908 2.98896 .0098068 9.8068
3.3863
.13332 101.320
.1
100
1
1000
MPa
.006895 .000249 .002988 .00000981 .009807 .003386 .000133 .101320
.0001
.1
.001
1
Table 2 - Engineering Units Multiplication Factors