Fluke 2680A, Service Manual

Page: 192 / 254

268XA
Service Manual
6-46
Table 6-13. A/D Module Calibration Constants
CAL
Constant
Number Function
Function Range
Comment
Minimum
Allowable Value
Maximum
Allowable
Value
0 V dc 90 mV Gain +0.0 +1.0
2 V dc 90 mV Offset -0.0 +0.0
4 V dc 300 mV Gain +0.0 +1.0
6 V dc 300 mV Offset -0.0 +0.0
8 V dc 3 V Gain +0.0 +1.0
10 V dc 3 V Offset -0.0 +0.0
12 V dc 30 V Gain +0.0 +1.0
14 V dc 30 V Offset -0.0 +0.0
16 V dc 50 V (FAI)
150/300 V (PAI) Gain +0.0 +1.0
18 V dc
50 V (FAI)
150/300 V (PAI)
Offset
-0.0
-3.0 +0.0
+3.0
20 V dc 750 mV Gain +0.0 +1.0
22 V dc 750 mV Offset -0.0 +0.0
24 V ac 300 mV Gain +0.0 +1.0
26 V ac 300 mV Offset -0.0 +0.0
28 V ac 3 V Gain +0.0 +1.0
30 V ac 3 V Offset -0.0 +0.0
32 V ac 30 V Gain +0.0 +1.0
34 V ac 30 V Offset -0.0 +0.0
36 V ac N/A (FAI)
150/300 V (PAI) Gain +0.0 +1.0
38 V ac N/A (FAI)
150/300 V (PAI) Offset -3.0 +3.0
40 Resistance 300
Ω
Gain +0.0 +1.0
42 Resistance 300
Ω
Offset -3.0 +3.0
44 Resistance 3 k
Ω
Gain +0.0 +1.0
46 Resistance 3 k
Ω
Offset -3.1 +3.1
48 Resistance 30 k
Ω
Gain +0.0 +1.0
50 Resistance 30 k
Ω
Offset -3.2 +3.2
52 Resistance 300 k
Ω
Gain +0.0 +1.0
54 Resistance 300 k
Ω
Offset -3.3 +3.3
56 Resistance 3 M
Ω
Gain +0.0 +1.0
58 Resistance 3 M
Ω
Offset -3.4 +3.4
60 Frequency All CFC* +0.0 +1.0
*CFC = crystal frequency correction