Fluke 5500A, Service Manual

Page: 156 / 296

5500A
Service Manual
6-30
Table 6-19. DC Voltage Verification at 1 M
Ω
Calibrator Mainframe output HP 3458A Reading (V DC) Tolerance (V DC)
0 mV 0.00004 V
1.25 mV 4.063E-05 V
-1.25 mV 4.063E-05 V
2.49 mV 4.125E-05 V
-2.49 mV 4.125E-05 V
2.5 mV 4.125E-05 V
-2.5 mV 4.125E-05 V
6.25 mV 4.313E-05 V
-6.25 mV 4.313E-05 V
9.90 mV 4.495E-05 V
-9.90 mV 4.495E-05 V
10.0 mV 0.000045 V
-10.0 mV 0.000045 V
17.5 mV 4.875E-05 V
-17.5 mV 4.875E-05 V
24.9 mV 5.245E-05 V
-24.9 mV 5.245E-05 V
25.0 mV 0.0000525 V
-25.0 mV 0.0000525 V
67.5 mV 7.375E-05 V
-67.5 mV 7.375E-05 V
109.9 mV 9.495E-05 V
-109.9 mV 9.495E-05 V
110 mV 0.000095 V
-110 mV 0.000095 V
305 mV 0.0001925 V
-305 mV 0.0001925 V
499 mV 0.0002895 V
-499 mV 0.0002895 V
0.50 V 0.00029 V
-0.50 V 0.00029 V
1.35 V 0.000715 V
-1.35 V 0.000715 V
2.19 V 0.001135 V
-2.19 V 0.001135 V
2.20 V 0.00114 V
-2.20 V 0.00114 V
6.60 V 0.00334 V
-6.60 V 0.00334 V
10.99 V 0.005535 V
-10.99 V 0.005535 V
11.0 V 0.00554 V
-11.0 V 0.00554 V
70.5 V 0.03529 V
-70.5 V 0.03529 V
130.0 V 0.06504 V
-130.0 V 0.06504 V