
Understanding the “ % of range ” Error
The
range error
compensates
for inaccuracies that result from the function and range you select.
The range error contributes a constant error, expressed as a percent of
range,
independent
of the input signal level. The following table shows
the range error applied to the
DMM
’s 24-hour dc voltage specification.
Range
Input Level
Range Error
(% of range)
Range
Error Voltage
10 Vdc
10 Vdc
10 Vdc
10 Vdc
1 Vdc
0.1 Vdc
0.0004
0.0004
0.0004
≤
40
µ
V
≤
40
µ
V
≤
40
µ
V
Total Measurement Error
To compute the total measurement error,
add the reading error and range error. You can then convert the total
measurement error to a “percent of input” error or a “ppm (part-per-
million) of input” error as shown below.
% of input error
=
Total
Measurement Error
Input Signal Level
×
100
ppm of input error
=
Total
Measurement Error
Input Signal Level
×
1,000,000
Example: Computing Total Measurement Error
Assume that a 5 Vdc signal is input to the
DMM
on the 10 Vdc range.
Compute the total measurement error using the 90-day accuracy
specification of
±
(0.0020% of r 0.0005% of range).
Reading Error
= 0.0020% x 5 Vdc
= 100
µ
V
Range Error
= 0.0005% x 10 Vdc = 50
µ
V
Total Error
= 100
µ
V + 50
µ
V
=
±
150
µ
V
=
±
0.0030% of 5 Vdc
=
±
30 ppm of 5 Vdc
1
Chapter 1 Specifications
To Calculate Total Measurement Error
27
Summary of Contents for 34970A
Page 1: ...Agilent 34970A Data Acquisition Switch Unit Service Guide ...
Page 34: ...32 ...
Page 35: ...2 Quick Start 2 ...
Page 49: ...3 Front Panel Overview 3 ...
Page 62: ...60 ...
Page 63: ...4 Calibration Procedures 4 ...
Page 118: ...116 ...
Page 119: ...5 Theory of Operation 5 ...
Page 159: ...6 Service 6 ...
Page 177: ...General Disassembly 4 3 2 1 6 Chapter 6 Service Disassembly 175 ...
Page 178: ...Internal DMM Disassembly 3 2 1 Chapter 6 Service Disassembly 176 ...
Page 180: ...Additional Chassis Disassembly 1 2 Chapter 6 Service Disassembly 178 ...
Page 181: ...Plug In Module Disassembly Needle nose Pliers 6 Chapter 6 Service Disassembly 179 ...
Page 182: ...180 ...
Page 183: ...7 Replaceable Parts 7 ...
Page 220: ...Chapter 7 Replaceable Parts Manufacturer s List 218 ...
Page 221: ...8 Schematics 8 ...
Page 272: ......