Resolution
Resolution is the numeric ratio of the maximum displayed value divided
by the minimum displayed value on a selected range. Resolution is
often expressed in percent, parts-per-million (ppm), counts, or bits.
For example, a 6
1
⁄
2
-digit multimeter with 20% overrange capability can
display a measurement with up to 1,200,000 counts of resolution.
This corresponds to about 0.0001% (1 ppm) of full scale, or 21 bits
including the sign bit. All four specifications are equivalent.
Accuracy
Accuracy is a measure of the “exactness” to which the internal DMM’s
measurement uncertainty can be determined
relative
to the calibration
reference used. Absolute accuracy includes the Internal DMM’s relative
accuracy specification plus the known error of the calibration reference
relative to national standards (such as the U.S. National Institute of
Standards and Technology). To be meaningful, the accuracy specifications
must be accompanied with the conditions under which they are valid.
These conditions should include temperature, humidity, and time.
There is no standard convention among multimeter manufacturers for
the confidence limits at which specifications are set. The table below
shows the probability of non-conformance for
each specification
with the
given assumptions.
Specification
Criteria
Mean
±
2 sigma
Mean
±
3 sigma
Probability
of Failure
4.5%
0.3%
Variations in performance from reading to reading, and instrument
to instrument, decrease for increasing number of sigma for a given
specification. This means that you can achieve greater actual
measurement precision for a specific accuracy specification number.
The 34970A is designed and tested to meet performance better than
mean
±
3 sigma of the published accuracy specifications.
1
Chapter 1 Specifications
Interpreting Internal DMM Specifications
29
Содержание 34970A
Страница 1: ...Agilent 34970A Data Acquisition Switch Unit Service Guide ...
Страница 34: ...32 ...
Страница 35: ...2 Quick Start 2 ...
Страница 49: ...3 Front Panel Overview 3 ...
Страница 62: ...60 ...
Страница 63: ...4 Calibration Procedures 4 ...
Страница 118: ...116 ...
Страница 119: ...5 Theory of Operation 5 ...
Страница 159: ...6 Service 6 ...
Страница 177: ...General Disassembly 4 3 2 1 6 Chapter 6 Service Disassembly 175 ...
Страница 178: ...Internal DMM Disassembly 3 2 1 Chapter 6 Service Disassembly 176 ...
Страница 180: ...Additional Chassis Disassembly 1 2 Chapter 6 Service Disassembly 178 ...
Страница 181: ...Plug In Module Disassembly Needle nose Pliers 6 Chapter 6 Service Disassembly 179 ...
Страница 182: ...180 ...
Страница 183: ...7 Replaceable Parts 7 ...
Страница 220: ...Chapter 7 Replaceable Parts Manufacturer s List 218 ...
Страница 221: ...8 Schematics 8 ...
Страница 272: ......