Hioki IM3536, Instruction Manual

Page: 211 / 270

207
Measurement Range and Accuracy
10.6 Measurement Range and Accuracy
Measurement accuracy equation: Measurement accuracy is calculated using the following equation.
Measurement accuracy = Basic accuracy × C × D × E × F × G
C: Level coefficient, D: Measurement speed coefficient, E: Cable length coefficient,
F: DC bias coefficient, G: Temperature coefficient (operating temperature coefficient)
Basic accuracy
Accuracy is calculated based on coefficients A and B from the basic accuracy chart shown below.
(See "Example calculation of basic accuracy" (p. 209).)
1 kΩ range or higher
Basic accuracy =
10
1
Zx
A B
 × 
± + × −
 
 
Range
100 Ω range or lower
Basic accuracy =
1 A B
Zx
 
± + × −
 
 
Range
Zx
: Impedance of the measurement sample
A and B: Noted in basic accuracy chart. (Upper value:
Z
accuracy [% rdg.]; lower value: θ accuracy [°])
• From 1.0001 MHz to 5 MHz, multiple basic accuracy by (fm [MHz]+3)/4.
*
• From 5.0001 MHz to 8 MHz, multiple basic accuracy by fm [MHz]/2.
*
*: "fm" is measurement frequency [MHz].
Basic accuracy chart
Range
For DC
measurement
For AC measurement (measurement frequency)
4 Hz to 99.99 Hz 100.00 Hz to 999.99 Hz 1.0000 kHz to 10.000 kHz
100 M
Ω
A=1 B=1
A=6 B=5 A=3 B=2 A=3 B=2
A=5 B=3 A=2 B=2 A=2 B=2
10 M
Ω
A=0.5 B=0.3
A=0.8 B=1 A=0.5 B=0.3 A=0.5 B=0.3
A=0.8 B=0.5 A=0.4 B=0.2 A=0.4 B=0.2
1 M
Ω
A=0.2 B=0.1
A=0.4 B=0.08 A=0.3 B=0.05 A=0.3 B=0.05
A=0.3 B=0.08 A=0.2 B=0.02 A=0.2 B=0.02
100 k
Ω
A=0.1 B=0.01
A=0.3 B=0.03 A=0.2 B=0.03 A=0.2 B=0.03
A=0.2 B=0.02 A=0.1 B=0.02 A=0.1 B=0.02
10 k
Ω
A=0.1 B=0.01
A=0.3 B=0.03 A=0.2 B=0.02 A=0.05 B=0.02
A=0.2 B=0.02 A=0.1 B=0.02 A=0.03 B=0.02
1 k
Ω
A=0.1 B=0.01
A=0.3 B=0.02 A=0.2 B=0.02 A=0.2 B=0.02
A=0.2 B=0.01 A=0.1 B=0.02 A=0.1 B=0.02
100
Ω
A=0.1 B=0.02
A=0.3 B=0.02 A=0.2 B=0.02 A=0.2 B=0.02
A=0.2 B=0.01 A=0.15 B=0.01 A=0.1 B=0.01
10
Ω
A=0.2 B=0.15
A=0.5 B=0.1 A=0.4 B=0.05 A=0.4 B=0.05
A=0.3 B=0.1 A=0.3 B=0.03 A=0.3 B=0.03
1
Ω
A=0.3 B=0.3
A=1.5 B=1 A=1 B=0.3 A=1 B=0.3
A=0.8 B=0.5 A=0.5 B=0.2 A=0.5 B=0.2
100 m
Ω
A=1 B=1
A=8 B=8 A=5 B=4 A=3 B=2
A=5 B=4 A=3 B=2 A=2 B=1.5
10
Specifications