9.2 Accuracy
259
9
Basic Accuracy
Guaranteed accuracy for temperature and humidity ranges: 23
±
5°C, 80% RH
or less (no condensation)
Warm-up time: 1 hour
*1:The coefficient is 1 when the operating temperature (t) is 23
±
5°C.
Measurement Condi-
tions
Measurement signal level: 1 V
Measurement speed: SLOW
Executing open circuit and short circuit compensation
Cable length: 0 m
9.2 Accuracy
Measurement Accuracy = Basic Accuracy
×
Measurement Signal Level Coefficient
×
Measurement Speed
Coefficient
×
Cable Length Coefficient
×
Temperature Coefficient
Measurement signal
level
100 mV
500 mV
1 V
Coefficient
1.5
1
1
Measurement speed
FAST
NORMAL
SLOW
Coefficient
1.5
1.0 (during 1 kHz 1V)
1.2 (besides 1 kHz 1V)
1
Cable length
0 m
1 m
Coefficient
1
1.0 (during 1 kHz 1V)
1.5 (besides 1 kHz 1V)
Temperature
*1
t = Operating temperature (
°C)
Coefficient
1 + 0.1 x | t-23 |
C-D
(CL: electrostatic capacitance [pF] of sample, , CH: electrostatic capacitance [mF] of sample)
when D
0.1
Rang
e No.
Frequen-
cy Pa-
rameter
Guaranteed Accuracy of 6 Months
Guaranteed Accuracy of 1 Year
120 Hz
1 kHz
120 Hz
1 kHz
1
C
±0.20%rdg.±300dgt.
±0.20%rdg.±300dgt.
±0.30%rdg.±450dgt.
±0.30%rdg.±450dgt.
D
±0.0120±2/CL
±0.0120±0.25/CL
±0.0180±3/CL
±0.0180±0.375/CL
2
C
±0.20%rdg.±60dgt.
±0.20%rdg.±60dgt.
±0.30%rdg.±90dgt.
±0.30%rdg.±90dgt.
D
±0.0020±2.2/CL
±0.0020±0.265/CL
±0.0030±3.3/CL
±0.0030±0.3975/CL
3
C
±0.16%rdg.±20dgt.
±0.14%rdg.±20dgt.
±0.24%rdg.±30dgt.
±0.21%rdg.±30dgt.
D
±0.0036
±0.0036
±0.0054
±0.0054
4
C
±0.15%rdg.±15dgt.
±0.13%rdg.±15dgt.
±0.23%rdg.±23dgt.
±0.20%rdg.±23dgt.
D
±0.0020
±0.0020
±0.0030
±0.0030
5
C
±0.15%rdg.±15dgt.
±0.13%rdg.±15dgt.
±0.23%rdg.±23dgt.
±0.20%rdg.±23dgt.
D
±0.0016
±0.0016
±0.0024
±0.0024
6
C
±0.15%rdg.±15dgt.
±0.09%rdg.±10dgt.
±0.23%rdg.±23dgt.
±0.14%rdg.±15dgt.
D
±0.0020
±0.0016
±0.0030
±0.0024
7
C
±0.25%rdg.±20dgt.
±0.13%rdg.±15dgt.
±0.38%rdg.±30dgt.
±0.20%rdg.±23dgt.
D
±0.0035
±0.0030
±0.00525
±0.0045
8
C
±1.2%rdg.±50dgt.
±0.7%rdg.±40dgt.
±1.8%rdg.±75dgt.
±1.05%rdg.±60dgt.
D
±0.0060
±0.0050
±0.0090
±0.0075
Summary of Contents for 3504-40 C HiTester
Page 2: ......
Page 22: ...1 4 Names and Functions of Parts 16 ...
Page 28: ...2 5 Turning the Power On and Off 22 ...
Page 40: ...3 3 Setting the Measurement Conditions 34 OF UF Evaluation Flow Chart ...
Page 66: ...4 4 Self Calibration 60 ...
Page 96: ...5 2 BIN Measurement Function Model 3504 50 3504 60 only 90 ...
Page 136: ...7 4 About Measurement Times 130 ...
Page 286: ...Appendix 7 Initial Settings Table A14 ...
Page 289: ......
Page 290: ......
Page 291: ......
Page 292: ......