
Chapter 13 Specifications
257
13
We define measurement tolerances in terms of f.s. (full scale), rdg. (reading) and dgt. (digit) values,
with the following meanings.
Example accuracy calculations
(Digits in excess of display range are truncated.)
• Resistance measurement accuracy
Measurement conditions: 100 m
Ω
range, low current, OVC OFF, no zero-adjustment,
SLOW1, 30 m
Ω
measurement target
Resistance measurement accuracy: ±(0.014%rdg. + 0.020%f.s.),
Additional accuracy without 0ADJ: ±0.020%f.s.
• Temperature measurement accuracy
Measurement conditions: Thermistor temperature sensor, measurement temperature of
35°C
Temperature measurement accuracy: ±(0.55+0.012×|t-30|)
• Temperature correction additional accuracy
Measurement conditions: Temperature coefficient of 3,930 ppm/°C, standard temperature
of 20°C, measurement temperature of 35°C
About Instrument Accuracy
f.s.
(maximum display value)
This is usually the name of the maximum displayable value. For this instrument, it
indicates the currently selected range.
rdg.
(reading or displayed value)
The value currently being measured and indicated on the measuring instrument.
dgt.
(resolution)
The smallest displayable unit on a digital measuring instrument, i.e., the input value
that causes the digital display to show a “1” as the least-significant digit.
±(0.014%×30 m
Ω
+ (0.02%+0.02%) × 100 m
Ω
) = ±0.0442 m
Ω
±(0.55+0.012×|35-30|) = ±0.610°C
-
α
t0
Δ
t
1+
α
t0
×
(t
+
Δ
t -
t
0
)
× 100 [%]
Additional error
× 100 = -0.227%rdg., +0.226%rdg.
-0.393%×(±0.61)
1+0.393%×(35±0.61-20)
Summary of Contents for RM3545
Page 2: ......
Page 4: ......
Page 26: ...Operating Precautions 18...
Page 42: ...1 5 Checking the Measurement Target 34...
Page 54: ...2 6 Pre Operation Inspection 46...
Page 70: ...3 5 Checking Measured Values 62...
Page 226: ...10 6 Supplied Connector Assembly 218...
Page 290: ...Chapter 13 Specifications 282...
Page 312: ...14 4 Disposing of the Instrument 304...
Page 349: ...Appendix 18 Outline Drawing A37 Appendix Appendix 18 Outline Drawing...
Page 362: ...Index Index 4...
Page 363: ......
Page 364: ......