Document Number: 002-10689 Rev *H
Page 148 of 166
S6J32E, S6J32F, S6J32G Series
Total error
Total error of digital output N =
V
NT
- {1 LSb × (N-1) + 0.5LSb}
[LSb]
1LSb
1 LSb (Ideal value) =
AVRH - AVRL
[V]
4096
N: A/D converter digital output value.
V
ZT(
Ideal value) = AVRL + 0.5LSb[V]
V
FST(
Ideal value) = AVRH - 1.5LSb[V]
V
NT
: Voltage at which the digital output changes from "(N
– 1)" to "N".
FFF
FFE
FFD
004
003
002
001
AVRL
(AVSS)
AVRH
{1 LSb (N - 1) + 0.5LSb}
1.5LSb
V
NT
0.5LSb
Ideal characteristics
Actual conversion
characteristics
(
Actually-measured
value
)
Analog input
Actual
con
ver
sion
cha
ract
eris
tics
(measured value)
Dig
ital ou
tp
u
t