![Tews Technologies TPCE636 Скачать руководство пользователя страница 58](http://html1.mh-extra.com/html/tews-technologies/tpce636/tpce636_user-manual_1093646058.webp)
TPCE636 User Manual Issue 1.0.2
Page 58 of 104
7.8.3.4 ADC Data Correction Formula
Please use the total 16 bit data register value for the ADC correction formula.
The basic formula for correcting any ADC reading for the TPCE636 (bipolar input voltage range) is:
Value
=
Reading
4
131072
1
corr
corr
Offset
Gain
Value
is the corrected result.
Reading
is the data read from the ADC Data Register.
Gain
corr
and
Offset
corr
are the ADC correction factors from the Calibration Data ROM stored for each programmable gain
factor.
The correction values are stored as two’s complement 16 bit values in the range -32768 to 32767. For higher accuracy
they are scaled to ¼ LSB.
Floating point arithmetic or scaled integer arithmetic is necessary to avoid rounding error while computing
above formula.
7.8.3.5 DAC Data Correction Formula
The basic formula for correcting any DAC value is:
Data
=
Value
4
131072
1
corr
corr
Offset
Gain
Value
is the desired DAC value.
Data
is the corrected DAC value that must be sending to the DAC.
Gain
corr
and
Offset
corr
are the DAC correction values from the Calibration Data ROM. They are stored separately for each
of the 8 DAC channels.
The correction values are stored as two’s complement byte wide values in the range from –32768 to +32767. For higher
accuracy they are scaled to ¼ LSB.
Floating point arithmetic or scaled integer arithmetic must be used to avoid rounding errors in computing above
formula.