
PROCESSING SPECIFICATIONS
NOTE
The notation format for average data values does not use a
decimal point.
Example: Read 10.00 as 1000.
3. Processing Error Details
The DP-1VR processing error is described below.
The DP-1VR processing error is defined as follows.
1. Lowermost digit
1 is counted but the value is on the inside of the
overflow limit indicated by the processing precision.
Data variation at this time is approximately
5% of the average
value.
2. The processing error when the average value variation greatly
exceeds the above variation is counted as lowermost digit
5.
3. However, regarding area A (
1000000, number of data 2000 or
lower), in all cases the processing error is counted as lowermost
digit
1.
-10000000
-8000000
-6000000
-4000000
-2000000
0
2000000
4000000
6000000
8000000
10000000
0
1000
2000
3000
4000
5000
6000
7000
8000
9000
10000
A
Overflow area
Overflow area
Number of data
Processing Accuracy
Average value of data
NOTE
The notation format for average data values does not use a
decimal point.
Example: Read 10.00 as 1000.
- 45 -
www.calcert.com
1.800.544.2843
0
5
10
15
20
25
30