De Nora Capital Controls CHLORALERT 17CA3000 Series, Instruction Manual

Page: 74 / 84

325.6610.17 - 74 -
Two examples of C and H floating point value calculations
(Note: Calculator values are approximations of the instrument
values given in the first line of each example)
Example 1;
Value as nearest C
 1111.0000000000000000  45 70 0B
Calculator check (calculator numbers are rounded):
0100 0101 0111 0000 x 2
OB or 0100 0101 0111 0000 x 2 11
(Sum of Exponents –1, -5, -7, -9, -10, -11) x 2 11
=.5 + .6425 + .0 .001 .0009 .00048828125 x
2048
= 0.542480468 x 2048 = 1110.999998 = 1111
Value as nearest H
 1111.0000000000000000  45 70 00 00 0B
Calculator check (calculator numbers are rounded):
0100 0101 0111 0000 0000 0000 0000 0000 0000 x 2
0B or
0100 0101 0111 0000 0000 0000 0000 0000 0000 x 2 11
(Sum of exponents -1,-5, -7. -9, -10, -11) x 2 11
=.5 + .03125 + .0 001 .0009 .00048 .0
+
.0 + .0 + .0 + .0x2048 = 0.542480468 x 2048 = 1110.999998 = 1111
Example 2:
Value as nearest C
 0.09999847412109375  66 66 FD
Calculator check (calculator numbers are rounded):
0110 0110 0110 0110 x 2
FD or 0110 0110 0110 0110 x 2 -3
(Sum of exponents -1, -2, -5, -6, -9, -10, -13, -14) x 2 -3
= .5 + .25 + .03125 + .001 .0009
.0001220703125
+ .00006103515625 x 0.125 = 0.799987792. x .0.125 = 0.099998474 = 0.1
Value as nearest H
 0.09999999997671694  66 66 66 66 FD
Calculator check (calculator numbers are rounded):
0110 0110 0110 0110 0110 0110 0110 0110 x 2
FD or
0110 0110 0110 0110 0110 0110 0110 0110 x 2 -3
(Sum of exponents -1, -2, -5, -6, -9, -10, -13, -14, -17, -18, -21, -22, -25, -26
-29, -30) x 2
-3
Figure 6-4 Floating Point Examples
6.6 Executing Instrument Self Tests Using Datalink
The procedure to execute the instrument self tests via the datalink can be found in section 7.5 of the
maintenance section of this instruction bulletin.
NOTE: Rx and Tx need to be connected for communications ports self test to work.
2
0
sign bit
2
-1
0.5
2
-2
0.25
2
-3
0.125
2
-4
0.0625
2
-5
0.03125
2
-6
0.015625
2
-7
0.0078125
2
-8
0.00390625
2
-9
0.001953125
2
-10
0.0009765625
2
-11
0.00048828125
2
-12
0.000244140625
2
-13
0.0001220703125
2
-14
0.00006103515625
2
-15
0.00003051757813
2
-16
0.00001525878906
2
-17
0.000007629394531
2
-18
0.000003814697266
2
-19
0.000001907348633
2
-20
0.0000009636743164
2
-21
0.0000004768371582
2
-22
0.0000002384185791
2
-23
0.0000001192092895
2
-24
0.00000005960464477
2
-25
0.00000002980232239
2
-26
0.00000001490116119