E-48
k
Calculation Ranges, Number of Digits, and
Precision
The calculation range, number of digits used for internal calculation, and calculation
precision depends on the type of calculation you are performing.
Calculation Range and Precision
Calculation Range
±
1
×
10
–99
to
±
9.999999999
×
10
99
or 0
Number of Digits for Internal
Calculation
15 digits
Precision
In general,
±
1 at the 10th digit for a single
calculation. Precision for exponential display
is
±
1 at the least significant digit. Errors are
cumulative in the case of consecutive
calculations.
Function Calculation Input Ranges and Precision
Functions
Input Range
sin
x
DEG
0
x
9
10
9
RAD
0
x
157079632.7
GRA
0
x
1
10
10
cos
x
DEG
0
x
9
10
9
RAD
0
x
157079632.7
GRA
0
x
1
10
10
tan
x
DEG
Same as sin
x
,
except when
x
= (2
n
–1)
90
.
RAD
Same as sin
x
,
except when
x
= (2
n
–1)
π
/
2
.
GRA
Same as sin
x
,
except when
x
= (2
n
–1)
100
.
sin–
1
x
0
x
1
cos–
1
x
tan–
1
x
0
x
9.999999999
10
99
sinh
x
0
x
230.2585092
cosh
x
sinh–
1
x
0
x
4.999999999
10
99
cosh–
1
x
1
x
4.999999999
10
99
tanh
x
0
x
9.999999999
10
99
tanh–
1
x
0
x
9.999999999
10
–1
log
x
/ln
x
0
x
9.999999999
10
99
10
x
–9.999999999
10
99
x
99.99999999
e
x
–9.999999999
10
99
x
230.2585092
'
x
0
x
1
10
100
x
2
x
1
10
50
1/
x
x
1
10
100
;
x
G
0
3
'
x
x
1
10
100
x
!
0
x
69 (
x
is an integer)
n
P
r
0
n
1
10
10
, 0
r
n
(
n
,
r
are integers)
1
{
n
!/(
n
–
r
)!}
1
10
100
n
C
r
0
n
1
10
10
, 0
r
n
(
n
,
r
are integers)
1
n
!/
r
!
1
10
100
or 1
n
!/(
n
–
r
)!
1
10
100