75
7 Specifications
No. 99MAM029A
7.2
Calculation Specifications
7.2.1 Effective Digits
The essential figures for calculation are as follows.
Setting the effective digits (number of digits after the decimal point) of input data as A, the
effective digits of each case are shown.
Symbol
Meaning
Displayed effective digits
(after the decimal point)
Tolerance
Data
Input data
A
-
N
Number of data
-
-
MAX
Maximum value
A
-
MIN
Minimum value
A
-
R
Range
A
-
X
Average
A + 2
Lowermost digit ±1
σn
Standard deviation
A + 2
Lowermost digit ±1
σn-1
Sample standard deviation
A + 2
Lowermost digit ±1
P
Fraction defective (%)
3
Lowermost digit ±1
Cp
Process capability index
3
Lowermost digit ±1
Cpk
Process capability index
3
Lowermost digit ±1
LSL
Lower specification limit value
A
Lowermost digit ±1
USL
Upper specification limit value
A
Lowermost digit ±1
DIV
Number of divisions in histogram
Fixed to 10 divisions
-
Histogram range display
A + 2
Lowermost digit ±1
X¯
Center (X¯ control)
A + 2
Lowermost digit ±1
X¯-UCL Upper control limit (X¯ control)
A + 2
Lowermost digit ±1
X¯-LCL
Lower control limit (X¯ control)
A + 2
Lowermost digit ±1
R¯
Center (R control)
A + 2
Lowermost digit ±1
R¯-UCL Upper control limit (R control)
A + 2
Lowermost digit ±1
R¯-LCL
Lower control limit (R control)
A + 2
Lowermost digit ±1
Summary of Contents for DP-1VA LOGGER
Page 16: ...xiv No 99MAM029A...
Page 22: ...6 1 Outline No 99MAM029A...
Page 42: ...26 2 Basic Operations No 99MAM029A...
Page 76: ...60 4 Output No 99MAM029A...
Page 88: ...72 6 Maintenance and Troubleshooting No 99MAM029A...
