Instructions for Example Repeatability and Reproducibility Calculations

Carl Houtman 11/22/2004

This spreadsheet provides an implementation of the calculations found in TAPPI standard T 1200, "Interlaboratory Evaluation o
Methods to Determine TAPPI Repeatability and Reproducibility". These are also the same calculations specified in ASTM E 69
come from the examples given in these two standards.

Please note that these calculations assume a balanced design, that is, each laboratory provided the same number of measure
case of both the 32 and 69 lb examples one data point is missing. While not formally a balanced design, these missing data p
have a large impact on the results. The reason that these calculations are insensitive is that there are eight or nine other labor
supplying the full information and there was only one data point missing. If you are facing a situation where the number of labo
less than 8 or more than 2 measurements are missing, more complex methods are required. You likely will have to seek the a
statistician.

To add a new data set (1) move to one of the example worksheets (2) by using the command "Move or Copy Sheet" under the
item, duplicate a worksheet. Remember to check "Create a Copy" box. (3) enter the new data starting in Cell B5. The current
are 10 measurements per laboratory and 25 laboratories, but these limits could be expanded by adjusting all of the sums. The
particular laboratory is entered into a single column. The calculations are automatically repeated each time a new entry is mad
missing data leave a blank. Do not enter a zero.

The h and k statistics are calculated and shown in the plots. These values provide tests of the consistency of the data and are
section 10 of the TAPPI standard. If the data for a particular laboratory exceeds the critical value, you should investigate the p
for these deviations from the rest of the population.

Below the h and k plots is shown a histogram of the data. Data points that do not appear to be part of a central normal distribu
also be investigated.

nterlaboratory Evaluation of Test

ns specified in ASTM E 691. The data

same number of measurements. In the

ign, these missing data points do not
e eight or nine other laboratories
where the number of laboratories is
ely will have to seek the advice of a

or Copy Sheet" under the "Edit" menu

g in Cell B5. The current default limits
sting all of the sums. The data for a
ch time a new entry is made. For

stency of the data and are discussed in

u should investigate the potential causes

of a central normal distribution should

These data are taken from T1200 sp00 for 35 lb linerboard (unbalanced)

Laboratory
data1
data2
data3
data4
data5
data6
data7
data8
data9
data10

1
87.8
86.6
81.4
86.0

2
87.6
86.4
87.3
83.4

3
91.3
91.3
89.2
88.7

4
86.8
88.7
86.1
87.2

5
95.3
86.9
94.4
87.4

6
90.5
92.8
91.3
86.0

7
91.2
89.0
91.3

8
89.1
88.7
87.0
88.8

Mean
Std Dev
Std Dev2
h statistic
h critical (+)
h critical (-)
k statistic
k critical
Count

85.5
2.80
7.85
-1.51
2.23
-2.23
1.05
1.92
4

86.2
1.92
3.68
-1.15
2.23
-2.23
0.72
1.92
4

90.1
1.37
1.88
0.80
2.23
-2.23
0.51
1.92
4

87.2
1.10
1.21
-0.65
2.23
-2.23
0.41
1.92
4

91.0
4.47
19.94
1.23
2.23
-2.23
1.67
1.92
4

90.2
2.93
8.56
0.81
2.23
-2.23
1.10
1.92
4

90.5
1.30
1.69
0.98
2.23
-2.23
0.49
2.09
3

88.4
0.95
0.90
-0.05
2.23
-2.23
0.36
1.92
4

Grand Mean

X
Sx

Grand Std Dev

Count

88.5 ERROR: this is not a balanced design the calculation is incorrect

2.0
9

p
Sr
Repeat Std Dev
Repeatability
r
%r
Repeatability %
Reproduce Std Dev SR
Reproducibility
R
%R
Reproducibility %

2.7
7.4
8.4%
3.1
8.5
9.6%

h statistics test
2.50

2.50

2.00
2.00

1.50
1.00
data
+critical value
-critical value

0.50
0.00
-0.50

10

1.50

1.00

-1.00
-1.50
-2.00

0.50

1.00
data
+critical value
-critical value

0.50
0.00
-0.50

1.50

10

1.00

-1.00
0.50

-1.50
-2.00

0.00

-2.50

81.4
95.3
1.39

73.3
76.4
79.6
82.7
85.9
89.0
92.2
95.4
98.5
101.7
104.8
3.2

0
0
0
2
1
19
10
3
0
0
0

20
18
16
Number of Occurences

min
max
difference

14
12
10
8
6
4
2
0
73.3

76.4

79.6

82.7

85.9

89.0

Value

9
86.5
89.8
82.1
92.0

10

11

12

13

14

87.6
4.31
18.55
-0.45
2.23
-2.23
1.61
1.92
4

k statistics test

data
critical value

15

16

17

18

data
critical value

82.7

85.9

89.0

Value

92.2

95.4

98.5

10

101.7 104.8

19

20

21

22

23

24

25

These data are taken from T1200 sp00 for 42 lb linerboard (the only complete set)

Laboratory
data1
data2
data3
data4
data5
data6
data7
data8
data9
data10

1
122.5
121.7
124.6
116.3

2
118.7
123.5
122.8
120.0

3
120.6
121.2
117.8
117.5

4
123.0
120.0
121.9
118.0

5
116.0
117.6
122.4
116.4

6
132.9
122.8
123.2
127.0

7
123.0
124.1
118.0
121.0

8
120.0
113.6
113.8
118.9

Mean
Std Dev
Std Dev2
h statistic
h critical (+)
h critical (-)
k statistic
k critical
Count

121.3
3.53
12.50
0.06
2.23
-2.23
1.17
1.92
4

121.3
2.28
5.18
0.05
2.23
-2.23
0.76
1.92
4

119.3
1.90
3.60
-0.60
2.23
-2.23
0.63
1.92
4

120.7
2.20
4.84
-0.12
2.23
-2.23
0.73
1.92
4

118.1
2.95
8.68
-0.98
2.23
-2.23
0.98
1.92
4

126.5
4.68
21.93
1.76
2.23
-2.23
1.56
1.92
4

121.5
2.68
7.17
0.14
2.23
-2.23
0.89
1.92
4

116.6
3.35
11.23
-1.48
2.23
-2.23
1.11
1.92
4

Grand Mean

X
Sx

Grand Std Dev

Count

121.1
3.1
9

p
Sr
Repeat Std Dev
Repeatability
r
%r
Repeatability %
Reproduce Std Dev SR
Reproducibility
R
Reproducibility %
%R

3.0
8.3
6.9%
4.0
11.1
9.2%

h statistics test
2.50

2.50

2.00
2.00

1.50
1.00
data
+critical value
-critical value

0.50
0.00
-0.50

10

1.50

1.00

-1.00
-1.50
-2.00

0.50

1.00
data
+critical value
-critical value

0.50
0.00
-0.50

10

1.50

1.00

-1.00
0.50

-1.50
-2.00

0.00

-2.50

113.6
132.9
1.93

102.2
106.6
111.0
115.4
119.8
124.2
128.6
133.0
137.4
141.8
146.2
4.4

0
0
0
2
10
19
4
1
0
0
0

20
18
16
Number of Occurences

min
max
difference

14
12
10
8
6
4
2
0

102.2 106.6 111.0 115.4 119.8 124.2 12

Value

9
123.7
125.7
121.7
127.6

10

11

12

13

14

124.7
2.54
6.47
1.17
2.23
-2.23
0.84
1.92
4

k statistics test

data
critical value

15

16

17

18

data
critical value

0
0

10

0 115.4 119.8 124.2 128.6 133.0 137.4 141.8 146.2

Value

19

20

21

22

23

24

25

These data are taken from T1200 sp00 for 69 lb linerboard (unbalanced)

Laboratory
data1
data2
data3
data4
data5
data6
data7
data8
data9
data10

1
147.7
133.0
136.3
139.8

2
149.5
137.5
141.6

3
134.5
139.9
141.3
147.1

4
140.5
139.7
139.7
143.9

5
147.0
141.7
143.8
145.2

6
148.7
149.2
142.3
154.3

7
141.0
144.8
139.6
139.0

8
134.1
140.8
142.0
130.6

Mean
Std Dev
Std Dev2
h statistic
h critical (+)
h critical (-)
k statistic
k critical
Count

139.2
6.31
39.82
-0.75
2.15
-2.15
1.36
1.90
4

142.9
6.10
37.20
0.29
2.15
-2.15
1.31
2.06
3

140.7
5.18
26.80
-0.32
2.15
-2.15
1.11
1.90
4

141.0
2.00
4.01
-0.25
2.15
-2.15
0.43
1.90
4

144.4
2.24
5.02
0.73
2.15
-2.15
0.48
1.90
4

148.6
4.92
24.18
1.91
2.15
-2.15
1.06
1.90
4

141.1
2.61
6.79
-0.21
2.15
-2.15
0.56
1.90
4

136.9
5.44
29.58
-1.40
2.15
-2.15
1.17
1.90
4

Grand Mean

X
Sx

Grand Std Dev

Count

141.8 ERROR: this is not a balanced design the calculation is incorrect

3.5
8

p
Sr
Repeat Std Dev
Repeatability
r
%r
Repeatability %
Reproduce Std Dev SR
Reproducibility
R
Reproducibility %
%R

4.7
12.9
9.1%
5.4
14.9
10.5%

h statistics test
2.50

2.50

2.00
2.00

1.50
1.00
data
+critical value
-critical value

0.50
0.00
-0.50

1.50

1.00

-1.00
-1.50
-2.00

0.50

1.00
data
+critical value
-critical value

0.50
0.00
-0.50

1.50

1.00

-1.00
0.50

-1.50
-2.00

0.00

-2.50

130.6
154.3
2.37

117.5
122.8
128.0
133.2
138.4
143.6
148.9
154.1
159.3
164.5
169.7
5.2

0
0
0
2
4
14
8
2
1
0
0

16
14

Number of Occurances

min
max
difference

12
10
8
6
4
2
0

117.5 122.8 128.0 133.2 138.4 143.6 14

Value

10

11

12

13

14

k statistics test

data
critical value

15

16

17

18

data
critical value

0
0

0 133.2 138.4 143.6 148.9 154.1 159.3 164.5 169.7

Value

19

20

21

22

23

24

25

These data are taken from ASTM E691

Laboratory
data1
data2
data3
data4
data5
data6
data7
data8
data9
data10

1
41.03
41.45
41.37

2
41.17
42.00
41.15

3
41.01
40.68
42.66

4
39.37
42.37
42.63

5
41.88
41.19
41.32

6
43.28
40.50
42.28

7
41.08
41.27
39.02

8
43.36
42.65
41.72

Mean
Std Dev
Std Dev2
h statistic
h critical (+)
h critical (-)
k statistic
k critical
Count

41.3
0.22
0.05
-0.39
2.15
-2.15
0.21
2.06
3

41.4
0.49
0.24
-0.13
2.15
-2.15
0.46
2.06
3

41.5
1.06
1.13
-0.11
2.15
-2.15
1.00
2.06
3

41.5
1.81
3.28
-0.10
2.15
-2.15
1.70
2.06
3

41.5
0.37
0.13
-0.09
2.15
-2.15
0.34
2.06
3

42.0
1.41
1.98
0.83
2.15
-2.15
1.32
2.06
3

40.5
1.25
1.56
-1.75
2.15
-2.15
1.17
2.06
3

42.6
0.82
0.68
1.75
2.15
-2.15
0.77
2.06
3

Grand Mean

X
Sx

Grand Std Dev

Count

41.5
0.6
8

p
Sr
Repeat Std Dev
Repeatability
r
%r
Repeatability %
Reproduce Std Dev SR
Reproducibility
R
Reproducibility %
%R

1.1
2.9
7.1%
1.1
2.9
7.1%

h statistics test
2.50

2.50

2.00
2.00

1.50
1.00
data
+critical value
-critical value

0.50
0.00
-0.50

1.50

1.00

-1.00
-1.50
-2.00

0.50

1.00
data
+critical value
-critical value

0.50
0.00
-0.50

1.50

1.00

-1.00
0.50

-1.50
-2.00

0.00

-2.50

39.0
43.4
0.434

35.1
36.4
37.6
38.9
40.1
41.4
42.7
43.9
45.2
46.4
47.7
1.3

0
0
0
0
2
11
9
2
0
0
0

41.4

42

12
10
Number of Occurences

min
max
difference

8
6
4
2
0
35.1

36.4

37.6

38.9

40.1

Value

10

11

12

13

14

k statistics test

data
critical value

15

16

17

18

data
critical value

38.9

40.1

41.4

42.7

Value

43.9

45.2

46.4

47.7

19

20

21

22

23

24

25