Hypothesis Testing

Introduction to Study Skills & Research Methods (HL10040)

Dr James Betts

Lecture Outline:
What is Hypothesis Testing?

Hypothesis Formulation
Statistical Errors

Effect of Study Design

Test Procedures

Test Selection.

Statistics

Descriptive
Organising, summarising & describing data

Inferential Correlational
Relationships Significance Generalising

What is Hypothesis Testing?

Null Hypothesis

Alternative Hypothesis

We also need to establish:

1) How .. are these observations? 2) Are these observations reflective of the .?

Example Hypotheses: Isometric Torque

Is there any difference in the length of time that males and females can sustain an isometric muscular contraction?

Alternative Hypothesis
There is a significant difference in the DV between males and females.

Null Hypothesis
There is not a significant difference in the DV between males and females

Example Hypotheses: Isometric Torque

Is there any difference in the length of time that males and females can sustain an isometric muscular contraction? N N
160 140 120

Number of People

100 80 60 40 20 0 1500

n n

16

2500

Energy Intake (calories per day)

17

3500

18

4500

19

5500

20

Sustained Isometric Torque (seconds)

Statistical Errors
Type 1 Errors -Rejecting H0 when it is actually true
-Concluding a difference when one does not actually exist

Type 2 Errors -Accepting H0 when it is actually false (e.g. previous slide)

-Concluding no difference when one does exist

160 140 120

Independent t-test: Calculation

n n

Number of People

100 80 60 40 20 0 1500

16

2500

Sustained Isometric Torque (seconds)

Energy Intake (calories per day)

17

3500

18

4500

19

5500

20

Mean 18.5 17.5

SD 1.74 1.72

n 25 25

Independent t-test: Calculation

Step 1: Calculate the Standard Error for Each Mean

SEM = SD/n =

SEM = SD/n =
Mean 18.5 17.5 SD 1.74 1.72 n 25 25

Independent t-test: Calculation

Step 2: Calculate the Standard Error for the difference in means

SEMdiff = SEM2 + SEM2 =

Mean 18.5 17.5

SD 1.74 1.72

n 25 25

Independent t-test: Calculation

Step 3: Calculate the t statistic

t = (Mean - Mean) / SEMdiff =

Mean 18.5 17.5

SD 1.74 1.72

n 25 25

Independent t-test: Calculation

Step 4: Calculate the degrees of freedom (df)

df = (n - 1) + (n - 1) =

Mean 18.5 17.5

SD 1.74 1.72

n 25 25

Independent t-test: Calculation

Step 5: Determine the critical value for t using a t-distribution table Degrees of Freedom Critical t-ratio 2.015 2.013 2.011 2.009

44 46 48 50

Mean 18.5 17.5

SD 1.74 1.72

n 25 25

Independent t-test: Calculation

Step 6 finished: Compare t calculated with t critical

Calculated t = Critical t =

Mean 18.5 17.5

SD 1.74 1.72

n 25 25

Independent t-test: Calculation

Evaluation: The wealth of available literature supports that females can sustain isometric contractions longer than males. This may suggest that the findings of the present study represent a type error

Possible solution:
Mean 18.5 17.5 SD 1.74 1.72 n 25 25

Independent t-test: SPSS Output

Group Statistics Group Control Visualisation N 10 10 Mean 24.7720 26.4680 Std. Deviation 1.25246 1.92823 Std. Error Mean .39606 .60976

Swim Data
from SPSS session 8
95% Confidence Interval of the Difference Lower Upper -3.22358 -3.24188 -.16842 -.15012

SwimTime50m

Independent Samples Test Levene's Test for Equality of Variances t-test for Equality of Means

F SwimTime50m Equal variances assumed Equal variances not assumed 7.842

Sig. .012

t -2.333 -2.333

df 18 15.447

Sig. (2-tailed) .031 .034

Mean Difference -1.69600 -1.69600

Std. Error Difference .72710 .72710

Advantages of using Paired Data

200 180 160

Data from independent samples is heavily influenced by variance between subjects

Number of Press-Ups

140 120 100 80 60 40 20 0

Week

200 180 160

Paired t-test: Calculation

a paired t-test can use the specific differences between each pair rather than just subtracting mean A from mean B (see earlier step 3)
1

Number of Press-Ups

140 120 100 80 60 40 20 0

Week

Week 1 Week 2

Mean 61.6 65.5

SD 56.6 57.5

n 8 8

Paired t-test: Calculation

Subject 1 2 3 4 5 6 7 8 Week 1 10 50 20 8 115 75 45 170 Week 2 12 52 25 10 120 80 50 175 Diff (D) Diff2 (D2)

Steps 1 & 2: Complete this table

D =

D2 =

Paired t-test: Calculation

Step 3: Calculate the t statistic

D t = n x D2 (D)2 = (n - 1)

Paired t-test: Calculation

Steps 4 & 5: Calculate the df and use a t-distribution table to find t critical Critical t-ratio Critical t-ratio Degrees of Freedom (0.05 level) (0.01 level) 1 2 3 4 5 6 7 8 9 12.71 4.303 3.182 2.776 2.571 2.447 2.365 2.306 2.262 63.657 9.925 5.841 4.604 4.032 3.707 3.499 3.355 3.250

Paired t-test: Calculation

Step 6 finished: Compare t calculated with t critical

Calculated t = Critical t =

Mean Week 1 Week 2 61.6 65.5

SD 56.6 57.5

n 8 8

Paired t-test: SPSS Output

Paired Samples Statistics Mean 61.6250 65.5000 N 8 8 Std. Deviation 56.64157 57.54005 Std. Error Mean 20.02582 20.34348 Pair 1 VAR00001 VAR00002

Push-up Data from lecture 3

Paired Samples Test Paired Differences 95% Confidence Interval of the Difference Lower Upper -5.17305 -2.57695

Pair 1

Mean VAR00001 - VAR00002 -3.87500

Std. Deviation 1.55265

Std. Error Mean .54894

t -7.059

df 7

Sig. (2-tailed) .000

Example Hypotheses: Isometric Torque

Is there any difference in the length of time that males and females can sustain an isometric muscular contraction?
160 140 120

t-test
Mean A Mean B

Number of People

100 80 60 40 20 0 1500

16

2500

Energy Intake (calories per day)

17

3500

18

4500

19

5500

20

Sustained Isometric Torque (seconds)

Example Hypotheses: Isometric Torque

Is there any difference in the length of time that males and females can sustain an isometric muscular contraction?
160 140 120

Number of People

Mean A Mean B

100 80 60 40 20 0 1500

16

2500

Energy Intake (calories per day)

17

3500

18

4500

19

5500

20

Sustained Isometric Torque (seconds)

assumptions of parametric analyses

All data or paired differences are ND (this is the main consideration) N acquired through random sampling Data must be of at least the interval LOM Data must be Continuous.

Non-Parametric Tests
These tests use the median and do not assume anything about distribution, i.e. distribution free Mathematically, value is ignored (i.e. the magnitude of differences are not compared) Instead, data is analysed simply according to rank.

Non-Parametric Tests
Independent Measures
Mann-Whitney Test

Repeated Measures
Wilcoxon Test

Mann-Whitney U: Calculation
Step 1: Rank all the data from both groups in one series, then total each School A School B Student Student Grade Grade Rank Rank J. S. L. D. H. L. M. J. T. M. T. S. P. H. Median =

BBA+ DB+ AF

9 9 14 3 11 12.5 1
; RA =

T. J. M. M. K. S. P. S. R. M. P. W. A. F. Median =

D C+ C+ BE CA-

4 6.5 6.5 9 2 5 12.5

; RB =

Mann-Whitney U: Calculation
Step 2: Calculate two versions of the U statistic using:

U1 = (nA x nB) +
AND

(nA + 1) x nA 2

- RA

U2 = (nA x nB) +

(nB + 1) x nB 2

- RB

Mann-Whitney U: Calculation
Step 3 finished: Select the smaller of the two U statistics (U1 = ; U2 = ..)

now consult a table of critical values for the Mann-Whitney test

n 0.05

6
5 2

7
8 4

8
13 7

9
17 11
Conclusion

0.01

Calculated U must be critical U to conclude a significant difference

Median A Median B

Mann-Whitney U: SPSS Output

Ranks VAR00001 VAR00002 1.00 2.00 Total N 7 7 14 Mean Rank 8.50 6.50 Sum of Ranks 59.50 45.50

Test Statisticsb VAR00001 Mann-Whitney U 17.500 Wilcoxon W 45.500 Z -.900 Asymp. Sig. (2-tailed) .368 a Exact Sig. [2*(1-tailed .383 Sig.)] a. Not corrected for ties. b. Grouping Variable: VAR00002

Wilcoxon Signed Ranks: Calculation

Step 1: Rank all the diffs from in one series (ignoring signs), then total each Athlete J. S. L. D. H. L. M. J. T. M. T. S. P. H. Medians = Pre-training Post-training OBLA (kph) OBLA (kph) 15.6 17.2 17.7 16.5 15.9 16.7 17.0 16.1 17.5 16.7 16.8 16.0 16.5 17.1 Diff. Rank 0.5 0.3 -1 0.3 0.1 -0.2 0.1 6 4.5 -7 4.5 1.5 -3 1.5 Signed Ranks +

6 4.5
-7 4.5 1.5 -3 1.5

Signed Ranks =

Wilcoxon Signed Ranks: Calculation

Step 2: The smaller of the T values is our test statistic (T+ = .....; T- = )

now consult a table of critical values for the Wilcoxon test

n 0.05

6
0

7
2

8
3

9
5
Conclusion Median A Median B

Calculated T must be critical T to conclude a significant difference

Wilcoxon Signed Ranks: SPSS Output

Ranks N VAR00002 - VAR00001 Negative Ranks Positive Ranks Ties Total a. VAR00002 < VAR00001 b. VAR00002 > VAR00001 c. VAR00002 = VAR00001 2 5b 0c 7
a

Mean Rank 3.00 4.40

Sum of Ranks 6.00 22.00

Test Statisticsb VAR00002 VAR00001 Z -1.364a Asymp. Sig. (2-tailed) .172 a. Based on negative ranks. b. Wilcoxon Signed Ranks Test

So which stats test should you use?

Q1. What is the ?

Q2. Is the data .?

Q3. Is the data .. or ..?