Beruflich Dokumente
Kultur Dokumente
Objectives:
Students should be able to identify the null and alternative (research) hypotheses in a statistical test Students should know the difference between one-and two-directional hypothesis testing Students should know what alpha, beta, power, and p-values are Students should be able to identify/define type I and type II errors Students should understand the differences between statistical significance and clinical importance Students should know how to determine statistical significance given alpha and a calculated p-value OR given alpha and a corresponding confidence interval
Hypothesis Testing
The second type of inferential statistics
Hypothesis testing is a statistical method used to make comparisons between a single sample and a population, or between 2 or more samples. The result of a statistical hypothesis test is a probability, called a p-value, of obtaining the results (or more extreme results) from tests of samples, if the results really werent true in the population.
Hypothesis Testing
In all hypothesis testing, the numerical result from the statistical test is compared to a probability distribution to determine the probability of obtaining the result if the result is not true in the population.
-4
-3
-2
-1
NonRejection Region
NonRejection Region
Directional (one-tailed): H0: Male Age Female Age HR: Male Age > Female Age (or the opposite)
NonRejection Region Rejection Region 5.0%
Beta is directly related to the power of a statistical test: Power is the probability of correctly rejecting the null hypothesis when it is false. Power = 1 - Beta A type II error occurs when a false null hypothesis is accepted.
P-values
P-values are the actual probabilities calculated from a statistical test, and are compared against alpha to determine whether to reject the null hypothesis or not. Example:
alpha = 0.05; calculated p-value = 0.008; reject null hypothesis
Hypothesis Testing
Male Female
Test statistic:
(x1 x 2 ) t SE (x1 x 2 )
Does age of onset of paranoid schizophrenia differ for males and females? calculated test statistic: t = -1.142
Critical value of t for alpha = 0.05: + 1.960 The computed value of t does not exceed the critical value so the null hypothesis of no difference in age is not rejected (the p value is greater than 0.05) Conclusion: The mean age of onset is not different for males versus females
Is the post treatment mortality different for patients receiving CABG compared to patients receiving PTCA?
There are a number of statistical tests that can be used: 2 examples are 1) chi-square test, or 2) z test for proportions. The resulting p values will be the same regardless of the test used. The researchers used a z test: the p value from the test was 0.3508.
Is the post treatment mortality different for patients receiving CABG compared to patients receiving PTCA?
The p value is 0.3508 this is >0.05, so the conclusion from the study is that there is no difference
If there is truly no difference between CABG and PTCA, the probability of obtaining the difference of 0.6% is ~35%
Hypothesis Testing
Step 4 Draw conclusion about the population based on the results of the statistical test on the sample
Statistical conclusion: the results either are or are not statistically significant
BUT You need to interpret the results in a meaningful (and not just statistical) way
Principles for Statistical Significance 1. The size of a p value does not indicate importance of the result. 2. Interpret nonsignificance cautiously. a. finding no difference may be important b. statistically nonsignificant clinically unimportant 3. Results may be statistically significant but clinically trivial.
There is a direct relationship between levels of alpha set for a statistical test and the level set for constructing a confidence interval. For example, alpha = 0.05 for a 2-sided statistical test is equivalent to a 95% confidence interval
NonRejection Region
Statistical significance can be obtained from a confidence interval as well as a hypothesis test
AND
Confidence intervals convey more information than p values For this reason, most medical journals now prefer that results be presented with confidence intervals rather than p values.
If the NULL VALUE for a statistical hypothesis test using alpha = 0.05 is contained within the 95% confidence interval, we can conclude NO statistical significance at alpha = 0.05 without doing the hypothesis test:
P Values vs. Confidence Intervals Example: Male Female n 12 12 mean age 26.8 29.6 SD 5.8 6.2
The difference in age obtained from the sample is: 26.8-29.6 = -2.8 years The standard error of the difference is 2.45 (calculation not shown)
The 95% confidence interval is: -2.8 +/- 2(2.45) = -2.8 +/- 4.9 = -7.7 to 2.1 years
The 95% confidence interval is: -2.8 +/- 2(2.45) = -2.8 +/- 4.9 = -7.7 to 2.1 years This means that the true population mean difference in age is somewhere between males being 7.7 years younger to males being 2.1 years older than females
The 95% CI includes 0 years, so there is no statistically significant difference in age. In addition, we have information about the precision of our estimate of the difference, which cannot be obtained from p values alone.
Note: This is a relatively wide confidence interval because the sample size is small
This confidence interval contains the value zero; therefore, we could have concluded that the mortality is not different based on the confidence interval alone.
For ratio variables, such as relative risk and odds ratio, the value one represents equality. The null hypothesis is that the ratio is equal to one: If the 95% CI includes the value one, the difference is not statistically significant at alpha = 0.05.