Beruflich Dokumente
Kultur Dokumente
2
Textbook Credits
Textbook
Shavelson, R.J. (1996). Statistical reasoning for the behavioral
sciences (3rd Ed.). Boston: Allyn & Bacon.
Supplemental Material
Ruiz-Primo, M.A., Mitchell, M., & Shavelson, R.J. (1996).
Student guide for Shavelson statistical reasoning for the
behavioral sciences (3rd Ed.). Boston: Allyn & Bacon.
3
Statistical Software
Excel
MegaStat
Minitab
SPSS
JMP
POM/QM
StatCrunch
4
Research Defined
Research is doing ones damnedest to answer perplexing
questions
Or research is a systematic approach to finding answers to
questions
Scientific research, our focus, seeks answers to questions
empirically and by inference, ruling out counter-interpretations
to the one justified by the data
With the scientific method, problems are formulated,
hypotheses are identified, data are collected, inferences are
drawn about which hypothesis is more credible
The purpose of empirical research, therefore, is to provide
answers to questions about behavior using the scientific method
5
Statistics Defined
Statistics is the science of conducting studies to collect, organize,
summarize, analyze, and draw conclusions from data.
Descriptive statistics consists of:
the collection
Organization
Summarization
presentation of data
Inferential statistics consists of:
generalizing from samples to populations
performing estimations
hypothesis testing
determining relationships among variables
making predictions
6
Research Questions/Steps in Conducting Research
Research Questions
What is happening?
Is there a systematic (causal) effect?
Why or how is it happening (mechanism)?
7
Data Collection and Sampling Techniques
Surveys are the most common method of collecting data. Three
methods of surveying are:
Telephone surveys
Mailed questionnaire surveys
Personal interviews
8
Some Terminology
Variable: is a characteristic or attribute that can assume different values(height,
ability)
Data are the values that variables can assume.
Random variables have values that are determined by chance.
A population consists of all subjects that are being studied.
A sample is a group of subjects selected from a population.
Random samples are selected using chance methods or random methods.
Independent Variable(Factor/Treatment): A variable that is measured , manipulated
(type of instruction), or selected (e.g., sex) to determine its relationship to some other
observed variable.
Control Variable: A variable which is held constant (or is controlled) to neutralize its
effect on the dependent variable because it is not the focus of the study (e.g., control
on sex in a reading study)
Intervening Variable: A conceptual or theoretical variable that accounts for the
relation between independent and dependent variable; an explanation for the
relation or a hypothesized mechanism that accounts for the relation.
Dependent Variable(Response): A variable that is observed and measured to
determine its response to the independent variable (i.e., dependent on the
independent variable)
9
Measurement Scales
Nominalclassifies data into mutually exclusive (non-
overlapping), exhausting categories in which no order or ranking
can be imposed on the data.
Ordinalclassifies data into categories that can be ranked;
however, precise differences between the ranks do not exist.
Intervalranks data, and precise differences between units of
measure do exist; however, there is no meaningful zero.
Ratiopossesses all the characteristics of interval measurement,
and there exists a true zero.
10
Measurement Scales: Classification of Data
11
Some Terminology: Summation Notation
Summation notation is mathematical notation commonly
used in statistics
Its really simple if you pause, take a deep breath, relax and
enjoy it a little patience goes a long ways
N
Mean X X p / N ( X 1 X 2 ... X p ... X N ) / N
p 1
12
Research Designs
Pre-experimental Designs
One-shot Case Study (Treatment group only)
One Group Pretest to Posttest Designmeasures of change
Intact Group Comparison at posttest
Experimental Designs
Random assignment to treatment & control group
Posttest Only Control Group
Pretest-Posttest Control Group
Factorial
Quasi-experimental Designs
Non-random assignment to treatment & control group observed
Nonequivalent-Control Group Design
Time-Series Design
Ex-Post Facto Designs
Statistical controls for comparing alternative treatments
Correlational Design
Criterion-Group Design
14
Pre-experimental Designs
One-shot Case Study (Treatment group only)
X O
Example:
X is a new personnel policy, a job satisfaction measurement is taken, and then a response is observed
O1 X O2
Example:
A job satisfaction measurement is taken before and after treatment X is applied
G2 Control O
Example:
G1 receives the treatment, G2 does not; then a job satisfaction measurement is taken and observed
(in this case G1 and G2 may represent two different business units)
15
Experimental Designs
Random assignment to treatment & control group
Posttest Only Control Group Pretest-Posttest Control Group
X O O1 X O2
Control O O1 Control O2
Factorial
X2
X1 O
X2
Control O
Example:
A job satisfaction measurement is taken after treatment X1 is applied or not and graveyard shift
X2 is implemented
16
Quasi-experimental Designs
Non-random assignment to treatment & control group observed.
Include one or more control groups.
Nonequivalent-Control Group Design
G1 O1 X O2
G2 O1 Control O2
Subjects receive a pretest (O1) treatment or non-treatment and then receive a posttest (O2)
Time-Series Design
O1 O2
Multiple observations are taken before and after a treatment is administered. Pretreatment
observations establish a control group baseline. Post-treatment observations establish a consistent
change in response.
17
Ex-Post Facto Designs
Statistical controls for comparing treatment and control
(relationships between two variables). Called ex-facto because the
researcher arrives after the treatment has been administered.
Correlational Design
O1 O2
Criterion-Group Design
G1 O
G2 O
Group 2 is compared to Group 1
18
Threats to Internal Validity
History:
- something co-occurring with the treatment caused the outcome
Maturation
- maturation, not the treatment, caused the outcome
Mortality
- loss of poorly performing subjects from a group caused the outcome
Statistical Regression
- extreme groups are likely to improve on retesting
Selection bias
- the differences in outcomes existed before the treatments were given
Instrumentation
- outcome measure not reliable, valid, or both
Testing
- pretest cued subjects to outcome measure
Stability
- Type I Error
19
History Threat
Treatment (X)
Control
20
Maturity Threat
Treatment (X)
21
Mortality Threat
Treatment (X)
22
Regression Threat
Treatment (X)
23
Selection Threat
Treatment (X)
Initial difference
exist in groups
Control
24
Instrumentation Threat
? Treatment (X) ?
25
Testing Threat
Pretest
Treatment (X)
26
Testing Threat
H0 True H0 False
Type I
Reject Error Correct
H0 producers risk Decision
(a)
Type II
Do not reject Correct Error
H0
Decision consumers
risk
(b)
A type I error occurs if one rejects the null hypothesis when it is true.
A type II error occurs if one does not reject the null hypothesis when it is false.
27
Ideal Model
Experimental Design
(Control Group + Random Assignment)
Treatment (X)
Randomly
Assigned
Control
28
Practice Exercises
29