Experimental Research

Chapter 8

Introduction
Explanatory research

Research that seeks to explain the cause of a phenomenon, and typically asks what causes what? or why is it this way?

Introduction
Causal hypothesis

A testable expectation about an independent variables affect on a dependent variable

Introduction

Causal hypotheses and experimental designs

1.
2. 3.

Empirical association Temporal precedence or time order Non-causal relationship

Introduction
Causal hypotheses and experimental

designs

Experimental designs

A study design in which the independent variable is controlled, manipulated, or introduced in some way by the researcher

Introduction
The classic experiment: Data collection

technique or study design?

In experimental design the independent variable is introduced, manipulated, or controlled

What does this mean?

The independent variable does not occur naturally, but it is the result of an action taken by the researcher Unique feature of the classic experimental design The researcher controls the placement of sample members into two or more categories of the independent variable

Introduction
The classic experiment: Data collection

technique or study design?

If practical and ethical, a study can be designed so that the dependent variable is measured first and then, the independent variable is introduced or manipulated and, finally, the dependent variable is measured again.

Can see whether the introduction of the independent variable comes before change in the dependent variable.

Experimental Designs
Control group

Exposed to all the influences that the experimental group is exposed to except for the stimulus

Experimental Designs
Stimulus The experimental condition of the independent variable that is controlled or introduced by the researcher in an experiment The researcher tries to treat the two groups exactly

alike, except instead of the stimulus, the control group receives no treatments, an alternative treatment, or a placebo

Experimental Designs
Placebo

A simulated treatment of the control group that is designed to appear authentic

Experimental Designs
Internal validity

Agreement between a studys conclusions about causal connections and what is actually true

Experimental Designs
Experimental design

pretest-posttest control group experiment

Classic controlled experiment

An experimental design with two or more randomly selected groups (an experimental and control group) in which the researcher controls or introduces the independent variable and measures the dependent variable at least two times (pretest and posttest measurement)

Experimental Designs
Experimental design

pretest-posttest control group experiment

Pretest

The measurement of the dependent variable that occurs before the introduction of the stimulus of independent variable

Experimental Designs
Experimental design

pretest-posttest control group experiment

Posttest

The measurement of the dependent variable that occurs after the introduction of the stimulus or the independent variable

Experimental Designs
Experimental design

pretest-posttest control group experiment

Probability sampling

A sample that gives every member of the population a known (nonzero) chance of inclusion

Experimental Designs

Experimental design pretest-posttest control group experiment

Random Assignment

A technique for assigning members of the sample to experimental and control groups by chance to maximize the likelihood that the groups are similar at the beginning of the experiment
This can be done by flipping a coin to determine which subject is assigned to which group Assign each subject a number and using either a random number table or electronic random number generator to select members of each group

Experimental Designs

Experimental design pretest-posttest control group experiment

Matching

Assigning members of the sample to groups by matching members of the sample on one or more characteristics and separating the pairs into two groups with one group randomly selected to become the experimental group

Experimental Designs

Experimental design pretest-posttest control group experiment

1.

2.

The study uses at least one experimental and one control group, selected using a strategy to make the groups as similar as possible The dependent variable is measured at least two time for the experimental and control groups. The first measurement is before and the second is after the independent variable is introduced

Experimental Designs
Experimental design

pretest-posttest control group experiment

3. The independent variable is introduced, manipulated, or controlled by the researcher between the two measurements of the dependent variable. 4. The differences in the dependent variable between the pretest and posttest are calculated for the experimental group(s) and for the control group. The differences in the dependent variable for the experimental and control groups are compared.

Experimental Designs

Experimental Designs

Internal validity and experiments Maturation

The biological and psychological processes that cause people to change over time

Experimental Designs

Internal validity and experiments Testing effect

The sensitizing effect on subjects of the pretest

Experimental Designs
Internal validity and experiments
History

The effects of general historical events on study participants

Experimental Designs
Internal validity and experiments
Selection

bias

A bias in the way the experimental and control or comparison groups are selected that is responsible for preexisting differences between the groups.

Experimental Designs
Posttest-only control group experiment

An experimental design with no pretest

Either because it is not possible to do a pretest or because of a concern that using a pretest would sensitize the experimental group to the stimulus Same design elements as other experiments: control of manipulation of the stimulus and two or more groups using random selection or assignment

Experimental Designs
Extended experimental design

Solomon four-group design

A controlled experiment with an additional experimental and control group with each receiving a posttest only

Experimental Designs

Experimental Designs
Quasi-experimental design

An experimental design that is missing one or more aspects of a true experiment Most frequently random assignment into experimental and control groups Used when it is not ethical or practical to do a controlled experiment

Experimental Designs
Experiments in the field

Field experiment

An experiment done in the real world of classrooms, offices, factories, homes, playgrounds, and the like

Experimental Designs
Experiments in the field

Generalizability

The ability to apply the results of a study to groups or situations beyond those actually studied

Focal Research
A Field Experiment in the Classroom by Chris

Caldeira

Hypothesized that using film clips to teach sociological concepts in conjunction with the textbook and lecture is more effective in helping students learn core concepts than the lecture and textbook without the clips.

Experimental Designs
Experiments in the laboratory

Laboratory research

Research done in settings that allows the researcher control over the conditions, such as in a university or medical setting Research examples
Hobza and Aaron Rochlen (2009) Bushman and Anderson (2009)

Experimental Designs
Experiments in the laboratory

Important to evaluate a studys external validity or the ability to generalize the results from the laboratory to the real world

Experimental Designs
Experiments in the laboratory

External Validity Issues to Consider

1. 2. 3.

4.

Was the situation very artificial, or did it approximate real life? How different were study participants from other populations? To what extent did the participants believe that they were up for inspection, serving as guinea pigs or play acting, or have other feelings that would affect responses to the stimulus? To what extent did the researcher communicate his or her expectations for results to the subjects with verbal or nonverbal cues?

Experimental Designs
Experiments in the laboratory

Experimenter expectations

When expected behaviors or outcomes are communicated to subjects by the researcher

One way to handle the issue of experimenter expectations is to use a double-blind experiment.

Experimental Designs
Experiments in the laboratory

Double-blind experiment

An experiment in which neither the subjects nor research staff who interact with them knows the memberships of the experimental or control groups.

Experimental Designs
Natural experiments

A study using a real-work phenomena that approximates an experimental design even though the independent variable is not controlled, manipulated, or introduced by the researcher

Experimental Designs
Natural experiments

Wars, hurricanes, & political events might effect some groups and not others. Example

Studying the of deployment on military families

The researcher cannot control deployment, but two groups could be created by those families who were deployed and those families who were not deployed

Comparing Experiments to Other Designs

Many research questions cannot be studied

using experimental design

Large samples are required Not practical, ethical, and possible to manipulate the independent variable In these scenarios researchers may consider panel, trend, cross-sectional, or case study designs

Summary
Study design options

Refer to Table 8.2 - Summary of Design Studies Ethical considerations Practicality

Issues to consider in designing a study

Time Cost Feasibility of controlling the independent variable

Quiz Question 1
An experimental design has the advantage over non-experimental approaches of determining the order in which events occur and
a. b. c. d.

controlling the effects of other variables. minimizing the costs of the research. accommodating ethical concerns. proving conclusively that a relationship is causal.

Quiz Question 2
In a classic experimental design, it is important to take measures of control and experimental groups
a. b. c. d. e.

before and after treatment. at least once during the research. after the treatment. before the treatment. it is not important to take measures.

Quiz Question 3
In experimental designs, it is important that the control group and the experimental group
a. b.

c. d.

are as similar as possible. represent very different groups so that the research is generalizable. do not come from the same background. receive the same treatment.