Experimental Design

Types - Broad Distinction

Qualitative

Quantitative

Qualitative Research
Narrative

Subjects own words Summarizes behaviors

Descriptive

Methods

Interviews Observation notes Surveys

Quantitative Research
Numerical

data collected & analyzed Explores relationship between variables

Independent (single or multi-leveled) Dependent (single or multiple)
Analysis may permit exploration of an interaction between variable

Experimental or quasi-experimental

Experimental Designs
Characterized

by complete random assignment of groups or subjects Groups are independent Usually employs strong control

Quasi-Experimental Designs
Groups May

or subjects not randomly assigned

e.g., sample of convenience

not have a comparison group Typical of clinical research

e.g., within subjects repeated measures
Less

subject-intensive

Broad Distinctions
Between

subjects

Dependent measures taken one time Data are independent (i.e., not correlated)
Within

subjects

A repeated measures design Dependent measures taken multiple times Data are dependent
Mixed

Between and within

Design Types
Single

factor (one-way)

Studies one independent variable

Multi-factor

Studies multiple independent variables

May have several levels

Examples:
Two-way (e.g., 2 x 2) Three-way (e.g., 2 x 2 x 2) Time-series

Single Factor Designs

Pretest-posttest

(one-group) Pretest-posttest (control group) Posttest-only (control group)

Pretest-Posttest (one group)

Quasi-experimental One Analysis

set of measures taken before and after treatment or intervention Compare pretest and posttest scores

paired t test
Weakness

No comparison or control group

Pretest-Posttest (control group)

Experimental

design random assignment Two groups

Control Experimental
Measures

Significant

on dependent variable made on both groups pre- and posttest

differences in experimental group not found in control group attributable to treatment Analysis
difference scores compared with independent t test ANCOVA pretest score as covariate

Multiple Factor Designs

Two-way

factorial factorial

e.g., 2 x 3
Three-way

e.g., 2 x 2 x 3

Two-Way Factorial Design

Studies

multiple independent variables

Example: 2 x 3
ME2 L2 L3

L1 Main effects (ME) Each with a number of L1 levels (L) ME1 L2 Permits study of

interactions Analysis
ANOVA

Three-Way Factorial Design

Studies

multiple independent variables

Main effects (ME) Multiple levels (L) Interactions effects

Example 2 x 2 x 3
ME 2 L1 L1 ME1 L2 L1 L2 ME3 L3 L2

Analysis
ANOVA Post hoc pairwise comparisons

Counterbalanced Design
Possibility

of order effects biasing data in a repeated measures design Solutions

Randomize order Counterbalance trials - order systematically varied
Example - two treatments (T1 - T2) Crossover design
Half of subjects - T1 then T2 Half of subjects - T2 then T1

Latin Square Design

Minimizes

order

effects
Subject 1 Subject 2 Subject 3

Test session
1 A B C 2 B C A 3 C A B

Single Subject Design

Permits

analysis of effects of treatment in individual subjects (or groups) Elements

Subjects usually own control Repeated measures Design phases (times series analysis)

Single Subject Design

Time series analysis

Dependent measure is continuous Establish baseline Measure treatment effect over time Baseline
Time

Treatment

Case Report
Subject

a single individual Often uses a narrative format May be non-experimental or experimental

Develops a profile of the subject using: Visual observation Interviews/surveys/questionnaires Objective data

May

provide generalizations about other subjects with similar conditions