Exploring

Marketing Research

William G. Zikmund

Chapter 11:
Experimental Research
 Experiment

• A research investigation in which conditions are

controlled
• One independent variable is manipulated
(sometimes more than one)
• Its effect on a dependent variable is measured
• To test a hypothesis
 Basic Issues of Experimental
Design
• Manipulation of the Independent Variable
• Selection of Dependent Variable
• Assignment of Subjects (or other Test
Units)
• Control Over Extraneous Variables
The experimenter has some degree of
control over the independent variable.
The variable is independent because its
value can be manipulated by the
experimenter to whatever he or she
wishes it to be.
 Experiment Treatment

Alternative manipulations of the

independent variable being
investigated
 Independent Variable

• The experimenter controls independent

variable.
• The variable’s value can be
manipulated by the experimenters to
whatever they wish it to be.
 Manipulation of Independent
Variable
• Classificatory vs. continuous variables
• Experimental and control groups
• Treatment levels
• More than one independent variable
 Experimental Treatments
• The alternative manipulations of the
independent variable being investigated
 Dependent Variable

• Its value is expected to be dependent

on the experimenter’s manipulation
• Criterion or standard by which the
results are judged
 Dependent Variable

• Selection
– e.g... sales volume, awareness, recall,
• Measurement
 Test Units
• Subjects or
entities whose
response to the
experimental
treatment are
measured or
observed.
 Two Types of Experimental
Error
• Constant errors
• Random errors
 Field versus
Laboratory Experiments
Controlling Extraneous Variables
• Elimination of extraneous variables
• Constancy of conditions
• Order of presentation
• Blinding
• Random assignment
 How May an Experimenter control for
Extraneous Variation?
• Eliminate Extraneous Variables
• Hold Conditions Constant
• Randomization
• Matching Subjects
Establishing Control
 Demand Characteristics
• Experimental procedures that intentionally
hint to subjects something about the
experimenter’s hypothesis
 Demand Characteristics

• Guinea pig effect

• Hawthorne effect
Field vs. Laboratory Experiment
Laboratory Experiment Field Experiment

Artificial-Low Realism Natural-High Realism

Few Extraneous Many Extraneous

Variables Variables
High control Low control

Low Cost High Cost

Short Duration Long Duration

Subjects Aware of Subjects Unaware of
Participation Participation
 Control Groups
Isolate
extraneous
variation
 When does an Experiment have
Internal Validity?
Internal Validity - The ability of an
experiment to answer the question whether
the experimental treatment was the sole
cause of changes in a dependent variable

Did the manipulation do what it was supposed

to do?
 Factors Influencing Internal
Validity
• History
• Maturation
• Testing
• Instrumentation
• Selection
• Mortality
 Isolating Extraneous Variation
with a Control Group
• History Effects
• Maturation Effects
• Mortality Effects
Type of Extraneous Variable Example

History - Specific events in the A major employer

environment between the Before closes its plant in
and After measurement that are test market area
beyond the experimenter’s control

Maturation - Subjects change Subjects become

during the course of the experiment tired

Testing - The Before measure alerts Questionnaire

or sensitizes subject to nature of about the traditional
experiment or second measure. role of women
triggers enhanced
awareness of women
in an experiment.
Instrument - Changes in New questions about
instrument result in response bias women are interpreted
differently from earlier
questions.

Selection - Sample selection Control group and

error because of differential experimental group is
selection comparison groups self-selected group
based on preference for
soft drinks

Mortality - Sample attrition; some Subjects in one group

subjects withdraw from experiment of a hair dying study
marry rich widows and
move to Florida
How can Internal Validity
Increase?
Increasing Internal Validity

• Control group

• Random assignment

• Pretesting and posttesting

• Posttest only
What are the Different Basic
Experimental Designs?
 Quasi-Experimental Designs
• One Shot Design (After Only)
• One Group Pretest-Posttest
• Static Group Design
One Shot Design (After Only)
X O1
One Group Pretest-Posttest
O1 X O2
 Static Group Design
Experimental Group X O1
Control Group O2
Three Good Experimental Designs

• Pretest - Posttest Control Group Design

• Posttest Only Control Group

• Solomon Four Group Design

Pretest-Posttest Control Group Design

Experimental Group R O1 X O2

Control Group R O3 X O4
Posttest Only Control Group

Experimental Group R X O1

Control Group R O2
 One-Shot Design
Internal Validity Problems
• History • Instrumentation
– weak – not relevant
• Maturation • Selection
– weak – weak
• Testing • Mortality
– not relevant – weak
One-Group Pretest-Posttest
Internal Validity Problems
• History • Instrumentation
– weak – weak
• Maturation • Selection
– weak – controlled
• Testing • Mortality
– weak – controlled
 Static-Group Design
Internal Validity Problems
• History • Instrumentation
– controlled – controlled
• Maturation • Selection
– possible source of – weak
concern • Mortality
• Testing – weak
– controlled
 Pretest-Posttest Control
Internal Validity Problems
• History • Instrumentation
– controlled – controlled
• Maturation • Selection
– controlled – controlled
• Testing • Mortality
– controlled – controlled
Solomon Four-Group Design
Internal Validity Problems
• History • Instrumentation
– controlled – controlled
• Maturation • Selection
– controlled – controlled
• Testing • Mortality
– controlled – controlled
 Posttest-Only Control
Internal Validity Problems
• History • Instrumentation
– controlled – controlled
• Maturation • Selection
– controlled – controlled
• Testing • Mortality
– controlled – controlled
Solomon Four Group Design

Experimental Group 1: R O1 X O2
Control Group 1: R O3 O4
Experimental Group 2: R X O5
Control Group 2: R X O6