Beruflich Dokumente
Kultur Dokumente
Fundamentals, Interpretation,
and Research Topics
Kevin M. Sowinski, Pharm.D., FCCP
Purdue University College of Pharmacy
Indiana University School of Medicine
West Lafayette and Indianapolis, Indiana
Study Designs: Fundamentals, Interpretation, and Research Topics
Study Designs:
Fundamentals, Interpretation,
and Research Topics
Kevin M. Sowinski, Pharm.D., FCCP
Purdue University College of Pharmacy
Indiana University School of Medicine
West Lafayette and Indianapolis, Indiana
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-381
Study Designs: Fundamentals, Interpretation, and Research Topics
Learning Objectives severe myopathy were sent to the U.S. Food and Drug
Administrations (FDAs) MedWatch program. Risk
1. D efine, compare, and contrast the concepts of factors for statin-induced myopathy were not assessed;
internal and external validity, bias, and confound- however, both the cases and the controls of this study
ing in clinical study design. had identical diagnostic evaluations and were stratified
2. Identify potential sources of bias in clinical trials; according to the duration of statin use before the onset
select strategies to eliminate or control for bias. of myopathy.
3. Outline the hierarchy of evidence generated by
various study designs. 1. W
hich type of bias is this study design most sus-
4. Compare and contrast the advantages and disad- ceptible to?
vantages of various study designs (e.g., prospective; A. Confounding by indication.
retrospective; case-control; cohort; cross-sectional;
B. Recall bias.
randomized controlled clinical trials; systematic
review; meta-analysis). Delineate the difference C. Diagnostic bias.
between parallel and crossover study designs. D. Misclassification.
5. Select from various biostatistical measures to
appropriately compare groups or their assessments 2. W
hich factor will be most affected by the type of
from various study designs and use their findings/ bias likely to occur in this study?
output to interpret results. A. External validity.
6. Define and evaluate odds, odds ratio, risk/incidence
B. Internal validity.
rate, risk ratio/relative risks (RRs), and other risk
estimates. Compute and evaluate number needed C. Assessment of exposure.
to treat and number needed to harm. Define and D. Number of patients needed for the study.
calculate terms such as point and period preva-
lence, incidence rate, prevalence rate, absolute risk 3. W
hen describing the results of a randomized con-
difference, and RR difference. trolled clinical trial, the investigators report using
7. Define and calculate terms such as true positive, an intention-to-treat analysis to analyze their data.
false positive, true negative, false negative, sensi- The results of their investigation comparing two
tivity, specificity, positive predictive value, nega- diuretics for heart failure show no difference in
tive predictive value, positive likelihood ratio, and the number of hospitalizations for decompensated
negative likelihood ratio. heart failure between the treatment groups. Given
8. Define research and differentiate it from quality their method of data analysis, which statement is
improvement activities. most appropriate?
9. Define the composition, functions, and roles of the A. M
ay be susceptible to issues regarding recall
institutional review board (IRB). bias.
10. Describe the various steps of the professional writ- B. P
rovides a good measure of effectiveness
ing and peer-review processes. under typical clinical conditions.
C. C
annot provide an estimate of the methods
effectiveness.
Self-Assessment Questions
Answers and explanations to these questions may be D. May overestimate the actual treatment effect.
found at the end of the chapter.
4. A
prospective randomized study compared once-
Questions 1 and 2 pertain to the following case. daily enoxaparin with twice-daily enoxaparin
A recently released statin is associated with less myop- when treating patients with venous thromboembo-
athy than other currently available statins. After 2 years lism (VTE). One of the study end points was the
of use, a retrospective case-control study was under- recurrence of VTE. The following table summa-
taken by the manufacturer after 20 different reports of rizes recurrence rates in all patients.
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-382
Study Designs: Fundamentals, Interpretation, and Research Topics
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-383
Study Designs: Fundamentals, Interpretation, and Research Topics
D. T
he odds of developing cardiovascular events
when treating hypertension with low doses of
diuretics are lower than when using calcium
channel blockers.
9. A
ccording the Code of Federal Regulations, which
statement best describes what is required of IRB
membership?
A. At least one layperson must serve on the IRB.
B. T
he size of IRB membership changes depend-
ing on the institution size.
C. At least 10 members serve on the IRB.
D. There must be one physician on the IRB.
10. A
s a resident who recently completed a research
project, you are writing the introduction section of
the paper. Which piece of information should best
be included in this section?
A. I nformation related to process for the selection
of participants.
B. Summary of prior studies.
C. The average age of the study subjects
D. Acknowledgments to clerical staff.
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-384
Study Designs: Fundamentals, Interpretation, and Research Topics
I. INTRODUCTION
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-385
Study Designs: Fundamentals, Interpretation, and Research Topics
RCT
Cohort
Case-Control
Cross-Sectional
Case Series
Case Reports
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-386
Study Designs: Fundamentals, Interpretation, and Research Topics
F. Causality
1. Temporality: Cause before effect
2. Strength: Plausibility increases with strength of relationship
3. Biological gradient: Dose-response?
4. Consistency: Observations over several settings
5. Specificity: Single cause for effect
6. Plausibility: Biologically plausible
7. Coherence: Consistency with existing knowledge
8. Analogy: Preclinical expectation applied to clinical testing
9. Experiment: Randomized controlled trials
A. D
ocument and Describe Experiences, Novel Treatments, and Unusual Events. Allows hypothesis generation
that can be tested with other study designs. Note that the title does not state study.
1. Possible adverse drug reactions in one or more patients: QT-interval prolongation associated with
fluoroquinolone antibiotics
2. Case report: One patient
3. Case series: More than one patient with a similar experience or many case reports combined into a
descriptive review
4. Reports should provide sufficient detail to allow readers to recognize same/similar cases at their center/
practice.
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-387
Study Designs: Fundamentals, Interpretation, and Research Topics
A. D
esign Does Not Involve Investigator Intervention, Only Observation. It is essential to remember that
observational study designs investigate associationsnot, in most cases, causes.
B. Case-Control Study: Study Exposure in Those with and without the Outcome of Interest
Classify and Compare Begin
Risk
Factor
Present Cases
Subjects With
Risk Condition of Interest
Factor
Absent
Risk
Factor
Present Cases
Subjects Without
Condition of Interest
Risk
Factor
Absent
Past Present
Figure 2. Case-control study design.
1. D etermine the association between exposures/risk factors and disease/condition. Classic example:
Aspirin use and Reye syndrome
2. Retrospective studies
3. Useful method (and perhaps the only practical way) to study exposures in rare diseases or diseases that
take long periods to develop
4. Critical assumptions to minimize bias
a. Cases are selected to be representative of those who have the disease.
b. Controls are representative of the general population that does not have the disease and are as iden-
tical as possible to the cases, minus the presence of the disease.
c. Information is collected from cases and controls in the same way.
5. Examples
a. Risk of myocardial infarction associated with antihypertensive drug therapies (JAMA 1995;274:
620-5)
b. Phenylpropanolamine (PPA) and the risk of hemorrhagic stroke (N Engl J Med 2000;343:1826-32).
Purpose of study:
i. To estimate in women the association between hemorrhagic stroke and the use of appetite
suppressants containing PPA
ii. To estimate the association between any use of PPA (in appetite suppressant or cough or cold
remedy) and hemorrhagic stroke
iii. To estimate in men and women the association between hemorrhagic stroke and the type of
exposure to PPA
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-388
Study Designs: Fundamentals, Interpretation, and Research Topics
C. Cohort Study
1. Determines the association between exposures/factors and disease/condition development. Allows an
estimation of the risk of outcome (and the RR between the exposure groups). Study outcome of interest
in those with and without the exposure of interest. Classic examples follow:
a. Framingham Study. A cohort of subjects from Framingham, Massachusetts, were (and are)
studied over time to evaluate the relationship between a variety of conditions (exposures) on the
development of cardiovascular disease.
b. Nurses Health Study: Investigated the potential long-term consequences of the use of oral
contraceptives
2. Describes the incidence or natural history of a disease/condition and measures it in time sequence
3. Retrospective (historical): Begins and ends in the present but involves a major backward look to
collect information about events that occurred in the past
Measure Outcomes
Begin Measure/Classify and Compare
Outcome
Present
Subjects With
Risk Factor
Outcome
Absent
Study Sample
Outcome
Subjects Without
Present
Population Risk Factor
Outcome
Absent
Subjects have Outcome
(EXCLUDED)
Past Present
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-389
Study Designs: Fundamentals, Interpretation, and Research Topics
a. A dvantages: Less expensive and time-consuming; no loss to follow-up, ability to investigate issues
not amenable to a clinical trial or ethical or safety issues
b. Disadvantages: Only as good as the data available, little control of confounding variables through
nonstatistical approaches, recall bias
4. Prospective or longitudinal: Begin in the present and progress forward, collecting data from subjects
whose outcomes lie in the future
Measure Outcomes
Begin Measure/Classify and Compare
Outcome
Present
Subjects With
Risk Factor
Outcome
Absent
Study Sample
Outcome
Subjects Without
Present
Population Risk Factor
Outcome
Absent
Subjects have Outcome
(EXCLUDED)
Present Future
a. E xample: Prospective, observational study: Postmenopausal hormone use and secondary preven-
tion of coronary events in the Nurses Health Study (Ann Intern Med 2001;135:1-8)
b. Advantages: Can control for confounding factors to a greater extent, easier to plan for data collection
c. Disadvantages: More expensive and time-intensive, loss of subject follow-up, difficult to study rare
diseases/conditions at a reasonable cost
5. Measure of association: RR: The risk of an event or development of a condition relative to exposure;
the risk of someone developing a condition when exposed compared with someone who has not been
exposed
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-390
Study Designs: Fundamentals, Interpretation, and Research Topics
A. Incidence
1. Measure of the probability of developing a disease
2. Incidence rate: Number of new cases of disease per population in a specified time
3. Calculated by dividing the number of individuals who develop a disease during a given period by the
number of individuals who were at risk of developing a disease during the same period
B. Prevalence
1. Measure of the number of individuals who have a condition/disease at any given time
2. Point prevalence: Prevalence on a given date
3. Period prevalence: Prevalence in a period (e.g., year, month)
C. Interpreting RRs/ORs
1. Estimate the magnitude of association between exposure and disease. Key point: For observational
studies, this is not cause and effect; it is an association.
2. The incidence of disease in the exposed group divided by the incidence of disease in the unexposed
group
3. The RR (a.k.a. risk ratio) cannot be directly calculated for most case-control studies; instead, the OR is
usually an estimate of the RR.
4. The RR and OR are interpreted on the basis of their difference from unity (1.0). If the 95% CI includes
unity, no statistical difference is indicated. The CI also gives us an idea of the spread within which the
true effect lies.
5. Interpretation of the index of risk
a. Direction of risk
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-391
Study Designs: Fundamentals, Interpretation, and Research Topics
b. Magnitude of risk
A/(A+B)
a. RR =
C/(C+D)
A
C
b. OR = or = (A x D)/(B x C)
B
D
a. OR = (6/377)/(1/749) = 12
b. Data from the PPA study above related to appetite suppressant and development of hemorrhagic
stroke
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-392
Study Designs: Fundamentals, Interpretation, and Research Topics
Table 5. Use of PPA and Appetite Suppressants and the Risk of Developing Hemorrhagic Stroke
Cases Controls Adjusted OR
(+ hemorrhagic stroke) ( hemorrhagic stroke) (95% CI)
n=383 n=750
Appetite suppressant: Women 6 1 16.6 (1.51182)
Appetite suppressant: Men 0 0
Appetite suppressant: Either 6 1 15.9 (1.38184)
D. Causation
1. R EMEMBER: In general, we do not prove or show causality with observational studies, but there is
some general guidance to consider when evaluating them. It is important to recognize that, in many
situations, the conduct of studies to establish causality is not possible, practical, or ethical.
2. Types of causality
a. Sufficient cause
b. Necessary cause
c. Risk factor
3. Questions used to evaluate causality
a. Was statistical significance observed?
b. What was the strength of the association, as measured by the OR or the RR?
c. Were dose-response relationships evaluated?
d. Was there a temporal relationship between exposure and disease/outcome?
e. Have the results been consistently shown?
f. Is there biologic plausibility to the association?
g. Is there any experimental (e.g., animal, in vitro) evidence?
A. Characteristics
1. Experimental or interventional, investigator makes intervention and evaluates cause and effect.
Examine etiology, cause, efficacy, using comparative groups.
2. Some previous background information or studies should exist to suggest that the intervention used will
likely be beneficial.
3. Design allows assessment of causality.
a. Sufficient cause
b. Necessary cause
c. Risk factor
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-393
Study Designs: Fundamentals, Interpretation, and Research Topics
Outcome
Intervention #1
No
Outcome
Study Sample
Intervention #2 Outcome
Population (or Placebo, etc.)
No
Outcome
Present Future
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-394
Study Designs: Fundamentals, Interpretation, and Research Topics
Washout
Intervention #1 Intervention #2
Study Sample
Population
Intervention #2 Intervention #1
Present Future
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-395
Study Designs: Fundamentals, Interpretation, and Research Topics
A. Subgroup Analysis
1. Important part of controlled clinical trials (if set a priori)
2. Many times, they are overused and overinterpreted, leading to unnecessary research, misinterpretation
of results, and/or suboptimal patient care.
3. Many potential pitfalls in identifying and interpreting
a. Failure to consider several comparisons or to adjust p-values
b. Problems with sample size (power), classification, and lack of assessment of interaction
B. Composite End Points: Often, the impression is that this practice is not a good practice.
1. The primary end point is one of the most important decisions to make in the design of a clinical study.
2. A composite end point combines several end points.
a. For example, cardiovascular death, nonfatal MI, and cardiac arrest with resuscitation
b. Usually combines measures of morbidity and mortality
c. W hat does the following statement mean? Our findings show that ramipril reduces the rates of
death, MI, stroke, revascularization, cardiac arrest, heart failure, complications related to diabetes,
and new cases of diabetes in a broad spectrum of high-risk patients. Treating 1000 patients with
ramipril for 4 years prevents about 150 events in around 70 patients.
i. Was there a reduction in all the end points or just in some?
ii. Are all the outcomes just as likely to occur?
iii. Why would the investigators of this trial have been interested in all of these outcomes?
3. What are the positives for using composite end points?
a. No single primary outcome
b. To alleviate problems of multiple testing
c. To increase number of events, which decreases sample size and cost to the investigator
4. What are the problems?
a. Difficulties in interpreting composite end points; consider our earlier example
b. Misattribution of statistically beneficial effects of composite measure to each of its component end
points
c. Dilution of effects, negative results for relatively common component of composite end point
hide real differences in other end points. Undue influence exerted on composite end point by
softer component end points
d. Averaging of overall effect: Problems when component end points move in opposite directions;
a sign the composite end point should be abandoned without valid conclusions being drawn
e. Should all end points be weighed the same, or should death weigh more?
5. The results for each individual end point should be reported together with the results for the composite.
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-396
Study Designs: Fundamentals, Interpretation, and Research Topics
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-397
Study Designs: Fundamentals, Interpretation, and Research Topics
8. S
ignificant time trend: More CHD events in the treatment group than in placebo in year 1 and fewer in
years 4 and 5
9. Authors conclusions
a. During follow-up, ERT-P did not reduce overall rate of CHD events.
b. Treatment increased rate of thromboembolic evens and gallbladder disease.
A. Intention-to-Treat Analysis
1. Compares outcomes on the basis of initial group assignment or as randomized. The allocation to
groups was how they were intended to be treated, even though they may not have taken the medica-
tion for the duration of the study, dropped out, and did not comply with the protocol.
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-398
Study Designs: Fundamentals, Interpretation, and Research Topics
2. D
etermines effect of treatment under usual conditions of use. Analogous to routine clinical practice in
which a patient receives a prescription but may not adhere to the prescribed drug regimen.
3. Gives a conservative estimate of differences in treatments; may underestimate treatment benefits
4. Most common approach to assessing clinical trial results
5. This is the preferred type of analysis in a superiority trial.
B. Per-Protocol Analysis
1. Subjects who do not adhere to allocated treatment are not included in the final analysis; only those
who completed the trial and adhered to the protocol (based on some predetermined definition [e.g.,
80% adherence])
2. Provides additional information about treatment efficacy and provides more generous estimates of
differences between treatments
3. Subject to several issues because of factors such as lower sample size and definitions of adherence.
Results are more difficult to interpret and would be validly applied only to adherent patients like those
in the trial; not necessarily generalizable to all patients
4. Preferred type of analysis in noninferiority trials, although intention-to-treat analysis is often also used
C. As-Treated Analysis
1. Subjects are analyzed by the actual intervention received. If subjects were in the active treatment group
but did not take active treatment, the data would be analyzed as if they were in the placebo group.
2. This analysis essentially ignores/destroys the randomization process for those who did not adhere to
study design. Results should be interpreted with caution.
X. SYSTEMATIC REVIEW/META-ANALYSIS
A. Introduction
1. Dramatic increase in the number of these types of papers
2. First meta-analysis probably published in 1904: Assessment of typhoid vaccine effectiveness
B. Systematic Review
1. Summary that uses explicit methods to perform a comprehensive literature search, critically appraise
it, and synthesize the world literature on a specific topic
2. Differs from a standard literature review: The study results are more comprehensively synthesized and
reviewed.
3. As with a controlled clinical trial (or other studies), the key is a well-documented and well-described
systematic review.
4. Differs from other reviews, which combine evaluation with opinions
C. Meta-analysis
1. Systematic review that uses mathematical/statistical techniques to summarize the results of the
evaluated studies
2. These techniques may improve on the following:
a. Calculation of effect size
b. Increase in statistical power
c. Interpretation of disparate results
d. Reduction in bias
e. Answers to questions that may not be addressable with individual studies
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-399
Study Designs: Fundamentals, Interpretation, and Research Topics
3. R
eliant on criteria for inclusion of previous studies and statistical methods to ensure validity. Details of
included studies are essential.
4. Elements of trial methodology
a. Research question
b. Identification of available studies
c. Criteria for trial inclusion/exclusion
d. Data collection and presentation of findings
e. Calculation of summary estimate: Ideally with forest plot (Figure 7)
f. Assessment of heterogeneity
i. Statistical heterogeneity
ii. c2 and Cochran Q are common tests for heterogeneity.
g. Assessment of publication bias: Funnel plot
h. Sensitivity analysis
s
Armazzi, A. (2001) 1 30 8 30 6.1% 0.13 [0.02, 0.94] n
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-400
Study Designs: Fundamentals, Interpretation, and Research Topics
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-401
Study Designs: Fundamentals, Interpretation, and Research Topics
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-402
Study Designs: Fundamentals, Interpretation, and Research Topics
b. T he PRISMA flow diagram: Four-stage diagram, depicting the flow of information through the
systematic review
c. The PRISMA explanation and elaboration document: Intended to enhance the use and understand-
ing of the PRISMA statement
A. Cost-Minimization Analysis
1. Differences in cost among comparable therapies are evaluated
2. Only useful to compare therapies that have similar outcomes
B. Cost-Effectiveness Analysis
1. Outcome: Clinical units or cost per unit health outcome (outcome examples: years of life saved, number
of symptom free days, blood glucose, blood pressure, etc.)
2. Useful to measure the cost impact when health outcomes are improved
C. Cost-Utility Analysis
1. Assigns utility weights to outcomes so the impact can be measured in relation to cost (outcome exam-
ple: quality-adjusted life-years)
2. Compares outcomes related to mortality when mortality may not be the most important outcome
D. Cost-Benefit Analysis
1. Monetary value is placed on both therapy costs and beneficial health outcomes.
2. Allows analysis of both the cost of treatment and the costs saved with beneficial outcomes
A. S
ensitivity: Proportion of True Positives That Are Correctly Identified by a Test; a test with a high sensitiv-
ity means that a negative test can rule OUT the disorder
B. S
pecificity: Proportion of True Negatives That Are Correctly Identified by a Test; a test with high specificity
means that a positive test can rule IN the disorder
C. Positive Predictive Value: Proportion of Patients with a Positive Test Result Who Actually HAVE the Disease
D. N
egative Predictive Value: Proportion of Patients with a Negative Test Result Who Actually DO NOT HAVE
the Disease
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-403
Study Designs: Fundamentals, Interpretation, and Research Topics
Table 9. Relationship Between Test and Correct Diagnosis Identified by Disease in a Published Study
Disease
Test Positive disease Negative disease Total
Positive 231 (true positive) 32 (false positive) 263
Negative 27 (false negative) 54 (true negative) 81
Total 258 86 344
From: Drum DE, Christacapoulos JS. Hepatic scintigraphy in clinical decision making. J Nucl Med 1972;13:908-15.
A. Definitions
1. Research: Systematic investigation (i.e., research development, testing, and evaluation) designed to
develop or contribute to generalizable knowledge
2. Human subject: Living individual about whom an investigator obtains data through intervention or
interaction with the individual OR identifiable private information
3. Quality improvement versus research
a. In general, if the results of a project are presented outside an organization (i.e., contributes to gen-
eralized knowledge), either as a publication or a presentation, it is defined as research.
b. If the results of a project are to be used internally and are not meant to contribute to generalized
knowledge, the activities will fall under quality improvement. Ideally, the IRB makes this decision.
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-404
Study Designs: Fundamentals, Interpretation, and Research Topics
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-405
Study Designs: Fundamentals, Interpretation, and Research Topics
8. IRB composition
a. At least five members
i. Chairperson
ii. Scientific member
iii. Nonscientific member
iv. Layperson unaffiliated with the institution
v. Practitioner
b. Sufficient qualifications through the experience, expertise, and diversity of its members and back-
grounds, including considerations of their racial and cultural heritage and their sensitivity to issues
such as community attitudes, to promote respect for its advice and counsel in safeguarding the
rights and welfare of human subjects
c. Membership must be able to ensure protection of vulnerable populations.
d. Membership must come from more than one profession.
9. Informed consent
a. Informed consent is a process, not a form. Information must be presented to the individual (or rep-
resentative) to enable that person to make a voluntary decision to participate as a research subject.
b. Components
i. Description of any reasonably foreseeable risks or discomforts
ii. Description of any benefits to the subject or to others that may reasonably be expected
iii. Disclosure of appropriate alternative procedures or courses of treatment, if any
iv. Statement describing the extent, if any, to which confidentiality of records identifying the
subject will be maintained
v. For research involving more than minimal risk, an explanation about whether any compensa-
tion and an explanation about whether any medical treatments are available if injury occurs
vi. Contact information for answers to questions about the research and research subjects rights;
whom to contact if the subject has a research-related injury
vii. A statement that participation is voluntary; refusal to participate will involve no penalty or loss
of benefits, and the subject may discontinue participation at any time without penalty
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-406
Study Designs: Fundamentals, Interpretation, and Research Topics
c. Waiver or alteration of consent: An IRB may waive/alter informed consent if the following are met:
i. No more than minimal risk
ii. Will not adversely affect the rights and welfare of the subjects
iii. The research could not practicably be carried out without waiver.
iv. Subjects will be provided additional pertinent information after participation.
d. An IRB may also waive informed consent in a limited class of research in emergency settings.
A. Primary Literature
1. Experimental studies
2. Observational studies
3. Descriptive reports
B. Publication Process
1. Journal selection
a. Topic
b. Journal quality
i. Impact factor
ii. Immediacy index
c. Open access
2. Preparation of submission: Paper parts
a. Title page
b. Abstract
c. Introduction/background
d. Methods
e. Results
f. Discussion
3. Editorial and peer review
a. Types of reviews
i. Single-blind review: The reviewers identity is hidden from the author, but the reviewer knows
the author.
ii. Double-blind review: Both reviewer and author are blinded.
iii. Open review: Reviewer and author are known to each other.
iv. Published review: Reviewers comments are published together with the paper.
b. Role of reviewer
i. Does the scientific content have value and originality?
ii. Is the paper consistent with journal guidelines?
iii. Are the methods appropriate?
iv. What changes should be made or additional experiments conducted?
v. Make a recommendation (accept, revise, reject) to the editor.
4. Revision process
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-407
Study Designs: Fundamentals, Interpretation, and Research Topics
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-408
Study Designs: Fundamentals, Interpretation, and Research Topics
REFERENCES
1. A
ltman DG, Bland JM. Diagnostic tests 1: sensi- 16. N
ess RB; for the Joint Policy Committee, Societies
tivity and specificity. BMJ 1994;308:1552. of Epidemiology. Influence of the HIPAA privacy
2. A
ltman DG, Bland JM. Diagnostic tests 2: predic- rule on health research. JAMA 2007;298:2164-70.
tive values. BMJ 1994;309:102. 17. P
iaggio G, Elbourne DR, Altman DG, et al.;
3. B
yerly WG. Working with the institutional review CONSORT Group. Reporting of noninferiority and
board. Am J Health Syst Pharm 2009;66:176-84. equivalence randomized trials, an extension of the
CONSORT statement. JAMA 2006;295:1152-60.
4. C
lancy MJ. Overview of research designs. Emerg
Med J 2002;19:546-9. 18. Q
uilliam BJ, Barbour MM. Evaluating drug-
induced cardiovascular disease: a pharmacoepide-
5. D
asgupta A, Lawson KA, Wilson JP. Evaluating
miologic perspective. In: Richardson MM, Chant
equivalence and noninferiority trials. Am J Health
C, Cheng JWM, et al., eds. Pharmacotherapy Self-
Syst Pharm 2010;67:1337-43.
Assessment Program, 7th ed. Lenexa, KS: ACCP,
6. D
iCenzo R, ed. Clinical Pharmacists Guide to 2010:225-39.
Biostatistics and Literature Evaluation. Lenexa,
19. S
chulz KF, Altman DG, Moher D; CONSORT
KS: ACCP, 2015.
Group. CONSORT 2010 statement: updated guide-
7. D
iPietro NA. Methods in epidemiology: obser- lines for reporting parallel group randomized tri-
vational study designs. Pharmacotherapy als. Ann Intern Med 2010;152:726-32.
2010;30:973-84.
20. S
hermock KM. Secondary data analysis/obser-
8. E
nfield KB, Truwit JD. The purpose, composition, vational research. In: Dunsworth TS, Richardson
and function of an institutional review board: bal- MM, Chant C, et al., eds. Pharmacotherapy Self-
ancing priorities. Respir Care 2008;53:1330-6. Assessment Program, 5th ed. Kansas City, MO:
9. H
amilton CW. How to write and publish scientific ACCP, 2005:43-63.
papers: scribing information for pharmacists. Am 21. S
hields KM, DiPietro NA, Kier KL. Principles of
J Hosp Pharm 1992;49:2477-84. drug literature evaluation for observational study
10. K
oretz RL. Methods of meta-analysis: an analysis. designs. Pharmacotherapy 2011;31:115-27.
Curr Opin Clin Nutr Metab Care 2002;5:467-74. 22. Smith GH, Mays DA. Clinical study design and
11. L
agakos SW. The challenge of subgroup analy- literature evaluation. In: Zarowitz B, Shumock G,
ses reporting without distorting. N Engl J Med Dunsworth T, et al., eds. Pharmacotherapy Self-
2006;354:1667-9. Assessment Program, 4th ed. Kansas City, MO:
12. L
esaffre E. Superiority, equivalence and non-infe- ACCP, 2002:203-31.
riority trials. Bull NYU Hosp Jt Dis 2008;66:150-4. 23. S
trassels SA, Wilson JP. Pharmacoepidemiology.
13. M
ann CJ. Observational research methods: In: Dunsworth TS, Richardson MM, Chant C,
research design II: cohort, cross sectional and et al., eds. Pharmacotherapy Self-Assessment
case-control studies. Emerg Med J 2003;20:54-60. Program, 6th ed. Lenexa, KS: ACCP, 2007:17-31.
14. M
oher D, Liberati A, Tetzlaff J, et al.; PRISMA 24. T
omlinson G, Detsky AS. Composite endpoints in
Group. Preferred reporting items for systematic randomized trials: there is no free lunch. JAMA
reviews and meta-analyses: the PRISMA state- 2010;303:267-8.
ment. Ann Intern Med 2015;162:797-8. 25. T
suyuki RT, Garg S. Interpreting data in cardiovas-
15. N
eely JG, Magit AE, Rich JT, et al. A practi- cular disease clinical trials: a biostatistical toolbox.
cal guide to understanding systematic reviews In: Richardson MM, Chant C, Cheng JWM, et al.,
and meta-analysis. Otolaryngol Head Neck Surg eds. Pharmacotherapy Self-Assessment Program,
2010;142:6-14. 7th ed. Lenexa, KS: ACCP, 2010:241-55.
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-409
Study Designs: Fundamentals, Interpretation, and Research Topics
26. V
an Way CW III. Writing a scientific paper. Nutr
Clin Pract 2002;22:636-40.
27. v on Elm E, Altman DG, Egger M, et al.
Strengthening the Reporting of Observational
Studies in Epidemiology (STROBE) statement:
guidelines for reporting observational studies. Ann
Intern Med 2007;147:573-7.
28. W
indish DM, Huot SJ, Green ML. Medicine resi-
dents understanding of the biostatistics and results
in the medical literature. JAMA 2007;298:1010-22.
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-410
Study Designs: Fundamentals, Interpretation, and Research Topics
1. Answer: B 5. Answer: D
Recall bias is always a potential concern for case- Answers A and C are incorrect calculations. Calculating
control studies because of the amount of time that passes the NNT to prevent one recurrence using twice-daily
between the study and the drug ingestion. Because therapy is as follows: 0.044 0.029 = 0.015 and 1/0.015
risk factors were not included in the study design, this = 66.767; however, the NNT should not be calculated
is of concern (Answer B is correct). Although a study when the end point of interest is nonsignificant (Answer
may be susceptible to many types of bias, the other B is incorrect; Answer D is correct).
choices would not pose as much risk (if any) compared
with recall bias (Answers A, C, and D are incorrect). 6. Answer: C
Answers A and B are incorrect because the margarine
2. Answer: B with ALA did not significantly reduce the risk of cardio-
Internal validity is greatly jeopardized because the vascular events (the 95% CI includes 1 [no difference in
study is not designed to protect against this possible risk]). Answer D is incorrect because the p-value is not
bias. In a sense, this design flaw jeopardizes external required for interpreting statistical significance when
validity (how well does a study apply to other patients the 95% CI is provided. Answer C is correct because
with this condition/disease?), but a lack of internal the p-value corresponds to the 95% CI.
validity is most affected (Answer B is correct). The
other answers can be adequately controlled for in the 7. Answer: A
design and conduct of the study (Answers A, C, and D Clinical trials are usually adequately powered to com-
are incorrect). pare primary end points (Answer A is correct). Because
Answer B is part of the composite outcomes, the study
3. Answer: B was likely not powered to detect this outcome inde-
Intention-to-treat analysis generally considers the pendently. Similarly, even though the subgroup analy-
approach, which gives the best estimate of use effec- sis was determined a priori, the study is not typically
tiveness (use under typical clinical trial conditions), designed to have sufficient power to make this compar-
whereas per-protocol analysis gives a better estimate ison (Answers C and D are incorrect).
of method effectiveness (use under ideal conditions)
(Answer B is correct; Answer C is incorrect). Intention- 8. Answer: D
to-treat analysis is the most common approach to data Answers A and B are incorrect because each implies
analysis for randomized controlled trials and may that one drug is more effective than the other. In this
underestimate the treatment effect (Answer D is incor- type of study design, neither drug is more/less effec-
rect). Recall bias is not a concern with randomized tive. Answer C is incorrect because the CI of the OR
controlled trials (Answer A is incorrect). does not include 1; thus, the finding is statistically sig-
nificant at the 5% level, making Answer D correct.
4. Answer: B
The CI of the difference in recurrence rate between the 9. Answer: A
two groups includes zero; thus, there is no statistically Federal law guidance for IRB membership simply states
significant difference between the two groups (Answer that membership must include at least five individu-
B is correct). Answer A is incorrect because the 95% als: a chairperson, a scientific member, a nonscientific
CI contains zero and is therefore not statistically signif- member, a layperson unaffiliated with the institution,
icant. Answer C is incorrect because not enough infor- and a practitioner (Answer A is correct). There is no
mation is provided. Answer D is incorrect because all requirement for size of membership other than for five
the above information can be determined without the or a certain number of types of individuals (Answers
benefit of reported p-values. B and C are incorrect) or for a physician (Answer D is
incorrect).
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-411
Study Designs: Fundamentals, Interpretation, and Research Topics
10. Answer: B
Answer A is incorrect because information related to
how the selection of research participants occurred
should be in the methods. The results/summary of pre-
vious studies (Answer B) are found in the introduction
to the study to frame the objective of the current study
or in the discussion to relate the results of the current
study to the results of other studies. Answer C is incor-
rect because this information should be in the results
section. Answer D is incorrect because acknowledg-
ments should be contained in the acknowledgment
section.
ACCP Updates in Therapeutics 2017: Pharmacotherapy Preparatory Review and Recertification Course
1-412