Beruflich Dokumente
Kultur Dokumente
Outcome Measurements
Whats Important? Whats Useful?
Nicholas J. Gross
The severity of chronic obstructive pulmonary disease (COPD) and bidity and mortality (7). Weight loss, muscle weakness, and os-
patients response to therapy are difficult to assess. The traditional teoporosis are among a variety of common features of advanced
measure, spirometry, correlates poorly with important clinical fea- COPD, each of which contributes to the symptoms, morbidity,
tures of the disease, such as survival and quality of life (QOL). and probably the mortality of COPD. The mechanisms of these
Moreover, COPD has recently been recognized as a systemic dis- systemic effects are poorly understood but may be related to
ease, and its systemic manifestations, such as weight loss and muscle persistent airways inflammation (8) and elevated levels of circu-
weakness, are only poorly related to lung function. Therefore, al- lating inflammatory mediators, such as tumor necrosis factor-
though lung function remains an important outcome, other out-
(TNF-) (9). Spirometry alone provides little or no information
comes must be included in any overall assessment of disease severity
about the extrapulmonary effects of COPD.
or response to interventions. Examples include refinements of spirome-
This review summarizes the utility of a variety of outcome
try, such as measurement of FEV6 and inspiratory capacity; functional
outcomes, such as dyspnea indexes and exercise tests; and global-
measurements in the assessment of therapeutic interventions for
clinical outcomes, such as QOL questionnaires and assessment of COPD. As in a previous review (10), these outcomes are grouped
frequency and severity of acute exacerbations. For scoring disease into categories or dimension: physiologic, functional, global-clin-
severity, making a prognosis, or determining the outcome of novel ical, and miscellaneous. Where possible, the minimal clinically
interventions, composite measures need to be developed that take important difference (MCID) in an outcome is mentioned. Be-
into account as many aspects of COPD as practicable. cause almost any outcome in COPD is a matter of degree (e.g.,
improvement in FEV1 or exercise capacity after an intervention),
Keywords: composite outcomes; dyspnea indexes; exacerbations; exer- MCIDs have been proposed for several comes (59). These
cise capacity; quality of life MCID, which are often based on soft data, represent a general
consensus among authors of the minimal change in an outcome
Chronic obstructive pulmonary disease (COPD) is now extremely that seems to result in a clinically meaningful improvement.
common (1). Its incidence and associated mortality are increas-
ing rapidly, not only in the United States but also in developing PHYSIOLOGIC OUTCOMES
countries (2). Almost all our current therapy is symptomatic and
does not alter the progression of the disease or the survival of Where the intervention may be expected to have an effect on
its victims. To address this crisis, several new therapies are being lung function, it is appropriate to measure it. The most useful,
developed, and existing therapies are being modified. A major discriminatory, and reproducible measurements are those ob-
question that emerges from these efforts is how we may best tained by spirometry: FEV1, FVC, and their ratio (11, 12). Where
evaluate the efficacy of these novel therapeutic interventions. the intervention is a bronchodilator, serial spirometry is per-
Spirometric measures of pulmonary function (typically FEV1 formed before and for an appropriate time span after administra-
and FEV1/FVC) have been used to determine the efficacy of a tion of the agent. The results can be evaluated in many ways
treatment. However, it has become clear in the last decade that (e.g. peak FEV1 and area under the FEV1 curve). Other results
spirometry neither predicts survival well (3, 4) nor correlates can be measured from the same data, usually as secondary out-
well with clinical status measures, such as quality of life (QOL) comes (e.g., time to onset and duration of bronchodilation action,
(5). Nor has it been shown that an improvement in pulmonary both typically being arbitrarily taken to be an increase in FEV1
function achieved by any intervention other than smoking cessa- of 15% increase over its baseline value). How much must the
tion is associated with an improvement in survival; this includes FEV1 improve to be considered clinically significant (i.e., the
surgery (6). A lack of improvement in spirometry may be associ- MCID)? The within-subject variability of FEV1 has been esti-
ated with other clinically important improvements in symptom- mated to be 160 ml (16). A change in FEV1 of this amount can
atology; therefore, spirometry may provide a less-than-complete thus be taken as evidence of physiologic efficacy, but a threshold
measure of the efficacy of an intervention. for clinical efficacy has not been definitively established. The
A further consideration is the recent realization that COPD American Thoracic Society and Global Initiative for Chronic
is not just a pulmonary disorder but is a systemic disease that Obstructive Lung Disease guidelines considered an absolute in-
has systemic effects that can contribute substantially to its mor- crease in FEV1 of 200 ml plus a relative increase of 12% above
baseline to be the threshold of clinical significance.
The technical performance of spirometry is important, and
standards have been published (13). Because these standards
are rarely met in clinical practice, retrospective data from routine
(Received in original form April 13, 2005; accepted in final form July 14, 2005)
clinic data are usually inadequate for research purposes. Fortu-
Research for this report has been provided by Veterans Affairs Research
nately, most, if not all, contemporary spirometers have built-in
Correspondence and requests for reprints should be addressed to Nicholas J. quality control software that alerts the operator to unacceptable
Gross, M.D., PO Box 1485, Hines Hospital, Bldg 1, Room E438 Roosevelt & 5th
data. One of the common technical problems of spirometry re-
Avenues, Hines, IL 60141. E-mail: Nicholas.gross@med.va.gov
lates to the duration of expiration. Due to the prolonged and
Proc Am Thorac Soc Vol 2. pp 267271, 2005
DOI: 10.1513/pats.200504-036SR low expiratory flow rate in COPD, the FVC is dependent on
Internet address: www.atsjournals.org the motivation and breath-holding capacity of the subject. To
268 PROCEEDINGS OF THE AMERICAN THORACIC SOCIETY VOL 2 2005
pnea, Fatigue, Emotional Function, and Mastery. The current MISCELLANEOUS OUTCOMES
version of this instrument is scored on a seven-point scale; higher
Radiology
scores signify better health status, and a difference of 0.5 units
or more is considered to be the MICD (36). For each instrument, Traditional radiologic examination of the lungs is insensitive to the
the total score is probably the most reliable end-point; however, presence and severity of COPD. However, computed tomography
one or more components can be presented to indicate a field in (CT) is able to detect and objectively quantify the density of lung
which the event or intervention seems to be particularly benefi- regions, and the measurements correlate reasonably well with
cial or harmful. subsequently obtained lung histology (45, 46). In addition to
QOL outcomes such as these are regarded as important in lung parenchymal density measurements, progress is being made
all aspects of COPD because they are felt to represent changes toward measurement of airway dimensions and wall thickness
that are clinically most relevant to patients and that may not be by high-resolution CT scans (47, 48). Radiologic outcome has
measurable by other more conventional parameters. not been widely applied in clinical studies, although it has been
appropriately use in as an outcome of lung volume reduction
Acute Exacerbations of COPD
surgery (49).
Acute exacerbations can be measured in many ways (e.g., time
to first exacerbation, number of exacerbations, number of un- Markers of Airway Inflammation
scheduled and emergency department visits for COPD, number These are receiving increased attention, with the realization that
of hospitalizations for COPD, and number of ICU admissions the pathogenesis and cellular pathology of inflammation is dis-
for COPD). Each of these outcomes should be captured, and, tinctive in COPD (50). A variety of studies have used biopsies
for confidence in the effect of the intervention, the results of of airways (e.g., scoring interleukin [IL]-8 and numbers of CD-8
these outcome measures should be in the same direction and lymphocytes [51]), bronchoalveolar lavage (52), exhaled breath
statistically significant. condensates (e.g., 8-isoprostane and leukotriene B4 [53, 54]), and
Mortality circulating inflammatory markers (e.g., TNF- and its soluble
receptors and IL-6) (56, 56). Although these markers have been
Mortality can be recorded as all-cause and disease related. Al- used as outcomes of interventions (57), their role in clinical
though mortality is probably the most robust and definitive out- research is only beginning to reach its potential. With better
come, it has rarely been measured as a primary outcome in understanding of the COPD inflammatory process, one hopes
COPD; the two long-term oxygen therapy trials (43, 44) and the
that the most relevant markers of inflammation will emerge and
NETT (6) are notable exceptions. Studies in which mortality is
that reliable, simple assays will become widely included in clinical
the primary outcome are likely to require relatively large num-
studies.
bers of subjects and long observation times and are consequently
expensive. Soft Outcomes
It is conventional in clinical studies to include, as secondary
outcomes, data that one regards as soft. Soft data include diary
cards, the use of rescue mediations, and global evaluations by
subjects or physicians. These data can be misleading (58) and
add little value to the study, except possibly to corroborate the
primary outcome.
Composite Outcomes
COPD is a protean condition; each of the outcomes discussed
previously focuses on a different dimension of the disease, and
none by itself gives a reliable account of the disease state or a
complete result of an intervention. It is appropriate, therefore,
that attempts are made to devise a method to score disease sever-
ity, make a prognosis, or determine the outcome of an intervention
that takes account of as many aspects of the disease as is practica-
ble. All or most clinical studies should include not only a physio-
logic outcome (e.g., based on spirometry) but also subjective
and objective functional scores (e.g., a dyspnea index and a
6-MWT) and a QOL index (e.g., SGRQ or CRQ); these should
be co-primary outcomes (10). More specific outcomes (e.g., lung
density by CT scan or inflammatory markers) should be included
where appropriate.
Celli and colleagues (3) have devised, prospectively tested,
and validated a composite index that they call the BODE index
from its four components: Body mass index, degree of airflow
Obstruction, the modified MRC Dyspnea scale, and Exercise
capacity based on the 6-MWT. The sum of components provides
a score from 010. The prospective, validation phase of the
study examined two robust outcomes, all-cause mortality, and
mortality due to respiratory failure. For both outcomes, the
Figure 2. Survival of patients with COPD based on the BODE index (A ) BODE index was a better predictor of mortality than FEV1
or stages of COPD as defined by American Thoracic Society standards (Figure 2). Major advantages of the index are that it is widely
(B ). Reprinted with permission from Reference 3. applicable, simple, and requires no special equipment.
270 PROCEEDINGS OF THE AMERICAN THORACIC SOCIETY VOL 2 2005
Conflict of Interest Statement : N.J.G. does not have a financial relationship with 27. Butland RJA, Pang J, Gross ER, Woodcock AA, Geddes DM. Two-,
a commercial entity that has an interest in the subject of this manuscript. 6-, and 12-minute walking tests in respiratory disease. BMJ 1982;284:
16071608.
References 28. Solway S, Brooks D, Lacasse Y, Thomas S. A qualitative systematic
overview of the measurement properties of functional walk tests used
1. National Center for Health Statistics. Plan and Operation of the Third in the cardiorespiratory domain. Chest 2001;119:256270.
National Health and Nutrition Examination Survey, 19881994. US 29. Enright PL, Sherrill DL. Reference equations for the six-minute walk
Department of Health and Human Services publication PHS 94-1308. test in healthy adults. Am J Respir Crit Care Med 1998;158:13841387.
Washington, DC: USDHHS. 30. Redelmeier DA, Bayoumi AM, Goldstein RS, Guyatt GH. Interpreting
2. Murray CJL, Lopez AD. Mortality by cause for eight regions of the small differences in functional status, the 6-minute walk test in chronic
world, Global Burden of Disease Study. Lancet 1997;349:12691276. lung disease patients. Am J Respir Crit Care Med 1997;155:12781282.
3. Celli BR, Cote CG, Marin JM, et al. The body-mass index, airflow obstruc- 31. Lacasse Y, Wong E, Guyatt GH, King D, Cook DJ, Goldstein RS. Meta-
tion, dyspnea, and exercise capacity index of chronic obstructive pul- analysis of respiratory rehabilitation in chronic obstructive pulmonary
monary disease. N Engl J Med 2004;350:10051012. disease. Lancet 1996;348:11151119.
4. Oga T, Nishimura K, Tsukino M, Sato S, Hajiro T. Analysis of factors 32. ATS Committee on Proficiency Standards for Clinical Pulmonary Func-
related to mortality in chronic obstructive pulmonary disease. Am J tion Laboratories. ATS Statement: guidelines for the 6-minute walk
Respir Crit Care Med 2003;167:544549. test. Am J Respir Crit Care Med 2002;166:111117.
5. Domingo-Salvany A, Lamarca R, Ferrer M, Garcia-Aymerich J, et al. 33. Singh SJ, Morgan MDL, Scott S, Walters D, Hardman A. Development
Health-related quality of life and mortality in male patients with of a shuttle walking test of disability in patients with chronic airways
chronic obstructive pulmonary disease. Am J Respir Crit Care Med obstruction. Thorax 1992;47:10191024.
2002;166:680685. 34. Jones PW, Quirk FH, Baveystock CM, Littlejohns P. A self-complete
6. National Emphysema Treatment Trial Research Group. A randomized measure for chronic airflow limitation: the St Georges Respiratory
trial comparing lung-volume-reduction surgery with medical therapy Questionnaire. Am Rev Respir Dis 1992;145:13211327.
for severe emphysema. N Engl J Med 2003;348:20592073. 35. Guyatt GH, Berman LB, Townsend M, Pugsley SO, Chambers LW. A
7. Gross NJ. Extrapulmonary effects of COPD. Curr Opin Pulm Med 2001; measure of the quality of life for clinical trials in chronic lung disease.
7:8492. Thorax 1987;42:773778.
8. Hogg JC, Chu F, Utokaparch S, et al. The nature of small-airway obstruc- 36. Schunemann HJ, Puhan M, Goldstein R, Jaeschke R, Guyatt GH. Mea-
tion in chronic obstructive pulmonary disease. N Engl J Med 2004; surement properties and interpretability of the Chronic Respiratory
350:26452653. Disease Questionnaire (CRQ). COPD: J Chronic Obstructive Pulmo-
9. Schols AM, Buurman WA, Staal van den Brekel AJ, Dentener MA, nary Dis 2005;2:8189.
Wouters EF. Evidence for a relation between metabolic derangements 37. Cydulka RK, McFadden ER Jr, Emerman CL, et al. Patterns of hospital-
and increased levels of inflammatory mediators in a subgroup of pa- ization in elderly patients with asthma and chronic obstructive pulmo-
tients with chronic obstructive pulmonary disease. Thorax 1996;51: nary disease. Am J Respir Crit Care Med 1997;56:18071812.
819824. 38. Vilkman S, Keistinen T, Tuuponen T, Kivela SL. Survival and cause of
10. Gross NJ. Outcome measures for COPD treatments, a critical evaluation. death among elderly chronic obstructive pulmonary disease patients
COPD: J Chronic Obstructive Pulmonary Dis 2004;1:4157. after first admission to hospital. Respiration (Herrlisheim) 1997;64:281
11. Enright PL, Johnson LR, Connett JE, Voelker H, Buist AS. Spirometry 284.
39. Hilleman DE, Dewan N, Malesker M, Friedman M. Pharmacoeconomic
in the Lung Health study. 1: methods of quality control. Am Rev
evaluation of COPD. Chest 2000;118:12781285.
Respir Dis 1991;143:12151223.
40. Anthonisen NR, Manfreda J, Warren CP, et al. Antibiotic therapy in
12. Enright PL, Lebowitz MD, Cockroft DW. Physiologic measures, pulmo-
exacerbations of chronic obstructive pulmonary disease. Ann Intern
nary function tests. Am J Respir Crit Care Med 1994;149:S9S18.
Med 1987;106:196204.
13. American Thoracic Society. ATS standardization of spirometry 1994
41. Rodriguez-Roisin R. Toward a consensus definition for COPD exacerba-
update. Am J Respir Crit Care Med 1994;152:11071136.
tions. Chest 2000;117:S398S401.
14. Enright RL. The FEV1/FEV6 predicts lung function decline in adult
42. Niewoehner D, et al. (in preparation), data on file (Boehringer-Ingleheim
smokers. Respir Med 2002;96:444449.
Pharmaceuticals)
15. ODonnell DE. Assessment of bronchodilator efficacy in symptomatic 43. Medical Research Council Working Party. Long term domiciliary oxygen
COPD. Chest 2000;117:42S47S. therapy in chronic hypoxic cor pulmonale complicating chronic bron-
16. Tweedale PN, Alexander F, McHardy GJR. Short-term variability of chitis and emphysema. Lancet 1981;1:681686.
FEV1 and bronchodilator responsiveness in patients with obstructive 44. Nocturnal Oxygen Therapy Group. Continuous or nocturnal oxygen ther-
ventilatory defects. Thorax 1997;42:48790. apy in hypoxemic chronic obstructive pulmonary disease. Ann Intern
17. Traver GA, Cline MG, Burrows B. Predictions of mortality in COPD, Med 1980;93:391398.
a 15 year follow-up study. Am Rev Respir Dis 1979;119:895902. 45. Spouge D, Mayo JR, Cardoso W, Muller NL. Panacinar emphysema, CT
18. Anthonisen NR, Wright EC, IPPB Trial Group. Bronchodilator response and pathologic findings. J Comput Assist Tomogr 1993;17:710713.
in chronic obstructive pulmonary disease. Am Rev Respir Dis 1986;133: 46. Genevois PA, de Maertelaer V, De Vuyst P, Zanen J, Yernault JC.
814819. Comparison of computed density and macroscopic morphometry in
19. Anthonisen NR, Connett JE, Kiley JP, et al. Effects of smoking interven- pulmonary emphysema. Am J Respir Crit Care Med 1995;152:653657.
tion and the use of an inhaled anticholinergic bronchodilator of the rate 47. Nakano Y, Muro S, Sakai H, et al. Computed tomographic measurements
of decline of FEV1, the Lung health study. JAMA 1994;272:14971505. of airway dimensions and emphysema in smokers. Am J Respir Crit
20. Fletcher C, Peto R, Tinker C. The natural history of chronic bronchitis Care Med 2000;162:11021108.
and emphysema. New York: Oxford University Press; 1976. pp. 1272. 48. King GG, Muller NL, Whittall KP, Xiang S, Pare PD. An analysis algo-
21. Burdon GW, Juniper EF, Killian KJ, et al. The perception of breath- rithm for measuring airway lumen and wall areas from high-resolution
lessness in asthma. Am Rev Respir Dis 1982;126:825828. computed tomographic data. Am J Respir Crit Care Med 2000;161:574
22. Fletcher CM. Standardized questionnaire on respiratory symptoms: a 580.
statement prepared and approved by the MRC Committee on the 49. Bae KT, Slone RM, Gierada DS, Yusen RD, Cooper JD. Patients with
aetiology of chronic bronchitis. BMJ 1960;2:1665. emphysema, quantitative CT analysis before and after lung volume
23. Mahler DA, Weinberg DH, Wells CK, Feinstein AR. The measurement reduction surgery. Radiology 1997;203:705714.
of dyspnea, contents, interobserver agreement, and physiologic corre- 50. Barnes PJ. New concepts in chronic obstructive pulmonary disease. Annu
lates of two new clinical indexes. Chest 1984;85:751758. Rev Med 2003;54:113129.
24. Weisman IM, Zebalos RJ, editors. Clinical exercise testing; progress in 51. DiStefano A, Capelli A, Lusuardi M, et al. Severity of airflow limitation
respiratory research. Karger, Basel, New York: 2002. is associated with severity of airway inflammation in smokers. Am J
25. Montoye HJ, Kemper HCG, Saris WHM, Washburn RA. Measuring Respir Crit Care Med 1998;158:12771285.
physical activity and energy expenditure. Champaign, IL: Human Ki- 52. Saetta M, Turato G, Maestrelli P, Mapp CE, Fabbri LM. Cellular and
netics; 1996. structural bases of chronic obstructive pulmonary disease. Am J Respir
26. Cooper CB, Storer TW, editors. Exercise testing and interpretation, a Crit Care Med 2001;163:13041309.
practical approach. Cambridge, UK: Cambridge University Press; 2001. 53. Montuschi P, Barnes PJ. Analysis of exhaled breath condensates for
Gross: Outcome Measures in COPD 271
monitoring airway inflammation. Trends Pharmacol Sci 2002;23:232 propionate on inflammatory cells in COPD, an ultrastructural exami-
237. nation of endobronchial biopsy tissue. Thorax 2002;57:799803.
54. Paredi P, Kharitonov SA, Barnes PJ. Analysis of expired air for oxidation 58. Rand CS, Wise RA, Nides M, et al. Inhaler adherence in a clinical
products. Am J Respir Crit Care Med 2002;166:S31S37. trial, comparison of self-report and canister weighing to the nebulizer
55. Schols AM, Buurman WA, Staal van den Brekel AJ, Dentener MA, chronology. Am Rev Respir Dis 1992;146:15591564.
Wouters EF. Evidence for a relation between metabolic derangements 59. Make B, Casaburi R, Leidy NK. Interpreting results from clinical trials,
and increased levels of inflammatory mediators in a subgroup of pa- understanding minimal clinically important differences in COPD out-
tients with chronic obstructive pulmonary disease. Thorax 1996;51: comes. COPD: J Chronic Obstructive Pulmonary Dis 2005;2:15.
819824. 60. Wise RA, Brown CD. Minimal clinically important differences in the
56. Roland M, Bhowmik A, Sapsford RJ, et al. Sputum and plasma six-minute walk test and the incremental shuttle walking test. COPD:
endothelin-1 levels in exacerbations of chronic obstructive pulmonary J Chronic Obstructive Pulmonary Dis 2005;2:125129.
disease. Thorax 2001;56:3035. 61. Jones PW. St Georges Respiratory Questionnaire: MCID. COPD: J
57. Gizycki MJ, Hattotuwa KL, Barnes N, Jeffery PK. Effects of fluticasone Chronic Obstructive Pulmonary Dis 2005;2:7579.