Beruflich Dokumente
Kultur Dokumente
Introduction Investigator-Based Methods vs. Respondent-Based Methods Assessment Methods Covered in this Review References
Introduction
Life stress has been posited as a key mechanism in the etiology and course of both psychological and physical health outcomes. The extant evidence to date has been inconsistent and as such has lead some researchers to suggest that stress per se does not play a major role in determining health outcome. Other researchers, however, have argued that different results across studies emerge from the use of different measurement strategies. In this respect, two research traditions of paradigmatic status are associated with the assessment and measurement of life stress: 1. Respondent-based assessment, based on the use of self-report checklists in which respondents are ask to identify the events they have experienced from a standard list of options. 2. Investigator-based assessment, typically involves the use of a semi-structured interview to elicit descriptions of occurrences. These descriptions are then presented to a panel of raters who define events and chronic difficulties as well as ratings along various theoretical dimensions. Hence, an important distinction between these two methods lies in the notion that for investigator-based approaches the primary responsibility for defining and categorizing life stress resides with the investigator not with the respondent. In other words, the final interpretation of an occurrence as a life event or chronic difficulty as well as the ratings assigned to that occurrence (e.g., severity or threatfulness, independence, etc.) are made by trained researchers in conjunction with the respondents self-report, omitting any information about the respondents actual reaction to the occurrence. These ratings are referred to contextual and/or objective ratings as opposed to subjective ratings that are the product of respondent-based or self-report checklists. In fact, a consensus is emerging in the literature that the assessment of contextual or objective factorsthe personal and psychosocial setting in which a stressor occursis a key consideration in understanding the relationship between that stressor and outcome (Thoits, 1995). In this respect, the definition of stress as well as its effects can be viewed as a process through which environmental events are interpreted by people, in relation to own values and resources and responded to psychologically, behaviorally, and biologically, (Herbert & Cohen, p. 295, 1996). Thus, a focus on contextual factors (e.g., biographical circumstances, chronic difficulties, etc) that elucidate the meaning of a particular stressor to a particular person within a process framework may help to account for the variability in response to that particular stressor.
The reliance on self-report checklists makes it exceedingly difficult to evaluate context or objective features of a particular occurrence. For example, a checklist item such as pregnancy may be associated with a different level of stressfulness for an unmarried woman with little financial or emotional support than for a happily married woman who has planned for the event in a stable financial position. In contrast, investigator-based methods attempt to provide a more accurate index of the objective severity of an occurrence by examining the context for each occurrence. In general, though researchers need to choose measures that most likely assess their conceptualization of life stress.
2. Standardization/ Precision of Measurement Parameter Number of possible events Standardization of Probes Precise criteria for defining events and/or difficulties Distinguish acute from chronic occurrences Distinguish events/difficulties from dependent variable Establish independence of event/difficulty Establish dating of events/difficulties Establish temporal relations between events and/or difficulties and outcome measures Respondent-based Usually fixed Fully standardized No Investigator-Based Open Flexible Yes
No
Yes
No
Yes
No
Yes
Not fully
Yes
No
Yes
Advantages of Investigator-Based Measures of Life Stress Assessment The magnitude of association between life stress and illness has been modest when employing self-report measures. However, in a broad range of studies, the LEDS has achieved substantially stronger effects sizes than self-administered measures have (see Brown & Harris, 1989). Investigator based methods are better suited for assessing objective features of life circumstances, which is consistent with the stimulus-based model of psychological stress. Checklists have demonstrated poor inter-rater reliability, low test-retest reliability, and limited validity (see Gorman, 1995 for a review). Investigator-based methods have developed several strategies to control for measurement errors and biases in the identification, dating, and evaluation (e.g., severity) of life events and chronic difficulties. Investigator-based methods allow for greater precision in the definition of the types of stressors (e.g., acute versus chronic, life domain, etc.) as well as precision in dating relative to the timing of exposure and outcome.
Disadvantages of Investigator-Based Measures of Life Stress Assessment The cost of implementation is significantly more than that cost involved in the administration of a self-report measure: o o o Training is necessary. Respondent/investigator burden in terms of time and effort for administration is considerable. Rating and independent review of ratings can take considerable effort and time.
There are other research considerations to take into account: o o Investigator based methods are not widely used in the literature because of cost and training considerations so comparisons across studies remain problematic. Extant evidence supporting their use in terms of predictive validity is limited. Given respondent/investigator burden they may not be suitable for large-scaled studies.
References
Cohen S, Kessler RC, Underwood Gordon L: Measuring stress: A guide for health and social scientists. New York: Oxford University Press, 1995. Dougall AL, Baum A: Stress, health, and illness. In: A Baum, TA Revenson, JE Singer (Eds.), Handbook of health psychology. Mahwah, NJ: Lawrence Erlbaum Associates, 2001. Brown GW, Harris TO: Life events and illness. New York: The Guilford Press, 1989. Cohen S, Kessler RC, Underwood Gordon L: Measuring stress: A guide for health and social scientists. New York: Oxford University Press, 1995.
Gorman DM: A review of studies comparing checklist and interview methods of data collection in life event research. Behav Med 9(2):66-73, 1993. Katschnig H: Life events and psychiatric disorders: Controversial issues. Cambridge: Cambridge University Press, 1986. Kessler RC: The effects of stressful life events on depression. Annu Rev Psychol 48:191214, 1997. McQuaid JR, Monroe SM, Roberts JE, Johnson SL, et al: Toward the standardization of life stress assessment: Definitional discrepancies and inconsistencies in methods. Stress Med 8(1):47-56, 1992. McQuaid JR, Monroe SM, Roberts JE, Kupfer DJ, Frank E: A comparison of two life stress assessment approaches: Prospective prediction of treatment outcome in recurrent depression. J Abnorm Psychol 109(4): 787-791, 2000. Wethington E, Almeida D, Brown GW, Frank E, Kessler RC: The assessment of stressor exposure. In: A Vingerhoets (Ed.), Assessment in Behavioral Medicine (pp. 113-134). New York: Taylor & Francis Inc., 2001. Zimmerman M: Methodological issues in the assessment of life events: A review of issues and research. Clin Psychol Rev 3:339-370, 1989.
attempt to include some of the conceptual features of contextual assessment defined by Brown and Harris. Briefly, the Life Events and Difficulties Schedule (LEDS) consists of a three part process: 1. Interview The LEDS is a semi-structured interview used to gather as full and coherent an account as possible in 10 domains (e.g., work, finance, relationships, etc.) or broad categories of life stress. It takes into account a persons biographical circumstances. Once the occurrence of an acute or chronic stressor is established, a second level of probing allows the interviewer to specify various aspects of the event or difficultys meaning for the individual by establishing the life circumstances of the individual at the time the event or difficulty occurs. Several strategies have been developed to ensure the accurate dating of occurrences aw well as their temporal relationship to each other over the period of observation.
2. Rating Procedure The LEDS is rated with respect to severity of threat and a variety of other dimensions (e.g., independence, focus, etc.). By assessing the level of threat associated with an event or difficulty, the rater makes a judgment as what most persons in such circumstances would be likely to experience. In doing so, the rater takes into account what is known of the persons plans, purposes, and commitments to their role areas as reflected in his or her biographical circumstances. The LEDS relies on a system of measurement particularly concerned with controlling respondent biases often overlooked by other methods and protecting equally well against various interviewer/rater biases. The LEDS manuals provide standard criteria for 1) defining whether an occurrence is an event or chronic difficulty and 2) for rating core dimensions (e.g., threat or severity, independence, etc.). Precedent examples in the manuals, organized by domain, are used to calibrate the ratings. These standard rating procedures prevent interviewers and raters from allowing the respondents symptoms or reported emotional responses to influence these ratings.
3. The Consensus/Expert Rater Process The manuals are also used in the consensus process (a panel of two or more trained rater) to ensure standardization of ratings as well as to provide a check on interviewer bias (an attempt to reduce the interviewers subjective reaction to the narrative provided by the respondent). The consensus process provides a final product or life stress profile consisting of a temporal sequence of events and difficulties.
meaning not enough contextual information is collected to approximate the contextual severity ratings made in the LEDS. An important feature of this measure is the development of techniques to improve recall and accurate dating of life events. The measure appears to have acceptable psychometric properties overall. Use of this instrument requires training but the authors indicate a significant reduction in training time, interviewing time, and coding time when compared to the LEDS. This measure was designed to be used in large-scale community surveys.
between discrete life events and ongoing chronic difficulties. Independent raters are used to objective ratings of severity. The authors report on test-retest reliability which appears to be more than adequate. No information is provided with respect to the time (and costs) involved in training, interviewing, and rating the interviews. The method has been used with adult community samples and patient samples.
that have included non-depressed samples as well as respondents with medical conditions. Inter-rater reliability appears to be adequate for both the independence and threat ratings.