Beruflich Dokumente
Kultur Dokumente
Research Article
CROSS-CULTURAL EVALUATION OF THE
PANIC DISORDER SEVERITY SCALE IN JAPAN
Ikuyo Yamamoto, M.D.,1 Yumi Nakano, M.D., Ph.D.,1 Norio Watanabe, M.D.,1 Yumiko Noda,1
Toshi A. Furukawa, M.D., Ph.D.,1* Takahiro Kanai, M.D., Ph.D.,2 Osamu Takashio, M.D., Ph.D.,3
Rumiko Koda, M.D.,3 Tempei Otsubo, M.D., Ph.D.,3 and Kunitoshi Kamijima, M.D., Ph.D.3
The Panic Disorder Severity Scale (PDSS) [Shear et al., 1997] is rapidly
gaining world-wide acceptance as a standard global severity measure of panic
disorder, however, its cross-cultural validity and reliability have not been
reported yet. We developed the Japanese version of the PDSS and examined its
factor structure, internal consistency and inter-rater reliability and concurrent
validity among Japanese patients with panic disorder with or without
agoraphobia. We also established rules of thumb for interpreting PDSS total
scores, taking the Clinical Global Impression severity scale as the anchoring
criterion. The identical one-factor structure of the PDSS was confirmed among
the Japanese patients as among the United States patients. Both internal and
inter-rater reliability was excellent (Cronbachs alpha was 0.86, and ANOVA
ICCs were all above 0.90). Concurrent validity of the PDSS items with self-
report questionnaires tapping similar or overlapping domains was satisfactory
(Pearson correlation coefficients were mostly above 0.5). Using the anchor-based
approach, the following interpretative guides are suggested: among those with
established panic disorder diagnosis, PDSS total scores up to 10 correspond with
mild, those between 11 and 15 with moderate, and those at or above 16
correspond with severe panic disorder. The present findings support the cross-
cultural generalizability of panic disorder symptomatology and of the PDSS, in
particular. Depression and Anxiety 20:1722, 2004. & 2004 Wiley-Liss, Inc.
Key words: panic disorder; psychiatric status rating scales; reproducibility of results;
cross-cultural comparison
INTRODUCTION 1
Department of Psychiatry and Cognitive-Behavioral Medi-
Since its introduction in DSM-III in 1980, panic cine, Nagoya City University Graduate School of Medical
Sciences, Nagoya, Japan
disorder has been the focus of much research interest 2
Department of Psychiatry, Toyohashi Municipal Hospital,
around the world. Ten years later, however, a consensus
Toyohashi, Japan
development conference for the treatment of panic 3
Department of Psychiatry, Showa University School of
disorder was convened at the U.S. National Institute of Medicine, Tokyo, Japan
Mental Health and came to the conclusion that there
was an urgent need for standardized diagnostic and *Correspondence to: Professor Toshi A. Furukawa, Dept. of
treatment outcome measures to enable direct compar- Psychiatry and CognitiveBehavioral Medicine, Nagoya City
University Graduate School of Medical Sciences, Mizuho-cho,
isons between different research settings and different
Mizuho-ku, Nagoya 467-8601 Japan.
treatment strategies [Wolfe and Maser, 1994]. At an E-mail: furukawa@med.nagoya-cu.ac.jp
ensuing meeting to standardize the assessment meth-
ods, key researchers from 26 different sites failed to Received for publication 21 October 2003; Revised 12 June 2004;
endorse any extant instrument(s) as the best for rating Accepted 16 June 2004
the overall illness severity [Shear and Maser, 1994; DOI 10.1002/da.20029
Shear et al., 1998]. A systematic survey of selected Published online in Wiley InterScience (www.interscience.wiley.
journals between 1980 and 1992 showed that only a com).
small and variable percentage (between 633%) of Throughout this procedure the two women who back
studies recorded some form of composite global rating translated from Japanese into English remained blind
of severity for the disorder [Weise et al., 1996]. to the original English instrument.
A promising research instrument to settle this
confusing state is the Panic Disorder Severity Scale PATIENTS
(PDSS), formerly called Cornell-Yale Panic Anxiety
The study sample consisted of 77 psychiatric out-
Scale or Multicenter Panic Anxiety Scale, an interview-
patients who currently met DSM-IV criteria for panic
based, seven-item scale for assessing the overall severity
disorder in Nagoya City University Hospital (n 26)
of panic disorder. It was modeled after the Yale-Brown
and Showa University School of Medicine Hospital
Obsessive Compulsive Scale [Goodman et al., 1989a,
(n 51) between January 2002 and January 2003.
b], field-tested, and published in 1997 [Shear et al.,
Diagnosis was ascertained by the Structured Clinical
1997]. The usual time frame for rating is the past
Interview for DSM-IV (SCID-IV). This study was
month, and the seven areas covered include: frequency
approved by the institutional Ethics Committee, and
of panic attacks, distress during panic attacks, antici-
patients provided signed informed consent to partici-
patory anxiety, agoraphobic fear/avoidance, interocep-
pate in this research.
tive fear/avoidance, impairment of work functioning,
and impairment of social functioning. Each item is
rated on a 04 scale, with higher ratings indicating PROCEDURE AND INSTRUMENTS
greater degrees of symptom severity. Excellent inter- All the patients were administered the Japanese
rater reliability, moderate internal consistency relia- PDSS by psychiatrists or a doctoral-level clinical
bility and satisfactory concurrent validity, and good psychologist. For 66 patients, the interview was
sensitivity to change have been reported [Shear et al., conducted by two independent examiners, one of
1997, 2001]. whom conducted the interview while the other
The PDSS is gaining rapid acceptance internation- observed and made independent, blind ratings. At the
ally, being translated into at least six languages by 2001 same time with the PDSS, the patients were asked to
[Shear et al., 2001]. Psychometric properties of these fill in the self-report questionnaire battery containing
non-English versions have not yet been reported, Fear Questionnaire (FQ) [Marks, 1986], Mobility
however, and the cross-cultural validity of the PDSS Inventory for agoraphobia (MI) [Chambless et al.,
is not yet known. The present authors developed the 1985], Agoraphobic Cognitions Questionnaire (ACQ)
Japanese version of the PDSS with the kind coopera- [Chambless et al., 1984], Body Sensations Question-
tion of the original developers of the scale. The aims of naire (BSQ) [Chambless et al., 1984], Symptom
the present study are to analyze the factor structure of Checklist-90-Revised (SCL-90-R) [Derogatis, 1992]
the instrument, to report its reliability and validity, and and Work, Home management, Social and Private
to provide some rules of thumb to facilitate the leisure activities Scale (WHL) [Marks, 1986].
interpretation of the scales scores. Fear Questionnaire. A self-report instrument for
measuring severity of phobic avoidance [Marks, 1986].
The patients are asked to choose a number between 0
PATIENTS AND METHODS (would not avoid it) to 8 (always avoid it) to show how
much he/she would avoid each of the listed situations
TRANSLATION OF THE PDSS because of fear or other unpleasant feelings. The
With the original authors permission, our team in anchor points are therefore in nine grades. The
the Department of Psychiatry and Cognitive-Behavior- situations include agoraphobia, nosophobia, and social
al Medicine of the Nagoya City University Graduate phobia. Good testretest reliability and factor validity
School of Medical Sciences translated the original have been demonstrated [Marks and Mathews, 1979].
English PDSS into Japanese. We followed the standard Mobility Inventory for agoraphobia. A self-report
procedure of back translation for cross-cultural adapta- instrument for measuring the severity of agoraphobic
tion of an original English psychometric instrument avoidance [Chambless et al., 1985]. The patients are
[Brislin, 1970]. One of the authors (T.A.F.) translated asked about 31 places and situations that they may
the English PDSS into Japanese first. This preliminary avoid because of anxiety or phobia. They answer with a
Japanese PDSS was back translated into English by two number between 1 (never avoid) to 5 (always avoid), in
Japanese women who had 15 years living experiences five grades. The scales reliability and concurrent and
in English-speaking countries and one of whom had a construct validity have been reported [Chambless et al.,
bachelors degree in psychology. The back translated 1985].
version was examined against the original by the Agoraphobic Cognitions Questionnaire and
original developers of the scale who pointed out Body Sensations Questionnaire. Questionnaires de-
possible discrepancies. T.A.F. then corrected the signed to measures aspects of fear of fear observed in
Japanese translation accordingly. This process was patients with panic disorder: the former assesses
repeated three times until all agreed that the original maladaptive cognitions concerning potential harm of
and back translated versions matched closely. a panic attack and the latter focuses on exaggerated fear
Research Article: Japanese Version of PDSS 19
response touched off by sensations associated with PDSS item and self-report measures thought to reflect
anxiety [Chambless et al., 1984]. There are 14 and 17 the item content.
items, respectively, each rated in five grades. Both Item 1 of the PDSS asks about the frequency of
instruments have been shown to have good reliability panic attacks during the past month. This should
and discriminant and construct validity [Chambless correlate with the self-reported MI subscale of panic
et al., 1984]. frequency for the past 3 weeks. Item 2 of the PDSS asks
Symptom Checklist-90 Revised. A widely-used about the distress associated with panic attacks during
assessment tool for general psychopathology [Deroga- the past month. This should correlate with the MI
tis, 1992]. It contains 90 items, subdivided into subscale of the severity of panic attacks. PDSS Item 3
nine subscales of somatization, obsessive-compulsive, concerns the severity of anticipatory anxiety in-
interpersonal sensitivity, depression, anxiety, hostility, between panic attacks. This should be reflected in the
phobic anxiety, paranoid ideation, and psychoticism. anxiety subscale of SCL-90-R. PDSS Item 4 asks about
Work, Home Management, Social and Private the severity of agoraphobia and avoidance, which the
Leisure Activities Scale. A self-report instrument for corresponding subscales of SCL-90-R, FQ, and MI
measuring the severity of functional impairments in the should also be measuring. PDSS Item 5 is concerned
work, home management, and social and private with the fear and avoidance of panic-related physical
activities [Marks, 1986]. The patients answers are sensations. This should correlate with self-reported
graded between 0 (not at all impaired) to 8 (very BSQ. Items 6 and 7 of the PDSS ask about the
severely impaired). Satisfactory reliability and construct impairments in work and social functioning, respec-
validity have been reported [Mundt et al., 2002]. tively, and must correlate with the corresponding
For the subsample recruited at Nagoya City Uni- subscales of the WHL.
versity Hospital, the global psychopathology of the Interpretative guides for the Japanese PDSS. For
patient was evaluated with Clinical Global Impression a psychometric instrument to be clinically useful, it
(CGI) severity by two independent assessors. This is a needs be interpretable. We used the anchor-based
measure of the severity of the disorder according to the approach [Guyatt et al., 2002] to establish the rough
clinicians clinical global judgment [Guy, 1976], rated rules of thumb in interpreting the total scores of the
from 1 (not ill) to 7 (most severe) in seven grades. The PDSS. After ascertaining that the CGI severity is at
inter-rater reliability of the CGI for the present sample least moderately correlated with the PDSS, we used
was an ANOVA intraclass correlation coefficient of regression analyses to define PDSS scores that would
0.72 (95% CI 0.31 to 0.89). We used the average correspond with severe, moderate, or mild severity of
score of two independent raters for further analyses. the panic disorder.
RESULTS
ANALYSES
PATIENTS
We used SPSS 11.0J for Windows [SPSS Inc., 2001]
for statistical analyses. The mean age of the 77 patients was 35.8 years
Factor analysis. The factor analysis is the best (sd 11.0, range 1964). There were 23 males (30%)
method for examining the conceptual equivalence of a and 54 females (70%). Sixty-two of them (81%) were
psychological scale in dif ferent cultures [Irvine and suffering from panic disorder with agoraphobia.
Carroll, 1980; Mumford et al., 1991]. We used the
scree plot to determine the number of factors to be FACTOR STRUCTURE
extracted, because this method has been demonstrated Figure 1 shows the scree plot from the principal
to yield the most consistent results across various component factor analysis of the PDSS. It clearly
situations [Zwick and Velicer, 1982]. We had expected shows one factor to be extracted, just like the original
one factor to be extracted as in the original version. We version. Table 1 shows the item-remainder correlations
also examined the item-remainder correlations (i.e., for all seven items of the PDSS. The correlation
correlation of each item with the sum of the remaining coef ficients were moderate to substantial.
items) to confirm the one-factor solution. We will proceed with the one-factor solution of the
Reliability. The internal consistency reliability of Japanese PDSS.
the scale was estimated with Cronbachs alpha coef fi-
cients. Cronbachs alpha should be above 0.70, but
probably not higher than 0.90 [Nunnally, 1978]. RELIABILITY
The inter-rater reliability was estimated with analysis Cronbachs alpha coefficient was 0.86, denoting
of variance intraclass correlation coef ficient (ANOVA excellent internal consistency reliability.
ICC). ANOVA ICC should generally be above 0.7 for Table 2 shows inter-rater reliability for each item as
the scale to have good reliability. well as the total score of the PDSS. All ANOVA ICCs
Validity. Concurrent validity of the Japanese PDSS were 40.9, again demonstrating very good inter-rater
was examined by calculating correlations between each agreement.
20 Yamamoto et al.
4 VALIDITY
Table 3 shows correlation coefficients between each
PDSS items and the corresponding self-report scales as
3 hypothesized in the Methods section. All the coef fi-
cients were moderate to substantive, except for Item 5
with BSQ.
Eigenvalue
INTERPRETATIVE GUIDES
1
The correlation coefficient between total PDSS and
CGI severity was 0.61 (95% CI 0.26 to 0.82). Figure
2 shows the linear regression analysis of the PDSS on
CGI severity. Because Score 3 of CGI is anchored as
0
mild, Score 4 as moderate, Score 5 as marked,
1 2 3 4 5 6 7
Score 6 as severe, and Score 7 as most extremely ill,
Component Number
the regression equation would suggest that PDSS
Fig. 1. Scree plot for the Japanese PDSS (principal component scores around 8 correspond with mild panic disorder,
factor analysis). those around 11 with moderate panic disorder, those
around 14 with marked panic disorder, and 16 or
above with severe to very severe panic disorder
TABLE 1. Item-remainder correlations for the Japanese among those who are already diagnosed with panic
PDSS disorder.
Chambless DL, Caputo GC, Bright P, Gallagher R. 1984. Assess- Mumford DB, Whitehouse AM, Platts M. 1991. Sociocultural
ment of fear of fear in agoraphobics: The Body Sensations correlates of eating disorders among Asian schoolgirls in Bradford.
Questionnaire and the Agoraphobic Cognitions Questionnaire. J Br J Psychiatry 158:222228.
Consult Clin Psychol 52:10901097. Mundt JC, Marks, IM, Shear, MK, Greist, JM. 2002. The Work and
Chambless DL, Caputo GC, Jasin SE, Gracely EJ, Williams C. 1985. Social Adjustment Scale: A simple measure of impairment in
The Mobility Inventory for Agoraphobia. Behav Res Ther 23: functioning. Br J Psychiatry 180:461464.
3544. Nunnally JC. 1978. Psychometric Theory. New York: McGraw-Hill.
Derogatis LR. 1992. SCL-90-R: Administration, scoring and Rapee RM, Craske MG, Barlow DH. 1994/1995. Assessment
procedures manual-II for the R(evised) version and other instru- instrument for panic disorder that includes fear of sensation-
ments of the psychopathology rating scale series. Towson, MD: producing activities: The Albany Panic and Phobia Questionnaire.
Clinical Psychometric Research, Inc. 71 p. Anxiety 1:114122.
Goodman WK, Price LH, Rasmussen SA, Mazure C, Fleischmann Reiss S, Peterson RA, Gursky DM, McNally RJ. 1986. Anxiety
RL, Hill CL, Heninger GR, Charney DS. 1989a. The Yale-Brown sensitivity, anxiety frequency and the prediction of fearfulness.
Obsessive Compulsive Scale. I. Development, use, and reliability. Behav Res Ther 24:18.
Arch Gen Psychiatry 46:10061011. Shear MK, Maser JD. 1994. Standardized assessment for panic
Goodman WK, Price LH, Rasmussen SA, Mazure C, Delgado P, disorder research. Arch Gen Psychiatry 51:346354.
Heninger GR, Charney DS. 1989b. The Yale-Brown Obsessive Shear MK, Brown TA, Barlow DH, Money R, Sholomskas DE,
Compulsive Scale. II. Validity. Arch Gen Psychiatry 46: Woods SW, Gorman JM, Papp LA. 1997. Multicenter collabora-
10121016. tive panic disorder severity scale. Am J Psychiatry 154:15711575.
Guy W. 1976. ECDEU Assessment Manual for Psychopharmaco- Shear MK, Clark D, Feske U. 1998. The road to recovery in panic
logy. Rockville, Maryland: U.S. Department of Health and Human disorder: Response, remission, and relapse. J Clin Psychiatry
Services. 59(Suppl):48.
Guyatt G, Walter S, Norman G. 1987. Measuring change over time: Shear MK, Rucci P, Williams J, Frank E, Grochocinski V, Vander Bilt
Assessing the usefulness of evaluative instruments. J Chronic Dis J, Houck P, Wang T. 2001. Reliability and validity of the Panic
40:171178. Disorder Severity Scale replication and extension. J Psychiatr Res
Guyatt GH, Osoba D, Wu AW, Wyrwich KW, Norman GR. 2002. 35:293296.
Methods to explain the clinical significance of health status SPSS Inc. 2001. SPSS for Windows Version 11.0. Chicago: SPSS Inc.
measures. Mayo Clin Proc 77:371383. Weise RE, Shear MK, Maser JD. 1996. On the need for
Irvine SH, Carroll WK. 1980. Testing and assessment across cultures: standardization in panic disorder treatment research: Survey of
Issues in methodology and theory. In: Triandis HC, Berry JW, the literature, 1980-1992. Anxiety 2:257264.
editors. Handbook of cross-cultural psychology. Vol. 2. Methodo- Wolfe BE, Maser JD. 1994. Treatment of panic disorder: A consensus
logy. Boston: Allyn and Bacon, Inc. p 181244. development conference. Washington, DC: American Psychiatric
Marks IM, Mathews AM. 1979. Brief standard self-rating for phobic Press.
patients. Behav Res Ther 17:263267. Zwick WR, Velicer WF. 1982. Factors influencing four rules for
Marks IM. 1986. Behavioural psychotherapy: Maudsley pocket book determining the number of components to retain. Multivar Behav
of clinical management. Bristol: IOP Publishing. 133 p. Res 17:253269.