Sie sind auf Seite 1von 6

DEPRESSION AND ANXIETY 20:1722 (2004)

Research Article
CROSS-CULTURAL EVALUATION OF THE
PANIC DISORDER SEVERITY SCALE IN JAPAN
Ikuyo Yamamoto, M.D.,1 Yumi Nakano, M.D., Ph.D.,1 Norio Watanabe, M.D.,1 Yumiko Noda,1
Toshi A. Furukawa, M.D., Ph.D.,1* Takahiro Kanai, M.D., Ph.D.,2 Osamu Takashio, M.D., Ph.D.,3
Rumiko Koda, M.D.,3 Tempei Otsubo, M.D., Ph.D.,3 and Kunitoshi Kamijima, M.D., Ph.D.3

The Panic Disorder Severity Scale (PDSS) [Shear et al., 1997] is rapidly
gaining world-wide acceptance as a standard global severity measure of panic
disorder, however, its cross-cultural validity and reliability have not been
reported yet. We developed the Japanese version of the PDSS and examined its
factor structure, internal consistency and inter-rater reliability and concurrent
validity among Japanese patients with panic disorder with or without
agoraphobia. We also established rules of thumb for interpreting PDSS total
scores, taking the Clinical Global Impression severity scale as the anchoring
criterion. The identical one-factor structure of the PDSS was confirmed among
the Japanese patients as among the United States patients. Both internal and
inter-rater reliability was excellent (Cronbachs alpha was 0.86, and ANOVA
ICCs were all above 0.90). Concurrent validity of the PDSS items with self-
report questionnaires tapping similar or overlapping domains was satisfactory
(Pearson correlation coefficients were mostly above 0.5). Using the anchor-based
approach, the following interpretative guides are suggested: among those with
established panic disorder diagnosis, PDSS total scores up to 10 correspond with
mild, those between 11 and 15 with moderate, and those at or above 16
correspond with severe panic disorder. The present findings support the cross-
cultural generalizability of panic disorder symptomatology and of the PDSS, in
particular. Depression and Anxiety 20:1722, 2004. & 2004 Wiley-Liss, Inc.

Key words: panic disorder; psychiatric status rating scales; reproducibility of results;
cross-cultural comparison

INTRODUCTION 1
Department of Psychiatry and Cognitive-Behavioral Medi-
Since its introduction in DSM-III in 1980, panic cine, Nagoya City University Graduate School of Medical
Sciences, Nagoya, Japan
disorder has been the focus of much research interest 2
Department of Psychiatry, Toyohashi Municipal Hospital,
around the world. Ten years later, however, a consensus
Toyohashi, Japan
development conference for the treatment of panic 3
Department of Psychiatry, Showa University School of
disorder was convened at the U.S. National Institute of Medicine, Tokyo, Japan
Mental Health and came to the conclusion that there
was an urgent need for standardized diagnostic and *Correspondence to: Professor Toshi A. Furukawa, Dept. of
treatment outcome measures to enable direct compar- Psychiatry and CognitiveBehavioral Medicine, Nagoya City
University Graduate School of Medical Sciences, Mizuho-cho,
isons between different research settings and different
Mizuho-ku, Nagoya 467-8601 Japan.
treatment strategies [Wolfe and Maser, 1994]. At an E-mail: furukawa@med.nagoya-cu.ac.jp
ensuing meeting to standardize the assessment meth-
ods, key researchers from 26 different sites failed to Received for publication 21 October 2003; Revised 12 June 2004;
endorse any extant instrument(s) as the best for rating Accepted 16 June 2004
the overall illness severity [Shear and Maser, 1994; DOI 10.1002/da.20029
Shear et al., 1998]. A systematic survey of selected Published online in Wiley InterScience (www.interscience.wiley.
journals between 1980 and 1992 showed that only a com).

& 2004 WILEY-LISS, INC.


18 Yamamoto et al.

small and variable percentage (between 633%) of Throughout this procedure the two women who back
studies recorded some form of composite global rating translated from Japanese into English remained blind
of severity for the disorder [Weise et al., 1996]. to the original English instrument.
A promising research instrument to settle this
confusing state is the Panic Disorder Severity Scale PATIENTS
(PDSS), formerly called Cornell-Yale Panic Anxiety
The study sample consisted of 77 psychiatric out-
Scale or Multicenter Panic Anxiety Scale, an interview-
patients who currently met DSM-IV criteria for panic
based, seven-item scale for assessing the overall severity
disorder in Nagoya City University Hospital (n 26)
of panic disorder. It was modeled after the Yale-Brown
and Showa University School of Medicine Hospital
Obsessive Compulsive Scale [Goodman et al., 1989a,
(n 51) between January 2002 and January 2003.
b], field-tested, and published in 1997 [Shear et al.,
Diagnosis was ascertained by the Structured Clinical
1997]. The usual time frame for rating is the past
Interview for DSM-IV (SCID-IV). This study was
month, and the seven areas covered include: frequency
approved by the institutional Ethics Committee, and
of panic attacks, distress during panic attacks, antici-
patients provided signed informed consent to partici-
patory anxiety, agoraphobic fear/avoidance, interocep-
pate in this research.
tive fear/avoidance, impairment of work functioning,
and impairment of social functioning. Each item is
rated on a 04 scale, with higher ratings indicating PROCEDURE AND INSTRUMENTS
greater degrees of symptom severity. Excellent inter- All the patients were administered the Japanese
rater reliability, moderate internal consistency relia- PDSS by psychiatrists or a doctoral-level clinical
bility and satisfactory concurrent validity, and good psychologist. For 66 patients, the interview was
sensitivity to change have been reported [Shear et al., conducted by two independent examiners, one of
1997, 2001]. whom conducted the interview while the other
The PDSS is gaining rapid acceptance internation- observed and made independent, blind ratings. At the
ally, being translated into at least six languages by 2001 same time with the PDSS, the patients were asked to
[Shear et al., 2001]. Psychometric properties of these fill in the self-report questionnaire battery containing
non-English versions have not yet been reported, Fear Questionnaire (FQ) [Marks, 1986], Mobility
however, and the cross-cultural validity of the PDSS Inventory for agoraphobia (MI) [Chambless et al.,
is not yet known. The present authors developed the 1985], Agoraphobic Cognitions Questionnaire (ACQ)
Japanese version of the PDSS with the kind coopera- [Chambless et al., 1984], Body Sensations Question-
tion of the original developers of the scale. The aims of naire (BSQ) [Chambless et al., 1984], Symptom
the present study are to analyze the factor structure of Checklist-90-Revised (SCL-90-R) [Derogatis, 1992]
the instrument, to report its reliability and validity, and and Work, Home management, Social and Private
to provide some rules of thumb to facilitate the leisure activities Scale (WHL) [Marks, 1986].
interpretation of the scales scores. Fear Questionnaire. A self-report instrument for
measuring severity of phobic avoidance [Marks, 1986].
The patients are asked to choose a number between 0
PATIENTS AND METHODS (would not avoid it) to 8 (always avoid it) to show how
much he/she would avoid each of the listed situations
TRANSLATION OF THE PDSS because of fear or other unpleasant feelings. The
With the original authors permission, our team in anchor points are therefore in nine grades. The
the Department of Psychiatry and Cognitive-Behavior- situations include agoraphobia, nosophobia, and social
al Medicine of the Nagoya City University Graduate phobia. Good testretest reliability and factor validity
School of Medical Sciences translated the original have been demonstrated [Marks and Mathews, 1979].
English PDSS into Japanese. We followed the standard Mobility Inventory for agoraphobia. A self-report
procedure of back translation for cross-cultural adapta- instrument for measuring the severity of agoraphobic
tion of an original English psychometric instrument avoidance [Chambless et al., 1985]. The patients are
[Brislin, 1970]. One of the authors (T.A.F.) translated asked about 31 places and situations that they may
the English PDSS into Japanese first. This preliminary avoid because of anxiety or phobia. They answer with a
Japanese PDSS was back translated into English by two number between 1 (never avoid) to 5 (always avoid), in
Japanese women who had 15 years living experiences five grades. The scales reliability and concurrent and
in English-speaking countries and one of whom had a construct validity have been reported [Chambless et al.,
bachelors degree in psychology. The back translated 1985].
version was examined against the original by the Agoraphobic Cognitions Questionnaire and
original developers of the scale who pointed out Body Sensations Questionnaire. Questionnaires de-
possible discrepancies. T.A.F. then corrected the signed to measures aspects of fear of fear observed in
Japanese translation accordingly. This process was patients with panic disorder: the former assesses
repeated three times until all agreed that the original maladaptive cognitions concerning potential harm of
and back translated versions matched closely. a panic attack and the latter focuses on exaggerated fear
Research Article: Japanese Version of PDSS 19

response touched off by sensations associated with PDSS item and self-report measures thought to reflect
anxiety [Chambless et al., 1984]. There are 14 and 17 the item content.
items, respectively, each rated in five grades. Both Item 1 of the PDSS asks about the frequency of
instruments have been shown to have good reliability panic attacks during the past month. This should
and discriminant and construct validity [Chambless correlate with the self-reported MI subscale of panic
et al., 1984]. frequency for the past 3 weeks. Item 2 of the PDSS asks
Symptom Checklist-90 Revised. A widely-used about the distress associated with panic attacks during
assessment tool for general psychopathology [Deroga- the past month. This should correlate with the MI
tis, 1992]. It contains 90 items, subdivided into subscale of the severity of panic attacks. PDSS Item 3
nine subscales of somatization, obsessive-compulsive, concerns the severity of anticipatory anxiety in-
interpersonal sensitivity, depression, anxiety, hostility, between panic attacks. This should be reflected in the
phobic anxiety, paranoid ideation, and psychoticism. anxiety subscale of SCL-90-R. PDSS Item 4 asks about
Work, Home Management, Social and Private the severity of agoraphobia and avoidance, which the
Leisure Activities Scale. A self-report instrument for corresponding subscales of SCL-90-R, FQ, and MI
measuring the severity of functional impairments in the should also be measuring. PDSS Item 5 is concerned
work, home management, and social and private with the fear and avoidance of panic-related physical
activities [Marks, 1986]. The patients answers are sensations. This should correlate with self-reported
graded between 0 (not at all impaired) to 8 (very BSQ. Items 6 and 7 of the PDSS ask about the
severely impaired). Satisfactory reliability and construct impairments in work and social functioning, respec-
validity have been reported [Mundt et al., 2002]. tively, and must correlate with the corresponding
For the subsample recruited at Nagoya City Uni- subscales of the WHL.
versity Hospital, the global psychopathology of the Interpretative guides for the Japanese PDSS. For
patient was evaluated with Clinical Global Impression a psychometric instrument to be clinically useful, it
(CGI) severity by two independent assessors. This is a needs be interpretable. We used the anchor-based
measure of the severity of the disorder according to the approach [Guyatt et al., 2002] to establish the rough
clinicians clinical global judgment [Guy, 1976], rated rules of thumb in interpreting the total scores of the
from 1 (not ill) to 7 (most severe) in seven grades. The PDSS. After ascertaining that the CGI severity is at
inter-rater reliability of the CGI for the present sample least moderately correlated with the PDSS, we used
was an ANOVA intraclass correlation coefficient of regression analyses to define PDSS scores that would
0.72 (95% CI 0.31 to 0.89). We used the average correspond with severe, moderate, or mild severity of
score of two independent raters for further analyses. the panic disorder.

RESULTS
ANALYSES
PATIENTS
We used SPSS 11.0J for Windows [SPSS Inc., 2001]
for statistical analyses. The mean age of the 77 patients was 35.8 years
Factor analysis. The factor analysis is the best (sd 11.0, range 1964). There were 23 males (30%)
method for examining the conceptual equivalence of a and 54 females (70%). Sixty-two of them (81%) were
psychological scale in dif ferent cultures [Irvine and suffering from panic disorder with agoraphobia.
Carroll, 1980; Mumford et al., 1991]. We used the
scree plot to determine the number of factors to be FACTOR STRUCTURE
extracted, because this method has been demonstrated Figure 1 shows the scree plot from the principal
to yield the most consistent results across various component factor analysis of the PDSS. It clearly
situations [Zwick and Velicer, 1982]. We had expected shows one factor to be extracted, just like the original
one factor to be extracted as in the original version. We version. Table 1 shows the item-remainder correlations
also examined the item-remainder correlations (i.e., for all seven items of the PDSS. The correlation
correlation of each item with the sum of the remaining coef ficients were moderate to substantial.
items) to confirm the one-factor solution. We will proceed with the one-factor solution of the
Reliability. The internal consistency reliability of Japanese PDSS.
the scale was estimated with Cronbachs alpha coef fi-
cients. Cronbachs alpha should be above 0.70, but
probably not higher than 0.90 [Nunnally, 1978]. RELIABILITY
The inter-rater reliability was estimated with analysis Cronbachs alpha coefficient was 0.86, denoting
of variance intraclass correlation coef ficient (ANOVA excellent internal consistency reliability.
ICC). ANOVA ICC should generally be above 0.7 for Table 2 shows inter-rater reliability for each item as
the scale to have good reliability. well as the total score of the PDSS. All ANOVA ICCs
Validity. Concurrent validity of the Japanese PDSS were 40.9, again demonstrating very good inter-rater
was examined by calculating correlations between each agreement.
20 Yamamoto et al.

4 VALIDITY
Table 3 shows correlation coefficients between each
PDSS items and the corresponding self-report scales as
3 hypothesized in the Methods section. All the coef fi-
cients were moderate to substantive, except for Item 5
with BSQ.
Eigenvalue

INTERPRETATIVE GUIDES
1
The correlation coefficient between total PDSS and
CGI severity was 0.61 (95% CI 0.26 to 0.82). Figure
2 shows the linear regression analysis of the PDSS on
CGI severity. Because Score 3 of CGI is anchored as
0
mild, Score 4 as moderate, Score 5 as marked,
1 2 3 4 5 6 7
Score 6 as severe, and Score 7 as most extremely ill,
Component Number
the regression equation would suggest that PDSS
Fig. 1. Scree plot for the Japanese PDSS (principal component scores around 8 correspond with mild panic disorder,
factor analysis). those around 11 with moderate panic disorder, those
around 14 with marked panic disorder, and 16 or
above with severe to very severe panic disorder
TABLE 1. Item-remainder correlations for the Japanese among those who are already diagnosed with panic
PDSS disorder.

PDSS item Pearson correlation coefficient (95% CI)

1 0.57 (0.46 to 0.68)


2 0.67 (0.56 to 0.78)
3 0.68 (0.58 to 0.78) 30
4 0.63 (0.52 to 0.74)
5 0.40 (0.29 to 0.51)
6 0.75 (0.65 to 0.85)
7 0.67 (0.56 to 0.78)
20
PDSS

TABLE 2. Inter-rater reliability of the Japanese PDSS

PDSS item ANOVA ICC (95% CI) 10

Total score 0.99 (0.98 to 0.99)


1 0.99 (0.99 to 1.00)
2 0.95 (0.92 to 0.97)
3 0.97 (0.96 to 0.98)
0
4 0.93 (0.90 to 0.96)
1 2 3 4 5 6 7
5 0.98 (0.98 to 0.99)
6 0.90 (0.84 to 0.94) CGI severity
7 0.94 (0.90 to 0.96) Fig. 2. Linear regression of CGI severity on PDSS total score.

TABLE 3. Concurrent validity with self-report questionnaires

PDSS Item Self-report questionnaires n Pearson correlation coefficients (95% CI)


1 MI frequency 69 0.45 (0.33 to 0.57)
2 MI severity 40 0.56 (0.41 to 0.71)
3 Symptom Check List-90-R Anxiety 31 0.47 (0.29 to 0.65)
4 Symptom Check List-90-R Phobic anxiety 31 0.64 (0.47 to 0.81)
4 FQ agoraphobia 73 0.49 (0.38 to 0.60)
4 MI total 70 0.58 (0.46 to 0.70)
5 BSQ 70 0.25 (0.15 to 0.35)
6 WHLS (average of work and home subscales) 39 0.51 (0.35 to 0.67)
7 WHLS (social leisure subscale) 38 0.66 (0.51 to 0.81)
Research Article: Japanese Version of PDSS 21

DISCUSSION established, PDSS total scores up to 10 would


correspond with mild panic disorder, those between
We confirmed the single factor structure of the 1115 with moderate to marked panic disorder, and
Japanese PDSS and demonstrated its excellent internal those with 16 or more with severe panic disorder.
as well as external reliability and its satisfactory Although we did not administer PDSS to those who do
concurrent validity. We further reported the rules of not suffer currently from panic disorder and therefore
thumb for interpreting the PDSS. cannot know the cutof f for the instrument when used
The first published study of the PDSS [Shear et al., as a screener, Shear et al. [2001] suggested the cutoff
1997] reported two-factor solution for the seven-item score of 8 to pick up current panic disorder most
PDSS, with Items 1 and 2 (panic frequency and panic efficiently among the convenience sample of mood/
distress) loading on the first factor and the other five anxiety disorders. We think that this suggestion
on the second factor. This factor analysis was deemed coincides well with our findings.
tentative, however, because the sample was limited to There were some shortcomings in the present study.
panic disorder with no or limited agoraphobia and the First, we did not assess some important psychometric
resultant range restriction for some of the scale items characteristics including testretest reliability and
may have affected the psychometric behavior of the discriminant validity vis-a`-vis other anxiety disorders,
instrument. A second and a third study conducted with other mental disorders, and healthy patients. These
full range of panic disorder patients confirmed the one- must be examined in separate, future studies. Second,
factor structure of the scale [Shear et al., 2001]. Our ours was only cross-sectional and could not report on
results confirmed that the symptomatology as assessed the instruments sensitivity to change, another very
with the PDSS was similarly unidimensional among the important psychometric feature for any evaluative
Japanese patients. The item-remainder correlations instrument to be clinically useful [Guyatt et al.,
were again of very similar magnitude, in the range 1987]. Several studies have ascertained this feature for
between 0.600.80 for both the American and the the original PDSS [Shear et al., 1997; Barlow et al.,
Japanese samples [Shear et al., 2001]. 2000] and we are currently conducting a further study
The internal consistency reliability of the scale was with the PDSS after pharmacological and cognitive-
reported to be moderate in the first study, probably due behavioral treatment. Third, the number of patients
to the circumstances noted above (Cronbachs was relatively small for some of the concurrent validity
alpha 0.65). In the second study [Shear et al., 2001], checks, especially for the comparison between the
however, it was 0.88, a figure again very similar to ours. PDSS total score and the CGI severity. The substantive
The inter-rater reliability has always been excellent, correlations between these two measures (r .61) and
with ANOVA ICCs between 0.740.87 for individual corroborative data from the American study on the
items and 0.87 for the total score [Shear et al., 1997]. screening capability of the PDSS argue strongly for the
The Japanese PDSS demonstrated similar, if only appropriateness of our interpretative guide for the
better, inter-rater reliability. PDSS total score.
Different sets of self-report questionnaires were used In summary, the Japanese PDSS showed excellent
to examine the concurrent validity of the PDSS. The reliability and satisfactory validity for it to be used
first validation study reported moderate correlations clinically in the Japanese settings. The identical factor
between PDSS Item 3 (anticipatory anxiety) with the structure ascertained for both the English and the
Anxiety Sensitivity Index [Reiss et al., 1986], between Japanese versions of the instrument attests to the cross-
PDSS Item 4 (agoraphobic fear/avoidance) with cultural generalizability of measurement of panic
agoraphobia subscale of the Albany Panic and Phobia disorder symptomatology. We also provided rules of
Questionnaire [Rapee et al., 1994], between PDSS thumb for interpreting the PDSS total scores. This
Item 5 (interoceptive fear/avoidance) with interocep- interpretative guide needs be confirmed in a future
tive subscale of the same questionnaire, and between study with the original English PDSS.
PDSS Items 6 and 7 (work and social impairment) and
a questionnaire very similar to WHLS [Shear et al.,
1997]. The second study did not report correlations for Acknowledgments. We would like to thank Prof.
individual items of the PDSS but noted moderate to M.K. Shear and Ms. R. Palmieri for allowing us to
substantive correlations of the total score with the translate the PDSS into Japanese and for cooperating
Anxiety Sensitivity Index and the Beck Anxiety in the back translation process.
Inventory [Shear et al., 2001]. Our results confirm
and extend the concurrent validity between the PDSS
and self-report questionnaires reporting on similar or REFERENCES
overlapping domains. Barlow DH, Gorman JM, Shear MK, Woods SW. 2000. Cognitive-
To our knowledge, no study has yet reported on the behavioral therapy, imipramine, or their combination for panic
interpretative guides for the PDSS total scores. Using disorder: A randomized controlled trial. JAMA 283:25292536.
the anchor-based approach, we established that, among Brislin RW. 1986. Back-translation for cross-cultural research.
patients whose panic disorder diagnosis is already J Cross Cult Psychol 1:185216.
22 Yamamoto et al.

Chambless DL, Caputo GC, Bright P, Gallagher R. 1984. Assess- Mumford DB, Whitehouse AM, Platts M. 1991. Sociocultural
ment of fear of fear in agoraphobics: The Body Sensations correlates of eating disorders among Asian schoolgirls in Bradford.
Questionnaire and the Agoraphobic Cognitions Questionnaire. J Br J Psychiatry 158:222228.
Consult Clin Psychol 52:10901097. Mundt JC, Marks, IM, Shear, MK, Greist, JM. 2002. The Work and
Chambless DL, Caputo GC, Jasin SE, Gracely EJ, Williams C. 1985. Social Adjustment Scale: A simple measure of impairment in
The Mobility Inventory for Agoraphobia. Behav Res Ther 23: functioning. Br J Psychiatry 180:461464.
3544. Nunnally JC. 1978. Psychometric Theory. New York: McGraw-Hill.
Derogatis LR. 1992. SCL-90-R: Administration, scoring and Rapee RM, Craske MG, Barlow DH. 1994/1995. Assessment
procedures manual-II for the R(evised) version and other instru- instrument for panic disorder that includes fear of sensation-
ments of the psychopathology rating scale series. Towson, MD: producing activities: The Albany Panic and Phobia Questionnaire.
Clinical Psychometric Research, Inc. 71 p. Anxiety 1:114122.
Goodman WK, Price LH, Rasmussen SA, Mazure C, Fleischmann Reiss S, Peterson RA, Gursky DM, McNally RJ. 1986. Anxiety
RL, Hill CL, Heninger GR, Charney DS. 1989a. The Yale-Brown sensitivity, anxiety frequency and the prediction of fearfulness.
Obsessive Compulsive Scale. I. Development, use, and reliability. Behav Res Ther 24:18.
Arch Gen Psychiatry 46:10061011. Shear MK, Maser JD. 1994. Standardized assessment for panic
Goodman WK, Price LH, Rasmussen SA, Mazure C, Delgado P, disorder research. Arch Gen Psychiatry 51:346354.
Heninger GR, Charney DS. 1989b. The Yale-Brown Obsessive Shear MK, Brown TA, Barlow DH, Money R, Sholomskas DE,
Compulsive Scale. II. Validity. Arch Gen Psychiatry 46: Woods SW, Gorman JM, Papp LA. 1997. Multicenter collabora-
10121016. tive panic disorder severity scale. Am J Psychiatry 154:15711575.
Guy W. 1976. ECDEU Assessment Manual for Psychopharmaco- Shear MK, Clark D, Feske U. 1998. The road to recovery in panic
logy. Rockville, Maryland: U.S. Department of Health and Human disorder: Response, remission, and relapse. J Clin Psychiatry
Services. 59(Suppl):48.
Guyatt G, Walter S, Norman G. 1987. Measuring change over time: Shear MK, Rucci P, Williams J, Frank E, Grochocinski V, Vander Bilt
Assessing the usefulness of evaluative instruments. J Chronic Dis J, Houck P, Wang T. 2001. Reliability and validity of the Panic
40:171178. Disorder Severity Scale replication and extension. J Psychiatr Res
Guyatt GH, Osoba D, Wu AW, Wyrwich KW, Norman GR. 2002. 35:293296.
Methods to explain the clinical significance of health status SPSS Inc. 2001. SPSS for Windows Version 11.0. Chicago: SPSS Inc.
measures. Mayo Clin Proc 77:371383. Weise RE, Shear MK, Maser JD. 1996. On the need for
Irvine SH, Carroll WK. 1980. Testing and assessment across cultures: standardization in panic disorder treatment research: Survey of
Issues in methodology and theory. In: Triandis HC, Berry JW, the literature, 1980-1992. Anxiety 2:257264.
editors. Handbook of cross-cultural psychology. Vol. 2. Methodo- Wolfe BE, Maser JD. 1994. Treatment of panic disorder: A consensus
logy. Boston: Allyn and Bacon, Inc. p 181244. development conference. Washington, DC: American Psychiatric
Marks IM, Mathews AM. 1979. Brief standard self-rating for phobic Press.
patients. Behav Res Ther 17:263267. Zwick WR, Velicer WF. 1982. Factors influencing four rules for
Marks IM. 1986. Behavioural psychotherapy: Maudsley pocket book determining the number of components to retain. Multivar Behav
of clinical management. Bristol: IOP Publishing. 133 p. Res 17:253269.

Das könnte Ihnen auch gefallen