Sie sind auf Seite 1von 16

Are Hofstede’s dimensions valid?

A test for measurement invari-


ance of Uncertainty Avoidance1
Sind die Hofsted’schen Kulturdimensionen valide? Ein Messäquiva-
lenztest der Hofsted’schen Unsicherheitsvermeidungsdimension

Lena Schmitz Abstract (English)


Dr., Wissenschaftliche Mit-
On the base of a survey among IBM employees in the 1970s, Geerd Hofstede devel-
arbeiterin am f-bb (For-
oped a model which aims at comparing cultures of countries by means of originally
schungsinstitut Betrieb-
four, by now six dimensions. This model has evoked extreme and opposed reactions:
liche Bildung) in Berlin.
Many researchers use it as a paradigm for cross-national comparisons, while others
Promotion in International
criticise it harshly. One basic point of criticism refers to the validity of the dimensions.
Cultural and Business
The present study gives an empirical contribution to the mostly theoretical discussion
Studies an der Universität
Passau (2013) and conducts tests for the validity of one Hofstedean dimension, namely Uncertainty
Avoidance. Employing original data from France and Germany (2011), this dimen-
sion does not prove to be a valid construct.
Wiebke Weber
Keywords: Hofstede’s cultural dimensions model, Uncertainty Avoidance dimension,
Dr., Leiterin der For- measurement invariance, multigroup confirmatory factor analysis, validity
schungsgruppe European
Social Survey (ESS) am
Abstract (Deutsch)
Research and Expertise
Centre for Survey Metho- Auf Basis einer Umfrage unter IBM Mitarbeitern in den 1970er Jahren konzipierte
dology (RECSM) und Geerd Hofstede ein Modell, das darauf abzielt, nationale Kulturen anhand von vier,
Mitglied des Core Scienti- mittlerweile sechs Kulturdimensionen zu vergleichen. Dieses Modell hat extreme
fic Teams des ESS. Promo- Reaktionen in beide Richtungen hervorgerufen: Während einige Forscher ihm einen
tion in Politikwissenschaft paradigmatischen Stellenwert zuschreiben, wird es von anderen scharf kritisiert.
und Umfragemethodik an Einer der hauptsächlichen Kritikpunkte betrifft die Validität der Kulturdimensionen.
der Universitat Pompeu Die vorliegende Studie liefert einen empirischen Beitrag zur vorwiegend theoreti-
Fabra, Barcelona (2013) schen Diskussion und führt Validitätstests an einer der Dimensionen, namentlich
Unsicherheitsvermeidung, durch. Unter der Anwendung von Daten aus Frankreich
und Deutschland (2011) bestätigt sich diese Dimension nicht als valides Konstrukt.
Schlagwörter: Hofstedes Kulturdimensionenmodell, Unsicherheitsvermeidung, Mess-
äquivalenz, konfirmatorische Faktorenanalyse, multipler Gruppenvergleich, Validität

11
1. Introduction argue those challenging the model, the
paradigmatic use has not been reflected
In the 1960s, a new sub discipline of in a sufficiently critical way. The econo-
general psychology became institu- mist Brendan McSweeney, one of Hof-
tionalized, called cross-cultural psy- stede’s most famous critics, observes an
chology ( Jahoda and Krewer 1997: “on-going unquestioning acceptance of
3, 24). Until today, researchers of this Hofstede’s national culture research by
sub discipline have been following the his evangelized entourage” (McSweeney
aim of “comparing data from several 2002b:112).
cultures” (Triandis 1997:ix) in order to
detect intercultural differences, usually The present study retraces the discrep-
by means of standardized question- ancy of the extreme reactions to Hof-
naires (Smith and Schwartz 1997:81). stede’s model. We suspect that it is the
One of the most famous examples is debate about the validity of the cultural
the work of Geert Hofstede (Barmeyer dimensions which essentially contrib-
and Genkova 2010:122, Harrison / utes to the discrepancy. Can the Hofst-
McKinnon 1999:485). His comparison edean dimensions really serve as interna-
of national cultures2 is based on cultural tional standards of comparison? On
dimensions, which serve as standards which methodic foundation are they
of comparison. For a high number of based? To contribute to this debate, the
countries (Hofstede 2009:xix), Hof- remainder of the present article pro-
stede calculated scores in different ceeds as follows: First of all, the origins
dimensions, i. e. numeric values, which of the dimensions will be retraced. In
allow establishing international rank- chronological order, the different steps
ings and country clusters (Hofstede will be outlined, on the basis of which
2009:150). His approach has been the dimensions were composed and
evoking extreme reactions, in a positive filled with content. Thereafter, we will
as well as in a critical sense. One body present follow-up studies to the Model
of research uses it as a framework for a of Cultural Dimensions. Secondly,
high number of cross-cultural research Hofstede’s statement about the dimen-
projects (Blodgett et al. 2008:762, sions’ validity will be recapitulated. His
Barmeyer 2010:87). The list of areas in statement will then be confronted with
which the model is employed, contains the criticisms it evoked. This confronta-
a great variety3, ranging from informa- tion leads to the research questions of
tion technology (Myers / Tan 2002:25), the present study, if Hofstede’s cultural
management controlling (Harrison / dimensions can be considered valid con-
McKinnon 1999:485), innovation, structs or not. We test this hypothesis
leadership styles ( Jones 2007:6), over with regard to one of the dimensions,
intercultural relations, decision-making, the Uncertainty Avoidance dimension.
selection, training, job design, motiva- Therefore, we replicate Hofstede’s origi-
tion and human resource management nal questionnaire in a survey interrogat-
to marketing (Søndergaard 1994:453f.) ing German and French public school
and market research. Hofstede himself teachers and factory workers, and test
realizes: “Since the later 1980s the idea for measurement equivalence. In the
of dimensions of national cultures has final section we present the results and
become part of […] ‘normal science’” comment on their implications.
(Hofstede 2002:2). Accordingly, he
calls his book Culture’s Consequences.
Comparing Values, Behaviors, Institu- 2. Hofstede’s cultural
tions, and Organizations Across Nations dimensions theory
(1. edition 1980, 2. edition 2009, cop.
2001) a classic (Hofstede 2009:xvii). The starting point for the develop-
Thus, his dimension model has been ment of Hofstede’s cultural dimen-
cited, reviewed, replicated (Sønder- sions theory is best summarized by the
gaard 1994:447, Nakata 2009:3, Taras / following quotation of Geert Hofstede
Steel 2009:41) and used as a paradigm and his son, Gert Jan Hofstede: “In the
(Taras / Steel 2009:53). However, so late 1960s Geert accidentally became

12 interculture j ourna l 13/22 ( 2 0 1 4 )


interested in national cultural differ- Inkeles and Daniel Levinson (Hofstede
ences – and got access to rich data for 2009:31). Each standard analytic issue
studying them” (Hofstede / Hofstede represents one universal problem, that
2005:ix). The coincidence was Hofst- any kind of human society has to cope
ede’s involvement in developing and with (Hofstede 1998:10, Hofstede
conducting a survey for IBM, a U.S. 2009:xix) and each dimension is meant
American multinational technology to provide a bipolar (Bond / Smith
and consulting company, that aimed at 1993:41, Briley 2009:183f., Gröschke
studying the “job attitudes” (Hofstede 2007:41, McSweeney 2002b:105) solu-
et al. 1976:4) and respectively “employ- tion spectrum for one issue. People of
ee values” (Hofstede 2009:41) of its em- different countries, so the Hofstedean
ployees around the world. Thus, when argument, choose differently from the
the IBM-questionnaire was designed, solution spectrums and, therefore, on
the idea of cultural dimensions was not average they can be positioned at dif-
present yet (McSweeney 2002b:95, ferent points between the two opposite
Hofstede 2009:45). This is why Hofst- endpoint of each dimension6. Hofstede
edes acknowledges with regard to one of names his dimensions as follows: 1)
his dimensions, namely the Uncertainty Power Distance, 2) Individualism /
Avoidance dimension that Collectivism, 3) Masculinity / Feminin-
ity and 4) Uncertainty Avoidance. 1)
“It is possible that other and perhaps bet- Power Distance composes the spectrum
ter survey indicators of national levels of of solutions to the universal problem
uncertainty avoidance can be developed, of human inequality and describes the
but I had to use the data available in the
extent to which members of a country
IBM archives, and uncertainty avoidance
was not a familiar concept to us when accept and expect that power is distrib-
we composed the IBM questionnaire in uted unequally. The higher the score of
1967” (Hofstede 2009:148). a country in the Power Distance index,
the higher is the acceptance of unequal
Between 1967 and 1973 the survey power distribution. 2) Individualism /
was conducted in two rounds and was Collectivism is related to the universal
completed by 160,000 employees from task of individuals to integrate them-
72 countries in 20 languages (Hofstede selves into primary groups. Whereas
2009: 41). In the course of the analysis the members of individualist countries
of the obtained data, Hofstede and his prefer rather loosely-knit social frame-
colleagues found that in some cases works, the members of collectivist
the different departments within one countries rather rely on tightly-knit
country showed stronger variations ones. 3) The Masculinity / Femininity
than equivalent departments of differ- index tells if typically assumed male or
ent countries (Hofstede et al. 1976:20). female character traits predominate in
Regardless of this finding, Hofstede the respective country. In masculine
decided to focus on differences between cultures, people live out the contrast
countries, when he deduced his cultural between male and female traits more
dimensions from this study. He applied than in feminine cultures; this means
an explorative factor analysis (Hofst- that men show themselves especially
ede 2009:31) in order to detect the competitive and achievement-oriented
underlying relationships between the whereas women are particularly tender
given answers. This way, he found three and socially oriented. 4) The Uncer-
factors. One of them he split and then tainty Avoidance score reflects how
created four dimensions4. The obvious the society of a country copes with the
lack of statistical independence is one uncertainty of the future. The higher
of the points of criticism regarding the the score, the stronger the members of
dimensions (Behrens 2007:71). the respective country intend to avoid
ambiguity (Hofstede 2009:xix f.,29).
Hofstede chose to create exactly these
four dimensions5 to be able to draw After detecting and naming them, in
connections to the so-called “standard a following step Hofstede intends to
analytic issues” by the sociologists Alex prove the validity of the dimensions.

13
For this purpose, he points out correla- Area of Live Low score on the High score on the
tions between the national indices and Uncertainty Avoi- Uncertainty Avoi-
external data (Hofstede 2009:41). As dance dimension dance dimension
external data, he includes the findings
of empirical studies, anecdotes and per-
sonal experiences (Hofstede 2009:27) Expression of Expressions have to be Expression of emotions
as well as socio-economic indices Emotions controlled. normal
(Hofstede 2009:68f.). The number of
data considered is high: “The count of
significant and independent correlations
Subjective Well-Being More subjective well-being Less subjective well-being

has grown to more than 400” (Hofstede (Happiness)


2009:4). The approach of correlat-
ing dimension indices with external Trust Most people can be trusted One can’t be careful
data can best be demonstrated by an enough with other people,
not even with family
example. Regarding the Uncertainty
Avoidance dimension, Hofstede quotes In the Family Lenient rules on what is Tight rules on what is dirty
a study which compared the speed dirty and taboo and taboo
limits in fourteen countries. He discov-
ers that those countries with stricter
speed limits tend to be the ones which At School Dialect speech positively Dialect speech
valued negatively valued
in the IBM study achieved a relatively
low Uncertainty Avoidance score. He
interprets this correlation as follows: In Motivation Hope of success Fear of failure
“The emotionality in high-UAI cultures
produces a sense of stress, of urgency,
which in turn leads the people in those
cultures to want to drive faster” (Hof- In the Work Situation Top managers involved in Top managers involved in
strategy operations
stede 2009:174). This example offers to
illustrate the arguments of Hofstede’s
critics, who call the variety of connec- In Consumer Main car bought second- Main car bought new
tions, which Hofstede draws to external Behavior hand
data, boundless (Baumgartel / Thomas
1982:192) and nearly intuitive (Behrens
In Political Systems Strong interest in politics Weak interest in
2007:150). They state that he com- politics
pares studies which are so differently
conceptualized that their findings are
hardly comparable (Behrens 2007:15). In Legislation Citizens positive towards Citizens negative towards
legal system legal system
Furthermore, they suspect that he only
mentions those studies which fit well
in his picture (Behrens 2007:56f., Early Nationalism Proud of own nation, Not proud of own nation,
2009:31f., McSweeney 2002a:1366). willing to fight for it unwilling to fight for it
Finally, the interpretation of found cor-
relations seems doubtful (McSweeney
2002a:1366ff.). Regarding the example Xenophobia Immigrants tolerated Immigrants should be sent
back
above, he interprets, that people tend
to drive faster in order to avoid uncer-
tainty. An alternative equally plausible
interpretation is that strong Uncertainty Table 1: Extract of Hofstede’s typologies regarding the Uncertainty Avoidance dimension. Source:
Avoidance finds its manifestation in Hofstede 2009:160f., 169f., 180f.
strict speed limits, because the limits de-
crease the risk of sustaining an accident.
Thus, the direction of causality between because “correlation is not causation”
the average level of Uncertainty Avoid- (Holland 1986:945).
ance and speed limits in a given country
is not clear. In fact, one may wonder if On the basis of the correlations, Hofst-
there is a causal relationship at all ede assigns content to each dimension.

14 interculture j ourna l 13/22 ( 2 0 1 4 )


The content is presented in, as he labels members of one country share, as they
them, typologies. Typologies describe labels it, one national culture: “Culture
those countries with a high score in the represents the cultural mental program-
respective dimension in contrast to the ming that the nationals tend to have
ones with a low one. For both cases, in common” (Hofstede 1980:43). He
typical respectively common traits and has been aiming at discovering and
behavior are indicated, usually worded describing those national cultures and
as opposites. The traits and behavior by creating typologies he finally means
refer to all imaginable areas of life, such to reach this aim. Here, he transfers his
as work and family life, child and school findings which originally were based on
education, politics, beliefs and philoso- a survey with specific samples, to the re-
phy. Table 1 illustrates a brief extract spective countries as a whole describing
of Hofstede’s typologies with reference the national culture of these countries.7
to the Uncertainty Avoidance dimen- Consequently, it is the typologies which
sion, indicating how national cultures he recommends to be taught in intercul-
are in the respective areas of life if they tural textbooks and trainings (Hofstede
score low on the Uncertainty Avoidance 2002:2, Hofstede 2009:28).
dimension compared to those that score
high. Indeed, the Hofstedean model has
reached an outstanding level of signifi-
In this extract of typologies, it becomes cance not only within the discipline of
obvious, that the Uncertainty Avoid- cultural sciences but also far beyond.
ance construct is a quite multifaceted Significance means, that, on the one
one. If the great variety of its facets is hand, the model has frequently been
contradictory to the construct validity, discussed, in a critical as well as in a
remains to be seen. In any case, Hofst- supportive sense, and that, on the other
ede’s typologies evoke criticism. One hand, a high number of follow-up stud-
critical argument refers to their word- ies have been conducted. Already in the
ing. One typology for instance states first edition of Culture’s Consequences
that in countries with a low Uncertainty (1980), Hofstede suggests continued
Avoidance score “People feel happier” research in the disciplines of anthropol-
(Hofstede / Hofstede 2005:181). ogy, sociology, psychology, business,
Unfortunately, the key term happy is politics, law and medicine. Within these
quite wide. Moreover, some typolo- disciplines he advises to elaborate action
gies lack transferability to reality. For guidelines based on his model in order
instance, the typology regarding work to enforce its pragmatic applicability.
life says that members of countries with For instance, the study conducted by
a high score in the Uncertainty Avoid- Harrison et al. (1994) draws on three
ance index avoid taking decisions and Hofstedean dimensions in order to ex-
prefer extra structured work routines. In plain and predict differences in organi-
contrast, the members of countries with zational and management planning and
a low score work better with less struc- control practices in Anglo-American
tured routines. Consequently, adapted and East Asian nations. Moreover, he
at country level, this typology says recommends calculating the dimension
that, for example, Greeks need more scores of countries which were not part
structured routines than Swedes ( Jones of the IBM study, referring in particular
2007:6). But regardless of nationality, so to socialist and development countries
we counter, specific work tasks require (Hofstede 2009:461f.). His call has
specific levels of routine. been heard; the last decades brought
up a great quantity of discussions and
The typologies, so the Linguist Leila follow-up studies to his model (Sønder-
Behrens sums up, the critical arguments, gaard 1994:447, Hofstede 2009:66).
are untenable and therefore, frivolous Depending on the discipline, some
(Behrens 2007:2, 6, 84). Still, so shall dimensions have been spotlighted more
be underlined, they constitute the basic than others. For instance, Individual-
output of the Hofstedean model. This ism/ Collectivism and Masculinity/
is because Hofstede assumes that the Femininity have often been applied

15
within the area of psychology (Merritt (Søndergaard 1994:447). Hofstede
2000), whereas Power Distance and Un- slightly modifies this categorization.
certainty Avoidance were rather focused He divides the applications of his
on by sociologists and business scientists model into the following categories: 1)
(Hoppe 1990, Hastings / Hastings reviews and criticism, 2) extensions to
1981). Later on, Hofstede revises his new nations and regions, 3) replication
specification of disciplines that should studies and 4) paradigmatic uses (Hof-
apply his model: “Reviews and criti- stede 2009:461). Some examples of 1)
cisms are most interesting when they Reviews and criticism have already been
come from unexpected areas” (Hofstede mentioned. As far as 2) extensions to
2009:463). As unexpected areas, he new nations and regions is concerned,
mentions, among others, information two examples shall be mentioned: first
technology, archive management, and the master thesis by Nanhekhan (1990)
nuclear power regulation. Indeed, the and second the study by Nasierowski
variety of disciplines that apply the and Mikula (1998). The former applied
model is great. But, so Hofstede asserts, the IBM questionnaire in Surinam and
the follow-up studies also show a great the latter in Poland. 3) The replica-
variety of quality (Hofstede 2009:66). tions are the most frequent category
Therefore, he dedicates a whole chap- of follow-up studies. “Replications are
ter of Culture’s Consequences, entitled studies hat administer questions used
“Using Culture Dimension Scores in in the IBM research to new samples
Theory and Research” to his require- from two or more of the same coun-
ments for continued research (Hof- tries” (Hofstede 2009:463). Hofstede
stede 2009:461ff.). Here, he warns of appreciates those kinds of studies, as
several pitfalls. Researchers should, for
he uses them to confirm the validity of
instance, not misunderstand the IBM
his dimension constructs. Within the
questionnaire as a personality test for
validation of his constructs by interpret-
individuals. Furthermore, Hofstede
ing the correlations between his and
criticises an ethnocentristic approach
external data, he dedicates one sub-
of those researchers who leave out the
chapter per dimension to “[s]traight
Masculinity/Femininity dimension
replications of the IBM survey” (Hof-
because they consider it politically
stede 2009:91f., 154f., 219f., 295f.).
incorrect.
Within straight replications, the IBM
Now we will further analyze the dif- questionnaire is either applied in his
ferent kinds of follow-up studies. It is original version, or the formulation of
difficult to give a representative over- certain items is adapted to the context
view covering the past 35 years, as many of the sample (Søndergaard 1994:448,
follow-up studies are master thesises Hofstede 2009:67). In any case, most
and dissertations which either have not replication studies follow the aim of
been translated into English or which testing Hofstede’s international rank-
have not been published at all (Søn- ings and the majority of them confirm
dergaard 1994:450). Therefore, we will them (Søndergaard 1994:451). Those
concentrate on, first, the works analyzed not confirming are usually blamed for
by the Danish business scientist Mi- not having adapted the items adequately
kael Søndergaard, and, second, studies to the context of the samples (Sønder-
mentioned by Hofstede in his texts and gaard 1994:452). As far as the samples
third some additional ones. In 1994, are concerned, most replication studies
Søndergaard analyzed approximately do not include more than one sam-
550 applications of the Hofstedean ple per nation. They aim at detecting
model. He had access to Hofstede’s international differences rather than
private library which allowed him to in- differences between subcultures. Only
clude unpublished works that had been very few studies compare units that are
sent to Hofstede. Søndergaard divides smaller than nations. One study entitled
the applications into four categories: “Exploring subcultural differences in
Citations, reviews, empirical replica- Hofstede: The case of the Chinese”
tions and applications as a paradigm (Huo / Randall 1991:160) compares

16 interculture j ourna l 13/22 ( 2 0 1 4 )


samples from Taiwan, Beijing, Hong MBA students from Malaysia, Singa-
Kong and Wuhan, that means four pore and Hong Kong (Westwood / Ev-
regional subcultures facing different erett 1987:187). On the one hand, they
political situations. This kind of study checked, if their country scores matched
though stays an exception. those calculated by Hofstede, and, on
the other hand, they conducted a factor
“The disadvantages of replication and analysis to test, if their factors were
extension studies is that they are caught in
consistent with Hofstede’s dimensions -
the straitjacket of my model and therefore
unlikely to make basic new contributions”
which they were not (Westwood / Ever-
(Hofstede 2009:465). ett 1987:200). All in all, so Søndergaard
outlines, the replication studies are the
Here, Hofstede leads over to the fourth most popular kind of follow-up studies
category of applications: the paradig- (Søndergaard 1994:450ff.). Similar to
matic uses. Hereby, he means two kinds most paradigmatic uses, they rely on
of follow-up studies. First, he refers to the Hofstedean dimensions without
those which deal with the basic struc- questioning their validity.
ture of his model. They usually either
aim at proposing an additional dimen- Also Hoftstede considers his cultural
sion or they might find out that one or dimensions as valid constructs. As out-
more dimensions are not applicable in lined before, he proves this by correlat-
a certain region (Hofstede 2009:465). ing the scores countries achieve on his
An example with much impact was the dimensions with external data and the
study conducted by the so-called Chi- interpretation of these correlations
nese Culture Connection (1987) which (Hofstede 2002:4, Hofstede 2009:41).
detected that the Uncertainty Avoid- Accordingly, he states a wide appli-
ance was not applicable in Asia and, cability of his dimensions (Hofstede
therefore, added the fifth dimension, 1998:10, Nakata 2009:4). In fact, he
Long- Versus Short-Term Orientation. claims the applicability in two respects:
Besides the studies dealing with the Firstly, the dimensions are meant to be
number of dimensions, Hofstede counts applicable in a remarkably high number
those to the fourth category of paradig- of countries. However, he acknowledges
matic uses, which take the dimensions that they may not be applicable in any
as given and base their interpretation of kind of region but leave this to further
findings upon them. research (Hofstede 2009:461). Sec-
ondly, the dimensions are expected to
“In these cases Hofstede’s concepts were be applicable in all subsamples of these
used as a paradigm; as a set of assump-
countries. This is because, as it has been
tions taken for granted. Hofstede’s frame-
mentioned before, according to Hofst-
work was applied in a speculative manner
without any test or research based on the ede, national cultures are equally shared
concepts” (Søndergaard 1994:448). by all national members. Consequently,
for a replication study basically any
One example for a paradigmatic use of kind of subsamples can be chosen, not
this kind is the study by Chow, Shields only IBM employees. Hofstede en-
and Chan (1991). They aim at investi- courages replication studies (Hofstede
gating the influence of national culture 2009:461ff.). What he sets as a require-
to the high production activity of ment, is that the nations to be compared
Asians and therefore compare a sample are represented by matched samples.
from Singapore to one from the United “We can compare Spanish nurses with
States. Hereby, they rely on Hofstede’s Swedish nurses, or Spanish policemen
assumption that they are comparing a with Swedish policemen” (Hofstede
nation with a low Individualism score 2009:23). Hofstede underlines the need
to one with a high one (Chow et al. for equivalence among the samples; they
1991:215). Some follow-up studies should only differ in nationality. In case
also combine a replication with para- that the equivalence cannot be secured,
digmatic use. For instance, the study by he advises to build matched samples of
Westwood and Everett (1987) applied more than one occupational group. “If
the complete IBM questionnaire to 170 the differences we find in one sample set

17
are confirmed by those found by others Item Position Title Request for Response options
in other matched samples, our matching of item of battery answer
was adequate” (Hofstede 2009:23). within
Whereas Hofstede is convinced of the the
validity of his dimensions, his critics battery
remain skeptical: “The use of Hofstede’s
dimensions […] raises more problems A37 18 MORE How often do you 1. I always feel this way
than it solves” (Baskerville 2003:10). ABOUT feel nervous or tense 2. Usually
What they find problematic is the YOUR at work? 3. Sometimes
JOB 4. Seldom
dimensions’ face validity, the wording 5. I never feel this way.
of the items in the IBM questionnaire
and the specificity of the IBM sample. A43 18 MORE How long do you 1. Two years at the most
ABOUT think you will conti- 2. From two to five years
The face validity has been tested in the THE nue working for this 3. More than five years
course of a study conducted in 2008. COMPANY company? (but I will probably
Here, two groups of altogether 157 leave before I retire)
students with experience in behavioral 4. Until I retire
science were asked to match the items of B60 9 ABOUT Company rules 1. Strongly agree
the IBM questionnaire to the dimen- GENERAL should not be broken 2. Agree
sions. For instance, the items belonging BELIEFS – even when the 3. Undecided
to the Uncertainty Avoidance dimen- employee thinks it is 4. Disagree
in the company’s best 5. Strongly disagree
sion were correctly matched by only
interests.
30,4% of the one group and by only
26% of the other one. This means that
only a third respectively a fourth of the Table 2: The original items on the basis of which Hofstede calculated the Uncertainty Avoidance
respondents considered the three items indices. Source: Hofstede et al. 1976.
as reflectors of the Uncertainty Avoid-
ance dimension as elaborated by Hof-
stede. This rate is evaluated as problem- Steiner / Benesch 2010:51; Lienert /
atically low (Blodgett et al. 2008:762). Raatz 1998:52). Moreover, the response
These kinds of findings or simply the options of this item do not constitute
reconsideration of the wording of the fixed references points, so they are not
items, as we will do in the following necessarily understood in the same
section, leads scholars like Behrens way by every respondent (Saris 1988).
(2007:96) to conclude that the Uncer- Whereas, for instance once per week
tainty Avoidance turns out as fiction. could by perceived as sometimes by one
respondent, it could be considered
A possible lack of validity could be due
seldom by another. In turn, the catego-
to the wording of the items. The items
ries always and never are fixed reference
which the Uncertainty Avoidance di-
points, but according to recent findings
mension is based on are presented Table
they might be perceived unrealistic
2. Using the means of these items, Hof-
by the respondents (Raab-Steiner /
stede created a formula8 to calculate the
Benesch 2010:51). Furthermore, as
Uncertainty Avoidance indices for 50
far as item A43 is concerned, respond-
nations and three regions, namely West
ents could consider more than one
Africa, East Africa and several Arab
response option adequate. They could,
countries. In the international ranking,
for instance, plan to continue working
Greece has the highest score of 112 and
for the same company two years at the
Singapore has the lowest of 8. The mean
most, and at the same time, until they
is 65 and the standard deviation is 24
retire. Finally, regarding item B60, the
(Hofstede 2009:151).
wording is long-winded and, therefore,
From these items, a set of problems incomprehensible. Moreover, it con-
evolves. To begin with, Item A37 is tains a negation. Negations increase the
double-barreled because it contains two complexity of the item and, therefore,
different states of feelings: “nervous” decrease the capability of respondents
and “tense”. Therefore, it does not meet to answer in a spontaneous and intuitive
the claim of unidimensionality (Raab- way. In this case, not only the item but

18 interculture j ourna l 13/22 ( 2 0 1 4 )


France Germany 3. Data
Teachers Workers Teachers Workers
In order to test whether the UAI is a
Sample size 103 (22.60%) 113 (24.10%) 147 (31.34%) 103 (21.96%) valid construct beyond the scope of the
IBM sample, we replicated the original
items which indicate this dimension. In
Male 49% 94% 49% 93% June 2011 we interviewed 113 work-
ers of Villeroy&Boch, manufacturer of
Tertiary ceramics, in France, and 106 in Ger-
98% 4% 100% 5%
education many. In the same period of time we
also interviewed 103 school teachers
in France and 147 in Germany. The
Table 3: Summary of sample. Source: Authors own table. interviews were based on a paper-
pencil-questionnaire which contained
a total of 43 questions and took the
also the response options contain nega- respondents between ten and fifteen
tions, what makes it even more complex minutes to answer it. Workers as well as
(Bortz / Döring 1995:224, Lienert / teachers were asked during their break
Raatz 1998:53). Furthermore, the situa- at their workplace. Table 3 describes the
tion drawn by this item is not concrete. samples. In accordance with Hofstede’s
To some respondents Company rules sampling requirements, we included not
could mean life saving security rules and only one but two kinds of matched sam-
to others marginal rules like the obliga- ples which are equivalent: Both samples
tion that employees should hang up of teachers are secondary public school
their coat. Therefore, it appears doubt- teachers and both samples of workers
ful that all respondents have the same are employed by the same company and
situation in mind and give comparable involved in comparable production
answers (Bortz / Döring 1995:224, processes. Moreover, the samples are ad-
Lienert / Raatz 1998:53, Raab-Steiner / equately matched regarding their gender
Benesch 2010:51). and education. Statistical tests confirm
that the samples in the two countries
Consequently, Hofstede’s critics doubt are not significantly different regarding
the wide applicability of his dimensions. gender and education at the one percent
They suspect that the dimensions are level (see Table 3).
IBM-specific constructs and, therefore,
only serve as standards of compari- Although, as has been shown before,
son among IBM employees (Korman Hofstede encourages replication studies
1985:244, Søndergaard 1994:449). If (Hofstede 2009:461ff.), he also warns
Hofstede had interrogated a different researchers of replicating the IBM
level of employees (Hansen 2009:15), items in their original wording. “Ques-
the employees of a different company tionnaires have to be adapted to their
( Janzer 2007:29, Goodstein 1981:51, intended respondent population, situ-
Bond / Smith 1993:42) or even of a ation, and period” (Hofstede 2009:67,
different profession (Cavusgil / Das Hofstede 1998:20f.). We followed this
1997:216f.), so they conclude, dimen- advice and modified the questions in
sions of a different kind would have order to make them applicable to the
emerged. These considerations origi- reality of the sample. Therefore, we
nate our research hypothesis, whereby adapted the word company to school
we focus on the UAI: The Uncertainty (Schule) for the German teachers and to
Avoidance dimension does not prove to be institution (Institution) for the French
valid beyond the scope of the IBM sample. workers and teachers.
If this hypothesis cannot be rejected,
then there seems to be no foundation of 4. Method
this dimension, and, consequently, nor
for its purpose to allow cross-cultural In order to test whether Hofstede’s
comparisons nor for the related typol- dimension of Uncertainty Avoidance
ogy. is a valid concept and goes beyond the

19
scope of IBM study, we test for measure-
ment invariance. Measurement invari-
ance means that individuals’ answers are
not dependent on their group charac-
teristics (Mellenbergh 1989, Meredith /
Millsap 1992, Meredith 1993), and,
thereby, that the concept is valid beyond
specific groups. Figure 4 illustrates the
measurement model of the Uncertainty
Avoidance dimension.
In Figure 1 Uncertainty Avoidance is
the unobserved latent concept which is
reflected by the three indicators A37,
A43 and B60. λi is the loading, τi is the
intercept and ei is the disturbance terms
for the ith item. It is assumed that the
disturbance terms have a mean of zero,
and are uncorrelated with each other
and with the latent variable. Moreover,
in order to assign a scale to the latent Figure 1: Measurement model of Uncertainty Avoidance. Source: Authors own figure.
variable the loading λ2 is fixed to 1 and
the intercept τ2 to 0.
There are three different levels of invari- and testing we rely on Jrule software
ances testing, in order: configural, met- (Van der Veld et al. 2008) based on the
ric, and scalar invariance. Configural in- procedure developed by Saris, Satorra
variance is achieved if the measurement and van der Veld (2009). Saris et al.
model fits the data well in the different show that the commonly used evalua-
groups and all item loadings are signifi- tion procedures for structural equation
cant (Davidov 2008:37). We will test models cannot be trusted as the test
for configural invariance in each group statistics and Fit indices are unequally
separately. Only if this is achieved, sensitive for different misspecifications.
metric invariance can be tested. Metric They propose using the modification in-
invariance requires that the loadings λi dex (MI) as test statistic for detection of
are the same across groups and is a nec- misspecifications (expressed as expected
essary condition for comparing relation- parameter change; EPC) in combina-
ships of the latent variable Uncertainty tion with the power of the MI test. This
Avoidance with other variables. If metric means that Jrule tests the model on the
invariance is established, in a final step parameter level rather than the model as
scalar invariance can be tested. Scalar a whole.
invariance requires that the intercepts
τi are also equal across groups and if
established allows comparing means 5. Results
across groups (Horn 1983, Meredith
1993, Steenkamp / Baumgartner 1998). The results can be summarized rather
Recalling quickly because in none of the groups
Hofstede’s approach, this means that configural invariance was found. In
only if this final condition is met, Hof- other words, in none of the groups the
stede’s formula can be used and groups items load on the latent concept Uncer-
can be compared. tainty Avoidance. Therefore, testing for
metric and scalar invariance has become
In order to conduct these tests we redundant, as both require configural
employ multigroup confirmatory factor equivalence as a precedent condition.
analysis (MGCFA) ( Jöreskog 1993, Table 4 summarizes the non-significant
Billiet 2002) the maximum likelihood effects conducting factor analysis in
estimator of LISREL 8.72 ( Jöreskog / each group separately; it presents the
Sörbom 2005). For model evaluation standardized solution which allows

20 interculture j ourna l 13/22 ( 2 0 1 4 )


Nervous or tense at work Continue working for this Company/school rules
(A37) company/school (A43) should not be broken (B60)

Unstan- Standardized Unstan- Standardized Unstan- Standardized


dardized solution dardized solution dardized solution
solution solution solution

Teachers .18 .16 1.0 1.32 -.10 -.08


(1.21) (.65)
French
Workers -.51 -.16 1.0 .52 .28 .11
(2.91) (1.59)

Teachers - .87 -.32 1.0 .30 -.53 -.19


(1.79) (.91)
German
Workers .49 .15 1.0 .37 1.19 .45
(.91) (2.84)

Table 4: Findings of the test for configural invariance in each group. Source: Authors own table.

comparing the loadings within a group within these nations. From our results
as well as the unstandardized solution we conclude, that criticisms suspect-
which allows comparing the load- ing that the Uncertainty Avoidance
ing across groups. We report this for dimension is specific to the Hofstedean
the sake of completeness, although IBM sample are justified. Consequently,
the non-significant loadings make all this dimension is neither to be used as a
comparisons of loadings redundant. The standard of cross-national comparisons,
items which were supposed to reflect nor as the basis for general descriptions
the Uncertainty Avoidance dimension about countries as wholes.
according to Hofstede, do not act as
expected. The lack of validity we find leads to the
question what it is due to. One theo-
retical explanation would be cultural
6. Discussion change over time. Uncertainty Avoid-
In this study, we aimed to test the ance might have been a valid construct
validiy of the Uncertainty Avoidance in the 1970s and might have lost
dimension of the Hofstedean model of relevance over the years. This might be
Cultural dimensions. We traced back the reason for our sample from 2011 to
the origins of this model, highlighted not replicate it. This explanation though
the importance and use of it, mentioned does not convince in two respects. First,
the criticisms to it, and tested with Hofstede himself excludes the idea of
original data from France and Germany cultural change. “Cultures, especially
(2011), if the Uncertainty Avoidance national cultures, are extremely stable
dimension can be replicated and hence, over time” (Hofstede 2009:34). More
proves to be a valid construct beyond concretely speaking, national cultures
the original IBM study. We find that are supposed to be stable “across many
this is not the case. In none of our four generations” (Hofstede 2009:10), at
samples, the items have proven to be least until the year 2100 (Hofstede
indicators of the construct Uncertainty 2009:36). Whenever his data is blamed
Avoidance. This contradicts Hofstede to be out of date, Hofstede points to
who claims that his dimensions are the century-old roots of his dimensions
applicable not only in a high number of (Hofstede 2009:73). Here, he mentions
nations, but also among all subsamples the second objection to the explana-

21
tion of cultural change over time. If the Uncertainty Avoidance dimension has
dimensions really do reflect universal not proven valid, those studies show a
problems of every human society and if lack of sustainable foundation. Con-
country scores shall be published and struct validity should have been assured
discussed until today, then it is indis- by testing for measurement invariance
pensable that the dimensions have not across groups. As a conclusion, this does
lost their validity. not mean that a concept such as the
Uncertainty Avoidance does not exist,
In the beginning of the present study, but it means that it cannot be measured
we recapitulated in detail the founda- employing (variations of ) the items
tion and methodological approach of from the IBM study.
the Hofstedean model. Thereby, we de-
tected several reasons which could lead
to the lack of validity of dimension we 7. Bibliography
studied here. First of all, the aim of IBM Barmeyer, C. / Genkova, P. / Scheffer, J.
questionnaire was not to compare cul- (2010): Interkulturelle Kommunikation und
tures across countries and the idea of the Kulturwissenschaft. Passau: Stutz.
Uncertainty Avoidance dimension was
not present at all when the question- Barmeyer, C. (2010): Kulturdimensionen
naire was designed. Secondly, once the und Kulturstandards. In: Barmeyer, C. /
data from the IBM study was obtained, Gankova, P. / Scheffer, J. (Eds.): Interkul-
Hofstede split the three factors which turelle Kommunikation und Kulturwissen-
he found by means of factor analysis schaft. Passau: Stutz, pp. 87-117.
into four dimensions. The theoretical
Baskerville-Morley, R. (2005): A research
reason was to bring the dimension in
note: the unfinished business of culture.
line with the standard analytic issues by Accounting, Organizations and Society 30,
Inkeles and Levinson (1954). However, pp. 389-391.
practically this means that the dimen-
sions are not statistically independent Baumgartel, H. / Thomas, H. (1982):
from each other. Thirdly, given that the Review of Geert Hofstede: `Culture’s
aim of the questionnaire design was not Consequences: international differences in
to detect the Uncertainty Avoidance work-related values´. Personnel Psychology
dimension, the wordings of the items 35(1), pp. 192-196.
are doubtful. Hofstede himself consid-
ers this problematic and recommends Behrens, L. (2007): Konservierung von
adjustments in the formulation of the Stereotypen mit Hilfe der Statistik. Köln:
Institut für Linguistik, Allgemeine Sprach-
items. However, he still believes that
wissenschaft.
these three items are the indicators of
the Uncertainty Avoidance dimension.
Billiet, J. (2002): Cross-cultural equiva-
This reasons seems to explain why it was lence with structural equation modeling.
impossible to detect the Uncertainty In: Harkness, J. A. / Van de Vijver, F. J. R. /
Avoidance dimension with our data. Mohler, P. P.(Eds.): Cross-Cultural Survey
Methods. Hoboken: John Wiley, pp. 247-
All in all, our study made clear that the 264.
Uncertainty Avoidance dimension is
not a valid construct and, therefore, Blodgett, J. / Bakir, A. / Rose, G. (2008): A
does not serve as base for follow-up Test of the Validity of Hofstede’s Cultural
studies. The majority of these studies Framework. Advances in Consumer Research
are replications of the original study, 35, pp. 762 f.
mainly, in order to update the original
Bond, M. H. / Smith, P. B. (1993): Social
study with more recent data or to derive
psychology across cultures. London: Har-
action guidelines that are practically ap- vester Wheatsheaf.
plicable. In contrast to our replication,
the majority of the studies does not Briley, D. A. (2009): Cultural Influence on
question the validity of the constructs Consumer Motivations: A Dynamic View.
and hence, take the dimensions as given. In: Cheryl, N. (Eds.): Beyond Hofstede. New
Following from our finding that the York: Palgrave Macmillan, pp. 181-200.

22 interculture j ourna l 13/22 ( 2 0 1 4 )


Cavusgil, S. T. / Das, A. (1997): Methodol- Theories Apply Abroad?. Organizational
ogy issues in cross-cultural sourcing research Dynamics (Summer), pp. 42-66.
- a primer. Marketing Intelligence and Plan-
ning 15(5), pp. 213-220. Hofstede, G. (1998): Masculinity and
Femininity as a Dimension of Culture.
Chow, C. W. / Shields, M. D. / Chan, Y. K. In: Hofstede, G. (Ed.): Masculinity and
(1991): The effects of management controls Femininity: the taboo dimension of national
and national culture on manufacturing cultures. Thousand Oaks: Sage Publications,
performance: an experimental investigation. pp. 3-28.
Accounting, Organizations and Society 19
(5), pp. 209-226. Hofstede, G. (2002): Dimensions do not
exist: A reply to Brendan McSweeney. Hu-
Davidov, E. (2008): A cross-country and man Relations 55(11), pp. 1-8.
cross-time comparison of the human values
measurements with the second round of the Hofstede, G. / Hofstede, G. J. (2005):
European Social Survey. Survey Research Cultures and organizations. New York, N.Y.:
Methods 2, pp. 33-46. McGraw-Hill.

Early, C. P. (2009): So What Kind of Athe- Hofstede, G. (2009): Culture’s Consequences.


ist Are You? In: Nakata, C. (Eds.): Beyond Comparing Values, Behaviors, Institutions
Hofstede. New York: Palgrave Macmillan, and Organizations Across Nations. London:
19-39. Sage Publications.

Goodstein, L. D. (1981): Commentary: Do Hoppe, M. H. (1990): A comparative study


American Theories Apply Abroad? Organi- of country elites: International differences in
zational Dynamics (Summer), pp. 49-54. work-related values and learning and their
implications for management training and
development. Dissertation: University of
Gröschke, D. (2007): Kulturelle Unter-
North Carolina at Chapel Hill.
schiede im Selbstkonzept. Interculture
Journal 6(5), pp. 39-70.
Horn, J. L. / McArdle J. J. / Mason R.
(1983): When is invariance not invariant:
Hansen, K. P. (2009): Die Problematik des
A practical scientist’s look at the ethereal
Pauschalurteils. Interculture Journal 8(10),
concept of factor invariance. The Southern
pp. 5-18.
Psychologist 1, pp. 179-209.
Harrison, G. L./ McKinnon, J. L. / Pan- Huo, Y. P. / Randall, D. M. (1991): Explor-
chapakesan, S. / Leung, M. (1994): The ing subcultural differences in hofstede’s
Influence of Culture on Organizational value survey: The case of the Chinese. Asia
Design and Planning and Control in pacific Journal of Management 8(2), pp.
Australia and the United States Compared 159-173.
with Singapore and Hong Kong. Journal of
International Financial Management and Jahoda, G. / Krewer, B. (1997): History of
Accounting 5(3), pp. 242-261. Cross-Cultural and Cultural Psychology. In:
Berry, J. W. / Poortinga, Y. H. / Pandey, J.
Harrison, G. L. / McKinnon, J. L. (1999): (Eds.): Handbook of Cross-Cultural Psychol-
Cross-cultural research in management con- ogy. Boston: Allyn and Bacon.
trol systems design: a review of the current
state. Accounting, Organizations and Society Janzer, A. (2007): Kulturwissenschaftliche
24, pp. 483-506. Probleme internationaler Managementfor-
schung. Interculture Journal 6(5), pp. 21-38.
Hastings, H. E. / Hastings, P. K. (1981):
Index to interntaional public opinion 1979- Jones, M. L. (2007): Hofstede – Culturally
1980. Oxford: Clio. Questionable? Speech at the Oxford Busi-
ness & Economics Conference on June,
Hofstede, G. / Kraut, A. I. / Simonetti, S. 24th-26th 2007, Oxford University.
H. (1976): The development of a core attitude
survey questionnaire for international use. Jöreskog, K. G. / Dag S. (2005): LISREL
Brussels: European Institute for Advanced 8.57. Lincolnwood, IL: Scientific Software
Studies in Management. International.

Hofstede, G. (1980): Motivation, Lea- Jöreskog, K. G. (1993): Testing structural


dership, and Organization: Do American equation models. In: Bollen, K. A. / Long,

23
S. J. (Eds.): Testing structural equation Saris, W. E. (1988): Variation in Response
models. Newbury Park: Sage Publications, Functions: A Source of Measurement Error in
pp. 294-316. Attitude Research. Amsterdam: Sociometric
Research Foundation.
Korman, A. K. (1985): Review of `Culture’s
Consequences: International differences Saris, W. E. / Satorra, A. / Van der Veld, W.
in work-related values´. Journal of Occupa- (2009): Testing structural equation models
tional Behaviour 6(3), pp. 243 f. or detection of misspecifications? Structural
Equation Modeling: A Multidisciplinary
Lienert, G. A. / Raatz, U. (1998): Testauf- Journal 16(4), pp. 561-582.
bau und Testanalyse. Weinheim: Beltz,
Psychologie Verl.-Union. Smith, P. B. / Schwartz, S. H. (1997):
Values. In: Berry, J. W. / Segall, M. H. /
McSweeney, B. (2002a): The Essentials of Kagitcibasi, C. (Eds.): Handbook of Cross-
Scholarship: A Reply to Geert Hofstede. Cultural Psychology. Boston: Allyn and
Human Relations 55(11), pp. 1363-1372. Bacon.

McSweeney, B. (2002b): Hofstede’s model Søndergaard, M. (1994): Research Note:


of national cultural differences and their Hofstede’s Consequences: A Study of Re-
consequences: A triumph of faith - a failure views, Citations and Replications. Organi-
of analysis. Human Relations 55(1), pp. zation Studies 15(3), pp. 447-456.
89-118.
Steenkamp, J.-B. / Baumgartner, H. (1998):
Mellenbergh, G. J. (1989): Item bias and
Assessing measurement invariance in
item response. International Journal of Edu-
cross-national consumer research. Journal of
cational Research 13, pp. 127-143.
Consumer Research 7, S. 78-90.
Meredith, W. / Millsap, R. E. (1992): On
Taras, V. / Steel, P. (2009): Beyond Hofst-
the misuse of manifest variables in the
ede. In: Nakata, C. (Ed.): Beyond Hofstede.
detection of measurement invariance. Psy-
New York: Palgrave Macmillan, pp. 40-60.
chometrika 57(2), pp. 289-311.

Meredith, W. (1993): Measurement invari- Triandis, H. C. (1997): Foreword. In:


ance, factor analysis, and factorial invari- Berry, J. W. / Dasen, P. R. / Saraswathi, T. S.
ance. Psychometrika 58, pp. 525-543. (Eds.): Handbook of cross-cultural psychology.
Boston: Allyn and Bacon, pp. ix f.
Merritt, A. C. (2000): Culture in the cock-
pit: Do Hofstede’s dimensions replicate? Van der Veld, W. / Saris, W. E. / Satorra,
Journal of Cross-Cultural Psychology 31, pp. A. (2008): Jrule 2.0: User manual. Unpub-
283-01. lished manuscript (Internal report, Rad-
boud University Nijmegen, The Nether-
Myers, M. D. / Tan, F. B. (2002): Beyond lands).
Models of National Culture in Information
Systems Research. Journal of Global Infor- Westwood, R. G. / Everett, J. E. (1987):
mation Management 10(1), pp. 24-32. Culture’s consequences: A methodology for
comparative management studies in South-
Nakata, C. (2009): Going Beyond Hofst- east Asia? Asia pacific Journal of Manage-
ede: Why We Need to and How. In: Na- ment 4(3), pp. 187-202.
kata, C. (Ed.): Beyond Hofstede. New York:
Palgrave Macmillan, pp. 3-18.

Nanhekhan, R. (1990): Cultuurverschillen


gemeten: aanknopingspunten voor wederzijds
begrip tussen Nederlands en Surinamers op de
werkvloer. Amsterdam: Master Thesis.

Nasierowski, W. / Mikula, B. (1998):


Culture Dimensions of Polish Managers:
Hofstede‘s Indices. Organization Studies
19(3), pp. 495–509.

Raab-Steiner, E. / Benesch, M. T. (2010):


Der Fragebogen. Stuttgart: UTB.

24 interculture j ourna l 13/22 ( 2 0 1 4 )


Endnotes
1. The theoretical part of this article is
based on: Schmitz, L. (2013): Nationalkul-
tur versus Berufskultur. Eine umfassende
Kritik Hofstedes. Diss. Universität Passau.

2. “In most of this book, I use the word


culture to refer to national culture […]”
(Hofstede 2009:1).

3. „[…] hundreds of researchers have used


the Hofstedean framework to understand
culture’s influences on managerial, con-
sumer, and organizational behavior” (Adir
et al. 2009:146).

4. He split one of the factors into Power


Distance and Individualism / Collectivism
(Hofstede 2009:59).

5. By now, the number of dimensions has


extended to six (Hofstede 2011:8).

6. In general, this idea refers to the concept


by Clyde Kluckhohn (Hofstede 2009:9f.,
28f., Baskerville-Morley 2005:389, Nakata
2009:4, Rathje 2009:35).

7. It shall be noted, that Hofstede – even


though he aims to detect national cul-
tures (“[...] I use the word culture to refer
to national culture” (Hofstede 2009:1))
– attaches dimension scores to nations,
countries as well as to regions, includ-
ing Western Germany, Belgium and Arab
countries (Hofstede 2009:44, 87). In order
to avoid the inherent confusion, we refer
here to cultures of countries when Hofstede
mentions national cultures.

8. The formula is the following: UAI =


300 – 40 x (mean score A37) – (% answer 1
or 2 in A43) – 30 x (mean score B60) (Hof-
stede 2009:491). According to the original
IBM study, the countries involved in the
present study scored as follows: France
reaches a score of 86, and, therefore, the
tenth rank in the UA index, whereas Ger-
many obtained a remarkable smaller score of
65, and, therefore, occupied the 29th rank.

25
26 interculture j ourna l 13/22 ( 2 0 1 4 )

Das könnte Ihnen auch gefallen