Sie sind auf Seite 1von 13

International Journal of Project Management 22 (2004) 19–31

www.elsevier.com/locate/ijproman

The success dimensions of international development projects:


the perceptions of African project coordinators
Amadou Diallo, Denis Thuillier*
Université du Québec à Montréal (UQAM), École des Sciences de la Gestion, Département de Management et Technologie, 315 Ste Catherine Est,
CP 6192, Montréal (Qué.) Canada H3C 4R2

Received 5 February 2002; received in revised form 20 September 2002; accepted 17 January 2003

Abstract
Success factors and success dimensions on which projects are evaluated have been discussed widely in literature. An analysis of
the perceptions of coordinators of international development projects has not been examined thus far, especially in Africa. This
paper characterises the dimensions of success (and their hierarchy) for such projects, as perceived by project coordinators in sub-
Saharan Africa using data collected by questionnaires. The research is unique in the sense that it determines the hierarchy of the
dimensions of the principal stakeholders (task managers in the international aid agencies, local officials, project team, steering
committee, beneficiaries, etc.) exclusively from the perspective of the project coordinator. The methodological approach precludes
hasty generalisation when it comes to generalising findings to other stakeholders, but the coordinators cognition unveils its specific
structure and demonstrate a good understanding of other stakeholders’ agendas. The results confirm the importance of manage-
ment dimensions (time, cost, quality) but paradoxically the project impacts are rated in last position for the coordinators. In addi-
tion, the dimensions related to the political environment of the international development community plays a significant role in the
perception of project success as the project coordinator must satisfy more than one ‘‘client’’ in such projects financed by multilateral
institutions.
# 2003 Elsevier Ltd and IPMA. All rights reserved.
Keywords: Project success; Dimensions; Criteria; International development; Evaluation; World Bank; Project manager; Africa

1. Introduction increasingly more in health, education, institutional


reform, etc. The projects generally last from three to five
Many projects are implemented in countries where the years but there is a trend to fund up to 10 years pro-
managerial, economic and political environment differs grams. They can be prolonged depending upon the
largely from what we are used to in developed countries. findings of the ‘‘end of project’’ evaluation. A project is
This is particularly the case in international aid projects managed by a coordinator (or director or project man-
financed by multilateral development agencies (World ager), appointed by the government. The coordinator is
Bank, United Nations, European Union, etc.) or by the often a civil servant, although there are exceptions. The
bilateral system (USAID, French Cooperation, DFID, coordinator manages a team of national collaborators.
CIDA, etc.). The World Bank group is currently super- There are seven stakeholders (subcontractors, experts
vising approximately 1500 projects under implemen- and consultants excluded) in an international develop-
tation. The countries receiving international assistance ment project:
are mainly located in sub-Saharan Africa, North Africa
and the Middle East, Southeast Asia, Central and Latin 1. The coordinator himself, the head of the project
America and Central Europe. Aid is shared among dif- management unit. He is in charge of the oper-
ferent sectors that cover government prerogatives: uti- ations.
lities, infrastructure, transportation but also 2. The task manager located in the headquarters of
the multilateral development agency, supervises
* Corresponding author. Tel.: +1-514-987-3000x7783. the project’s implementation and makes sure that
E-mail address: thuillier.denis@uqam.ca (D. Thuillier). the guidelines of the institution are strictly
0263-7863/03/$30.00 # 2003 Elsevier Ltd and IPMA. All rights reserved.
doi:10.1016/S0263-7863(03)00008-5
20 A. Diallo, D. Thuillier / International Journal of Project Management 22 (2004) 19–31

respected by the project’s national management indirectly improve the wealth of the population. It is
unit. political because some project options (choice of specific
3. A national supervisor who is a high-ranking civil regions or of targets-groups, inputs, etc. . .) express
servant or sometimes the minister himself, to political decisions made by the multilateral development
whom the coordinator reports. agencies with the assistance, whether sincere or under
4. A project team which is directly under the coor- duress, of national political leaders and policy makers.
dinator’s authority. The team is not really an A coordinator himself is implicitly positioned as a poli-
external actor but no matter what it’s influence, tical player when appointed as project manager:
the coordinator cannot function effectively
without the project team.  he barely participates in the design of the project.
5. A steering committee which acts as an interface He must therefore adhere to the decisions made
with the local institutional system and the lower by others during the appraisal and may have to
levels of government concerned directly or manage subtly during the project implemen-
indirectly with the project. tation.
6. The beneficiaries who are theoretically the ‘‘cli-  he enjoys a high profile position for a limited
ent’’ of the project. They should always influence duration (i.e. 3–5 years) and may have personal
the direction of the project but they often have motivation to foster a relationship with either the
little impact owing to the lack of representative local authority or the task manager in an effort to
authorities or organizations. However the Social further his career. This behaviour may not
Fund’s design is worthy of note here [1]. necessarily negatively impact the project as the
7. The population at large. They are voters and it is objectives of the project correspond to those of
important to have them support the project, even the coordinator. However the coordinator has
in countries where democratic rule is not yet implicit personal objectives above and beyond
firmly established. The political dimension of those of the project.
development projects is further elaborated here-
after. A coordinator of an aid program or project in a
developing country is fully aware of the dimensions of
Significant results have been obtained for the past evaluation used for projects financed by multilateral
decades in the sectors of health, rural development and agencies. He therefore knows that the project will be
education. The success of aid projects however is gen- judged on objective dimensions. He will thus make an
erally considered below acceptable levels considering the effort to perform adequately on these dimensions.
amount of financing involved. The projects and pro- However, the socio-political and cultural context in
grams expost facto evaluations reports prepared by the which the project operates is specific, in particular when
World Bank show a number of problems listed by it occurs in a strong culture with clearly defined social
Youker [2] who particularly underlines: operating modes. This is especially the case for projects
in Africa. The concept of success from the coordinator’s
 the lack of shared perception and agreement on perspective can then be measured on unexpected
the objectives of the projects by staff and stake- dimensions. Some of these dimensions cannot be justi-
holders fied explicitly during the evaluation and consequently
 the lack of commitment by the team, manage- are never commented upon nor discussed in manage-
ment and stakeholders ment literature. It is in this context that the present
 the lack of detailed, realistic, and current project research tries:
plans within organisations not structured for
project management  to highlight the hierarchy of principal dimensions
 unclear lines of authority and responsibility that drive the actions of coordinators of multi-
 the lack of adequate resources lateral development project in sub-Saharan
 poor feedback and control mechanisms for early Africa;
detection of problems  to explain the project performance on these
 poor or no analysis of major risk factors dimensions as a function of specific variables;
 delays caused by bureaucratic administration and
systems  to understand the coordinator’s perceptions of
the main stakeholders dimensions hierarchy.
The first observation above is a fundamental one. The
nature of the problem is more political than technical. A Evaluation dimensions and their prioritisation are
development project can be considered both social and often if not always fixed by external actors. We take a
political. It is social because its objective is to directly or different and unique approach. As the coordinator is
A. Diallo, D. Thuillier / International Journal of Project Management 22 (2004) 19–31 21

central to the project, we strive to learn in this research performed by a project manager, a client or one of the
his own understanding of the situation. key stakeholders. Each stakeholder perceives the success
The paper is divided into three sections and is orga- according to dimensions, and a hierarchy of dimensions,
nised as follows. Firstly the literature on project success that comply with his own agenda [9,10]. There is no
and success dimensions is reviewed and questions and ‘‘absolute’’ success or consistency in overall success
tentative assumptions pertaining to the specific envir- appreciation over time: there is only ‘‘perceived success’’
onment of international development projects are for- [11]. One may indeed be tempted to prioritise dimen-
mulated. The methodology used is the subject of Section sions of management when one performs an evaluation
3 and the results of the empirical analysis are discussed during the project implementation. On the other hand,
in Section 4. The conclusion presents some suggestions one will naturally pay more attention to the economic,
for further research on success factors for development political or social impacts, when the evaluation is con-
projects. ducted at the end of the project [11]. This is even more
evident when the project evaluation is performed with a
historical perspective (refer to the voyages of antiquity
2. Success factors and success dimensions or the expeditions of the Renaissance).
Even when everybody agrees with a list of criteria,
The concept of success in projects has been widely measurement of project success remains a rather diffi-
discussed in management literature and has been central cult task. Schedule and budget management may be
to the literature of project management [3]. The dimen- assessed through direct measures and quality manage-
sions (criteria) upon which one appreciates success and ment through pass or fail criteria or some kind of char-
the factors of success themselves have been the focus of acteristics testing. Therefore, any stakeholder may draw
more study. [4–7]. Success can indeed be evaluated only valid conclusions on project management performance.
when the evaluation dimensions are adequately defined. However, client’s satisfaction is not objectively measur-
For the project manager, evaluation dimensions gen- able and it is the same, i.e. for the experience gained
erally correspond to the traditional constraints. That is through the project, or the magnitude of organisational
to say, a project is usually considered a success if its impacts or any other benefits induced. As intervals do
implementation complies with the usual constraints of not capture the subjective nature of such criteria, ordi-
time, cost and the client’s terms of reference or ‘‘qual- nal scales with choices (Likert scales) must be designed
ity’’. Here one can identify the influence of the con- to collect stakeholders’ perceptions [12–14].
struction and engineering sectors; sectors upon which In spite of the differing points of view, a review of the
project management has structured itself for the past literature makes it possible to outline a set of evaluation
centuries. In these professions, success is judged pri- dimensions which appear regularly although not with
marily through the assessment of the technical quality the same occurrence:
of outputs and through the evaluation of the manage-
ment performance whose dimensions are objective, per-  respect of the three traditional constraints;
fectly defined and well-accepted. The classical project  satisfaction of the client;
manager does not view his project beyond the scope of  satisfaction of the objectives as outlined in the
his professional duties and responsibilities. logical framework;
The client’s agenda is significantly different. Either a  project impacts;
private firm or an institution, the client cannot evaluate  institutional or organisational capacity built in
the success of its project without referring to the objec- the organisation by the project;
tives that governed the conception, the formulation and  financial returns (in the case of productive pro-
the project design The raison d’être of a project lies in jects) or the economic or social benefits (in the
the satisfaction of one or more objectives. The client’s case of public sector projects); and
perspective is therefore more of a global one. It is  project innovative features (outputs, manage-
important to judge the project’s success not only by ment or design).
auditing the way in which the project team manages the
inputs and delivers the outputs or ‘‘project management The literature, however, is rather scarce when it comes
success’’, but also by evaluating the project’s contribu- to better understanding the hierarchy of dimensions
tion to the initial objectives or ‘‘project success’’ as sta- which support the managerial behaviour of the coordi-
ted in the logical framework [8]. Beyond time, cost and nators, especially in Africa. The implementation of a
quality, it is pertinent to consider another evaluation development project financed by the system of the mul-
dimension which we will refer to hereafter as the project tilateral development agencies is led by a national coor-
impacts since that is the accepted terminology used in dinator. With the assistance of his project team and
the development community. We prefer one dimension according to the guidelines set out by the donor, the
over another, depending upon whether the evaluation is national coordinator launches, manages and imple-
22 A. Diallo, D. Thuillier / International Journal of Project Management 22 (2004) 19–31

ments activities defined during the planning phase of the We may also expect to see the task manager valuing the
project. He has his own concept of success and of its efficiency of the coordinator’s day-to-day management.
dimensions that is a function of its representation1 Is this really the way the coordinator perceives the task
which is in effect a function of the coordinator’s own manager’s priorities? It may depend on the coordina-
social, cultural and religious background. The coordi- tor’s interpretation3 of the explicit or implicit messages
nator may value certain dimensions more than others from his task manager or other stakeholders. It is
and his hierarchy of dimensions conditions the way in important to recall here that the national coordinator,
which he manages and controls the project. It appears an African-born, high-ranking civil servant, and the
appropriate to further investigate to obtain a better task manager of the multilateral institution often belong
understanding of the coordinator’s cognitive process. to different cultures. The quality of their communi-
The coordinator is naturally concerned by the tradi- cation plays a significant, if not determinant, role in the
tional dimensions previously noted as they constitute efficiency of the management process.
many of the goals that he plans to meet. However, it can This research does not focus on the quality of the
be argued that he is also concerned by the political communication between actors. It is interesting however
dimension of his role. This concern may be from a feel- to analyse the coordinator’s perception of the main sta-
ing of self-preservation or from social consciousness. keholders opinions on his project success and, if possi-
The ‘‘visibility’’ of the project may appear as a notice- ble, to discuss what we could learn when investigating
able dimension on which the coordinator builds his ‘‘what the perception of the coordinator unveils about
appreciation of success. It is a specific aspect of devel- implicit stakeholders specific hierarchy of evaluation
opment projects which seems neglected and which, to dimensions’’. Traditional project evaluation does not
our best knowledge, has not been the subject of any include the project coordinator as an evaluator but as a
empirical research. resource. We take a rather different approach here as
Everyone involved in development projects feels that the coordinator is the center or the project evaluation
the quality of the relationship between the coordinator and we strive to learn through his own subjective
and his task manager is a very important success factor understanding of the situation; through his very per-
(although we were unable to find any research results or ception of his environment. This may be considered
even documentation on this point). Knowing the power circular logic. It is commonly accepted however that
of the donor in the relationship, one may therefore group members and leaders, especially in a systemic
expect that the coordinator will try as much as possible project management context, behave on the basis of
to satisfy the task manager and to perform on the their own perceptions more than on the basis of facts.
dimensions the task manager prefers. A project which is This raises a certain number of questions that statis-
well perceived will show fluid and efficient transactions tical treatment of an ad-hoc database may solve or
between the coordinator and his task manager. This is validate. They can be subdivided in three main cate-
indeed beneficial for the recipients, who in principle are gories:
‘‘the client’’, as it is for the coordinator himself.
Although the coordinator is appointed locally, the task Analysis of the coordinator’s perceptions:
manager has a say when it comes to decide who will run Does the coordinator build his own judgement on
an eventual phase II or III after termination of the project success upon evaluation dimensions which
initial project phase. It is well known that such high correspond to those with which we are accustomed in
profile, high status and well-compensated positions2 are standard project management? Are they in accor-
rather scarce in Africa and one can easily understand dance with what we learned either from the literature,
that a coordinator will do everything within his power being aware however that what we found in the lit-
to get the support of his task manager when required. erature did not cover specifically the field of interna-
One could raise the ethical issue of personal agendas tional development, or from experience with
interfering with public service efficiency but the reality international development? We may expect that the
of public sector wages, family burdens and other survi- coordinator pays specific attention to the manage-
val challenges in poor countries are implicitly under- ment dimensions and to the satisfaction of the pro-
stood in the development community. ject’s long-term objectives. However, as we
The task manager, who represents the financial insti- documented earlier, does the political play in which
tution, will care a priori about beneficiaries’ satisfaction, the coordinator is de facto surrounded, influence his
about the global project impact and its sustainability. appreciation of project success and take a substantial
place in the coordinator’s mindset?
1
For more on the concept of representation (within the context of
international development) please refer to Jodelet [15] which draws
upon the seminal writings of Durckheim, Piaget, and Moscovici.
2 3
A third of the coordinators surveyed earn over $ 10 000 US/year For more on the concept of reception active in the international
which is well above governmental standards in Africa (see Appendix). development context see Ravault [16].
A. Diallo, D. Thuillier / International Journal of Project Management 22 (2004) 19–31 23

Analysis of the determinants of performance on suc- from those who actually received the questionnaire may
cess dimensions: be higher.4 However, this rate, although a modest one is
of the same magnitude to what other researchers [17–21]
Is the performance on a given dimension related to got under similar mailing conditions. It can be considered
some specific variables? We may wonder if ‘‘techni- acceptable when taking into account geographical con-
cal’’ projects perform significantly better or worse on siderations and the fact that we did not contact respon-
such dimensions than ‘‘non-technical’’ projects. dents with a follow-up to stimulate responses.
Similarly, we may wonder if projects managed by Non respondent bias:
coordinators with specific characteristics, such as age, Descriptive statistics of the sample show that the
gender or language, perform better on one or more proportion of projects considered more or less a failure
macro-dimension. In the vacuum of empirical research by their coordinator is approximately 12% in the sam-
on such topics and because assumptions or hypotheses ple. This is possibly below the real failure rate for such
could possibly stray from the realm of political correct- projects in Africa south of Sahara. This may suggest
ness, we prefer to raise only exploratory questions. It is that we face a non respondent bias as non respondents
hoped that the statistical results will make it possible to could not respond because their project is more or less a
answer some of these questions and provide empirical failure. White and Fortune [13] faced a similar situation
support to some generally accepted ideas on the matter. with a complete success rate far higher than that repor-
ted in the literature. According with usual techniques we
Analysis of the dimensions hierarchy of the stake- tested for potential links between success appreciation
holders as perceived by the coordinator: and other key variables, and time to respond to the
While it is difficult and costly to administer the same questionnaire. Tests did not show any significance.
questionnaire to the major stakeholders for each Generalisation of the empirical results depends on sam-
project, it is important try to understand stakeholder ple characteristics also, i.e. geographical distribution,
opinions and rationale from the coordinator’s per- sectors either ‘‘technical’’ or ‘‘non-technical’’, project
spective. It is a rather unique and exploratory maturity distribution, etc. We address such questions
approach since we rely on the accuracy of the coor- hereafter.
dinator’s perceptions. But does the coordinator per- Geographical distribution of respondents:
ceive the stakeholders’ objectives clearly and does the We were able to identify through postmarks responses
analysis of these perceptions (insofar the coordinator from 26 different countries. Ten responses being uni-
communicates freely) constitute a valid method for dentifiable. This is a fair score taken when taking into
understanding the stakeholders’ agendas? consideration that:

 Most of Central Africa (Congo-Brazzaville,


République Démocratique du Congo-Zaı̈re,
3. Methodology République de Centrafrique, Burundi, etc. is
under political turmoil, civil war, or at best under
3.1. The sample, response rate and the potential biases post-war transition with multilateral Economic
Recovery Credits. Projects are suspended sine die
This research could be implemented in two ways: or even closed;
either by semi-directed interviews with a certain number  Morocco and Tunisia receive mostly credits
of African coordinators and exploitation of the verba- allocated to sectors, not to specific projects.
tim, or by a more normative investigation by sending a Projects stricto sensu are not easily detected.
questionnaire with statements to be ranked on Likert  We did not send questionnaires to South-Africa.
scales. Owing to the excessive cost, it was not practical The same for Nigeria and Lybia. 65% Of
to follow the first method. We decided therefore to col- responses originated from francophone countries
lect data by way of questionnaires delivered by mail. A and 35% from anglophone former British colo-
pre-addressed (but not postage paid) envelope was nies or from other colonial rulers. This is con-
included to facilitate the return of completed ques- sistent with the initial repartition in the mailing.
tionnaires. Six-hundred questionnaires in French or
English were mailed to project managers, coordinators It is therefore estimated that the diversity of respon-
and directors. Three-hundred-and-fifty recipients were dent countries is fairly represented in the survey and
francophone and two-hundred-and-fifty were anglo-
4
Setym International mentions that approximately one out of five
phone. We received 93 answers which is an apparent
project coordinator addresses in its african database requires yearly
response rate of approximately 15%. As mail sent to update for changes in postal box number, project moving, etc. While
institutional addresses with postal boxes in Africa often our effective response rate is obviously unknown, we may therefore
does not reach the intended recipient, the response rate expect it to near the 20% level.
24 A. Diallo, D. Thuillier / International Journal of Project Management 22 (2004) 19–31

that potential generalisation of research findings for  Information on the project: sector, duration,
projects currently under implementation in Africa south granted funds, respective contributions of the
of Sahara is not significantly distorted by geographical major financial institutions.
bias.  A global judgement of the coordinator on the
Technical and non-technical projects: success of his project.
One may argue that project success and success  The coordinator’s appreciation on statements
dimensions depend on project type and sector. This is (items) that make reference to micro-dimensions
the reason why in the questionnaire we asked for which of project evaluation (see following section).
sector the project belongs to (see Appendix). This  Information on contextual events: suspension5 of
repartition looks consistent with the one of multilateral the country, turn-over of the stakeholders, etc.
projects portfolios. However, the limited number of  The coordinator’s opinions on how the stake-
respondent prevents analysis of success and success holders judge the success of his project: the task
dimensions sector by sector. Aggregation may alter manager in the international development insti-
generalisation of results. Remember that all projects in tution, his national supervisor, the steering
the research share common characteristics. Although committee, his project team, the beneficiaries,
outputs and inputs are sector related, all projects in the and the general populace.
survey are international development projects funded by  Socio-demographic information on the coordi-
multilateral institutions. They share, therefore, common nator’s age, sex, education, participation in
finality, objectives, processes and guidelines. seminars or workshops, former experience in
Project maturity: project management, professional status, wages,
It is rather difficult to evaluate the success or the long- etc.
term induced benefits of a project still in its launching
phase. As the questionnaire provides information rele- Information that refers to a subjective judgement was
vant to credit approval and start-up date it was possible rated on a scale from one to five (i.e. from strongly dis-
to assess that all projects in the sample were in fact agree to strongly agree) or on a binary scale (0,1) when
under ongoing implementation with a 5 year mean and it was a dichotomous answer without any subjectivity.
3 year standard deviation. Statements referring to the overall project success and
Social desirability: to the elementary micro-dimensions of project eval-
It was emphasised by the fact that we rely on the sole uation are listed later. In these cases, coordinators
coordinators judgement. Respondents may provide ranked their responses from one to five on all items.
biased responses either for professional or social desir- On the first page of the questionnaire:
ability purposes or not respond owing to noticeable
failure of the project they are responsible for. Crowne  My project is a success (SUCCESS)
and Marlowe [22] developed a scale to assess socially
desirable responses in psychology. Their research was Respondents were asked to respond to the following
further adapted to test for socially desirable behaviours statements on the reverse side of the first page. This was
in human sciences surveys where one should rely on self in order to disassociate these answers from the earlier
reported answers as is the case in this study. The present statement:
research objectives do not lie in the determination of the
effective success rate for international development  the beneficiaries are satisfied by the goods or
projects. It focuses rather on unveiling the coordinators services generated (BENSATIS);
success dimensions hierarchy without asking explicitly  the goods and services produced are by the pro-
about it. This hierarchy emerges when linking global ject conform to those described in the project
success as perceived, with performance on specific eva- documents(GSCONF);
luations items as perceived (see Section 3.2). The  the initially identified objectives were attained
approach does not preclude biased responses for social (OBJECTIVES);
desirability purposes. However we expect some bias  the project operated in time (TIME);
consistency for similarly socially desirable outcomes (i.e.  the project operated within budget (BUDGET);
success and micro-dimensions of success). This can be  the project achieved a high national profile
considered a reasonable hypothesis [23,24]. (PROFILE);
 the project has a good reputation amongst the
3.2. The questionnaire and the statistical strategy principal donors (REPUTATION);

Among the 13 sections of the questionnaire, six are 5


Multilateral development agencies suspend disbursements when
examined in the present research. These sections make it debt repayments are significantly overdue without just cause or when
possible to get: the local political situation is beyond control.
A. Diallo, D. Thuillier / International Journal of Project Management 22 (2004) 19–31 25

 the project has a good chance to be extended with logistic regression is sensitive to multicollinearity and
additional funding (ADDFUND); sample size (as maximum likelihood estimation implies
 the project had a visible impact on the bene- asymptotic normality). Reliability of our estimates may
ficiaries (IMPACT); and be altered by the presence of correlation between eval-
 the project built institutional capacity within the uation dimensions and by the limited number of cases in
country (SUSTAIN). our sample for each combination of independents. Lack
of robustness may preclude any valid conclusion. In this
Internal consistency and reliability tests were per- research we test robustness on random sub samples to
formed by calculating alpha of Cronbach on the com- assess the stability of the macro-dimensions hierarchy.
plete sample and on random sub-samples. The results The most significant results are discussed in the
were always higher than 0.84 which makes it possible to following section.
complete the analysis. The statistical strategy is simple
and straightforward:
4. Results of the empirical (statistical) analysis
 Factor analysis with the earlier items (micro-
dimensions), in order to identify meaningful 4.1. Constructs or macro-dimensions
latent variables or ‘‘constructs’’ which form
macro-dimensions (criteria). Then orthogonal Each item corresponds to a micro-dimension. Each
rotations are performed to get the clearest picture micro-dimension is specific but some are derived from
of macro-dimensions coordinates. the same latent variable or ‘‘construct’’, which can then
 Nominal regression with project success as a be considered as a macro-dimension of the evaluation
dependent variable and macro-dimensions (suc- process. We will henceforth use the terms ‘‘construct’’
cess dimensions) as explanatory variables. This and ‘‘macro-dimension’’ interchangeably. Essentially,
to understand the coordinators’ hierarchy of constructs are latent variables and are thus not directly
evaluation dimensions. measurable, but we can indirectly unveil their existence
 Nominal regression between the stakeholders’ by considering communal variation between item
appreciation of the project success as perceived scores. Items whose scores have a high proportion of
by the coordinator as the dependant variable, common variance, share the influence of a common
and macro-dimensions as dependant variables. latent variable or construct. Factor analysis, which is a
This is to understand the hierarchy upon which, tool of vector reduction, makes it possible to identify
according to the project coordinator, each sta- and specify constructs that underlie answers to state-
keholder built his appreciation of project success. ments. After orthogonal rotation, optimal statistical
 Non parametric analysis between success and a factor analysis generates three macro-dimensions for
priori influential characteristics to unveil other our database. The factor scores or co-ordinates on each
potentially significant meaningful relationships statement are shown in Table 1.
between success or success dimensions and Co-ordinates lower than 0.5 after orthogonal rotation
independent variables included in the survey. were removed, in order to improve the visual emergence
of the three macro-dimensions, whose meaning is dis-
Statistical analysis of Likert scale data is not tractable cussed in what follows:
with classical multivariate regression owing to the vio-
lation of usual assumptions. Multiple discriminant ana-
lysis or multinomial logistic regression stand as usual Table 1
alternatives for such surveys [25]. In the research, we Co-ordinates of macro-dimensions on micro-dimensions
chose multinomial logistic regression to test the sig- Micro-dimensions (items) Factors
nificance of the macro-dimensions versus the project
1 2 3
success as other researchers did for similar studies in
social sciences.6 Logistic regression does not require a BENSATIS 0.571
normally distributed dependent variable, linearity GS CONF 0.633
OBJECTIVES 0.569
between dependent and independents, homo-
TIME 0.729
scedasticity, independents to be intervals, etc. However BUDGET 0.851
PROFILE 0.730
6
Likert scales was considered as a valuable tool to assess percep- REPUTATION 0.586
tions in project management [12–14]. However it was not possible to ADDFUND 0.688
identify empirical project management research analysing ordinal data IMPACT 0.738
either with multiple discriminant analysis or multinomial logistic SUSTAIN 0.847
regression. These techniques are common in business research,
marketing, psychology, or medical sciences. n=82. Orthogonale rotation: VARIMAX.
26 A. Diallo, D. Thuillier / International Journal of Project Management 22 (2004) 19–31

 Macro-dimension 1: PROFILE, ADDFUND, nate under, but near to 0.5. Otherwise it is a cluster that
GSCONF, REPUTATION is very neat and delineates the scores of minor items,
OBJECTIVES excepted. These three components
Three (out of four) micro-dimensions gather parti- measure the real results and the medium and long term
cular characteristics which belong to the international direct or indirect benefits. We will simply name the
development project environment. They relate to the macro-dimension IMPACT. It explains 20% of the
concept of the political value of the project itself and of common variance.
its management. A project, considered under a political Two macro-dimensions (on three) are objective and as
angle, is as valuable tool for governmental action as it is it could be expected, one refers to the management suc-
for the professional career of the project manager. Pro- cess (macro-dimension 2) and the other to the success of
jects that run effectively are often publicised by the the project itself (macro-dimension 3). This is in accor-
government for political purposes. This is beneficial for dance with what the literature says for project manage-
the project manager as well as for the government. In ment at large. It is both interesting and reassuring to see
addition, it is generally understood that a project with a the factor analysis grouping the micro-dimensions in the
high local profile and a good reputation amongst the same manner as the conceptual analysis. The third
donors is in a position to eventually receive additional macro-dimension, PROFILE, captures a particular
funding for extension once the project’s initial phase behavior specific to the mechanics and to the distinctive
concludes. It is agreed that factor analysis does not environment of international development projects. The
allow us to statistically infer that ADDFUND depends national coordinator in a developing country cannot
on PROFILE and REPUTATION. Nevertheless the rely only on the fact that he is a competent and hard
grouping of these three micro-dimensions is significant. working project manager to ensure a long and prosper-
The multilateral institution which funds the project, ous professional career. The ‘‘survival’’ of the coordi-
may be viewed in some point as a client that the coor- nator as a coordinator, and thus as a personality that
dinator intends to satisfy. enjoys the benefits of a high profile position (his wages
The macro-dimension explains 24% of the common do not compare with those of his fellow civil servants in
variance. We will label this macro-dimension PRO- the ministry, see Appendix) depends on one hand on his
FILE, for the sake of simplicity. relationship with the task manager of the multilateral
institution (its other ‘‘client’’) and on the other hand, on
 Macro-dimension 2: BUDGET, TIME, his status as a local personality. A coordinator posi-
OBJECTIVES tively perceived within his environment can eventually
capitalise on the results of his project. The project can
This is a group of micro-dimensions which corre- be compared with a springboard; a rare opportunity
spond to the usual constraints of project management that the coordinator must carefully manage for the sake
(time, cost) with a dimension related to the satisfaction of the public interest as well as for his professional and
of the institution that funds the project (OBJECTIVES). personal interest.
Indeed, even if the actors, such as the local authorities However, the macro-dimensions documented earlier
and donors, agree on the finality of a project or pro- may not weight equally the coordinator’s judgement on
gram, then the specific objectives of the project are often his project success. This is precisely what we intend to
set up and defined by the donors’ evaluation team once analyse next.
the project appraisal is completed. These objectives
draw upon the overall aid framework of the multilateral 4.2. The coordinator’s hierarchy of macro-dimensions
institutions and adhere to their policies. This is even if
national and local experts participate in the field mis- We thus define the internal dimensions hierarchy on
sions and strive to raise local concerns. This macro- which the coordinators’ judgement is built. The depen-
dimension explains 23% of the common variance. It dant variable SUCCESS and the macro-dimensions
confirms that the coordinator strives to comply with the PROFILE, MANAGEMENT, and IMPACT needed
agenda that is set for the project leader and to satisfy some re-coding either on (0,1) or (1,2,3). As different
the multilateral institution. While the macro-dimension binary re-codings of SUCCESS did not show robustness
refers to classical project management skills it is named owing to aggregation problems linked with the variable
hereafter MANAGEMENT. distribution, we finally re-coded all variables on a (1,2,3)
scale which appeared more in accordance with the
 Macro-dimension 3: SUSTAIN, IMPACT, implicit meaning of the coordinators’ answers. With
BENSATIS such a scale, a score value of 1 represents more or less a
project failure, 2 means that the project is a relative
This macro-dimension could have included OBJEC- success and 3 characterises a complete success. Each
TIVES, since OBJECTIVES weighted it with a co-ordi- macro-dimensions was re-coded using the non-
A. Diallo, D. Thuillier / International Journal of Project Management 22 (2004) 19–31 27

weighted7 mean of scores for each item (micro- are assessing project success. However, it may not be
dimension) which defines the macro-dimensions as listed easy to accept the idea that the central player is less
in Table 1. The multinomial logistic regression is some- sensitive to the induced results (IMPACT) as he is to the
what tricky when it comes to discussing results but project PROFILE. Perhaps we should consider that
it gives a detailed understanding of the underlying IMPACT is an abstract concept that is difficult to eval-
relationship between variables which is precisely what uate, especially when the project is in start-up mode (the
we are looking for at this stage. As usual, the score 3 survey includes some ‘‘young’’ projects although not in
(i.e. for the dependant variable: the coordinator agrees an unacceptable proportion). Information is not avail-
strongly that ‘‘the project is a success’’) acts as able until the end of project and sometimes not until
the omitted score and thus acts as a reference in the after it has closed. There are delays inherent in the
statistical analysis. Results are seen in Table 2. reception of information concerning IMPACT indica-
Drawing on the earlier empirical results we may tors, particularly in education, health and other social
ascertain that: projects. However, we tested unsuccessfully IMPACT
for «young» and «mature» projects. As robustness of
 Globally, only the macro-dimensions MAN- the model may be questionable, random sub-samples
AGEMENT and PROFILE significantly under- multinomial logit estimations with two third of the data
lie the coordinators’ judgement. It is not possible base were conducted. MANAGEMENT was tested sig-
to say that the coordinators consider the nificant 10 times out of ten, PROFILE eight times, but
IMPACT, and therefore medium and long term IMPACT was significant only two times out of ten
benefits when assessing project success. which validates the findings in Table 2.8 This confirms
 Going into more detailed analysis, MANAGE- that the criteria comes third when judging of the project
MENT and PROFILE explain the fact that the success. It seems that for coordinators managing high
coordinator will never judge his project as a PROFILE projects, IMPACT is therefore taken more
failure (SUCCESS=1) when he finds that project or less for granted.
performance on both these dimensions is good.
The contrary also holds true: when both dimen- 4.3. The macro-dimensions factors of performance
sions are poor, the project will never be seen a
complete SUCCESS. However, a poor perfor- Our initial intention was to empirically investigate
mance on MANAGEMENT is the only reason potential variations of the coordinators’ hierarchy of
that might significantly restrain the coordinator dimensions with respect to characteristics like age, gen-
from considering his project a complete SUC- der, anglophone or francophone cultural influence or
CESS, but it could be considered a complete even project sectors. This was unfortunately not possi-
SUCCESS if MANAGEMENT is good but ble as the modest size of the database precluded seg-
project PROFILE is low. Again, the contrary mentation. We could however conduct non parametric
holds true. Finally, even if the project is con- correlations or non parametric tests between the macro-
sidered a failure or a relative success, IMPACT is dimensions and the earlier-mentioned variables. This
never significantly taken into consideration. does not give us any information on hierarchy but
allows us to nevertheless statistically infer relationships,
We are pleased to see that the MANAGEMENT if any, between variables and project performance. As a
dimension plays a prominent role when coordinators result we were in a position to ascertain:

 Performance on MANAGEMENT and PRO-


Table 2
The coordinators hierarchy of macro-dimensions
FILE depends upon the project sector (P < 0.05)
and the same can be said for IMPACT, although
SUCCESS less significantly (P < 0.10). It is common sense
1 Global 2 for IMPACT but less obvious for the other
macro-dimensions.
MANAGEMENT 0.004 0.000 0.002  older coordinators show better MANAGE-
PROFILE 0.003 0.002 0.104
IMPACT 0.193 0.267 0.130
MENT (P < 0.05). It is arguable to infer that as
development projects follow precise implemen-
n=82. Numbers show significance of the null hypothesis. This means tation processes and procurement guidelines,
that there is a significant relationship (underlined) when numbers are smooth management of such projects require
below 0.05.

7
Another statistical analysis was performed using weighted items 8
Multiple discriminant analysis came to an identical conclusion.
scores for each macro-dimension. Results did not show significant IMPACT was rejected for poor correlation with the discriminant
changes when compared with those discussed hereafter. functions.
28 A. Diallo, D. Thuillier / International Journal of Project Management 22 (2004) 19–31

some experience. As newly appointed project 4.4. The stakeholders’ hierarchy of evaluation
coordinators often lack of project management macro-dimensions
skills, time is required for the learning curve to
take effect. One can understand that an ‘‘old’’ Everyone is driven by his own perception of his
coordinator who can ably handle multilateral environment. It is also true for the project coordinator
project management constraints may get more who manages in accordance with the way he perceives
autonomy and may be treated in a more laisser- the stakeholders’ reactions as the project progresses. It
faire manner by his task manager and thus will was possible to identify the macro-dimensions on
show timely, efficient delivery of outputs. It may which the coordinator makes up his mind about pro-
also come from cultural traits: age is well ject success. Once we know how the coordinator per-
respected in Africa and the decisions of older ceives each stakeholder’s opinion about his project, it is
coordinators are often not contested within the straightforward to identify how the coordinator thinks
project team. the stakeholders are ranking the same macro-dimen-
 Having a national supervisor who is truly a sions. Remember the coordinator was alone when
‘‘politician’’ improves the performance on completing the questionnaire. As we only have the
IMPACT. In the instance where the national opinions of the coordinators, we must assume that the
supervisor is more of a ‘‘technician’’, it improves stakeholders build their judgements with the same
the MANAGEMENT performance. This con- macro-dimensions used by the coordinators. This
forms to assumptions but it is premature to infer seems highly probable. Even if stakeholders may use
without testing with control variables, particu- others, it is almost certain that these three macro-
larly with sectors. Again, this was not possible dimensions are taken into consideration, although not
because of database constraints. with the same hierarchy demonstrated by the coordi-
 When the multilateral agencies suspend dis- nators (see the literature review Section 2). It is pre-
bursements on the grounds of political or eco- cisely this last point that we want to investigate further
nomical matters, it significantly affects (P < 0.05) and empirically validate.
the MANAGEMENT as everyone could expect. The statistical strategy is the same as outlined Section
 Projects whose coordinators attend more semi- 4.2. Stakeholder opinions were also re-coded with a
nars and intensive workshops in Africa show (1,2,3) scale and were subjected to nominal regression.
significant MANAGEMENT improvements As usual, the score 3 (i.e. ‘‘the stakeholder strongly
(P < 0.05). However, only coordinators of high agrees that the project is a success’’) is the reference sit-
PROFILE projects attend seminars or work- uation. Results are shown in Table 3.
shops in North America. Only taking into consideration statistical significance
below the 0.05 level, we may ascertain that:
The data did not show any significant relationship
between achievement on the three macro-dimensions  As discussed earlier, (see Section 4.2) the coor-
and coordinators’ education, gender or the fact that the dinator is sensitive to the MANAGEMENT and
country was a former French or British colony. In these to the PROFILE of his project when it comes to
cases though, a lack of significance is as good a result as assessing its success. However IMPACT is never
is significance itself. a valuable macro-dimension for evaluation.

Table 3
Stakeholders hierarchy of macro-dimensions

SUCCESS

MANAGEMENT PROFILE IMPACT

1 Global 2 1 Global 2 1 Global 2

Coordinator (82) 0.004 0.000 0.002 0.003 0.002 0.104 0.193 0.267 0.130
Task manager (82) 0.115 0.226 0.676 0.001 0.000 0.060 0.184 0.034 0.018
Supervisor(82) 0.007 0.014 0.060 0.022 0.037 0.202 0.025 0.006 0.006
Steering Committee (80) 0.116 0.158 0.072 0.007 0.011 0.030 0.000 0.000 0.002
Project Team (82) 0.003 0.002 0.005 0.203 0.431 0.374 0.001 0.001 0.006
Beneficiares (80) 0.045 0.110 0.193 0.739 0.916 0.922 0.000 0.000 0.001
Population (82) 0.026 0.013 0.012 0.865 0.030 0.158 0.000 0.000 0.001

(n): number of respondents excluding missing values. Numbers show significance of the null hypothesis. This means that there is a significant
relationship (underlined) when numbers are below 0.05.
A. Diallo, D. Thuillier / International Journal of Project Management 22 (2004) 19–31 29

 The task manager in the multilateral develop- From all the statistical analysis emerge only two
ment agency is sensitive to PROFILE and unexpected results. As previously discussed, it appears
IMPACT but the data was not able to confirm contradictory that project coordinators do not care sig-
that he pays attention to the project MAN- nificantly for project IMPACT. In addition, the fact
AGEMENT. As a result, statistical analysis that other stakeholders place preference on IMPACT as
shows that there are differences between the two a key dimension for evaluation of project success shows
prominent stakeholders as the coordinators that even if the coordinators find it rather difficult to
appear to place preference on short-term con- assess project IMPACT (a possible explanation see
siderations (MANAGEMENT–PROFILE) Section 4.2), it does not preclude them to implicitly
when task managers show more of a long-term consider IMPACT as an unavoidable evaluation criteria
perspective (PROFILE–IMPACT). Here it for other stakeholders. If it is a difficult task for the
should be noted however that they both value central player to assess IMPACT, then it will be next to
PROFILE and that GSCONF is included in impossible for more peripheral actors to do so. Since all
PROFILE (see Table 1). The task manager is stakeholders but the coordinator appreciate IMPACT
therefore not indifferent to the quality of the as it should be, we face a specific result that requires
project outputs. Factor analysis is a valuable tool further research to be confirmed or better understood.
but it also has drawbacks: as separation of fac- The lack of strong significance of MANAGEMENT for
tors is not a clear cut one, caution is required in the task manager brings us to question either the coor-
the analysis before jumping to premature con- dinators’ thinking, which looks strange based on this
clusions. sole preoccupation, or to see this result as a unique
 The national supervisor, often a department sample feature which could disappear within a much
director or even the minister himself appears to larger database. Unfortunately the present size of the
value the three macro-dimensions with slightly data-base does not allow us to settle the question.
the same degree of significance. This conforms
with what could be anticipated
 The steering committee raises concerns only on 5. Conclusion
PROFILE and IMPACT. The committee does
not meet at steady intervals and its numerous The analysis of the project coordinators perceptions
members who are often representatives of gov- confirms that sensible differences exist on how stake-
ernment institutions turn over frequently. The holders value evaluation dimensions. This is a vali-
committee is not in a position to skilfully address dation of conceptual standard project evaluation
project management problems. In brief, the principles and methods as exposed in professional and
steering committee looks more like a burden than scientific project management literature. To put it
an effective consulting support to the project briefly, the study confirms that each stakeholder asses-
coordinator. ses project success on the basis of evaluation dimensions
 The project team values MANAGEMENT and that fit within his own agenda or within the interests of
IMPACT. It is a reassuring finding. Improve- the group he represents. It is worthy to note that the
ment of project efficiency should mean some research, which shows some other interesting empirical
increase in support to the project team as a whole results, was conducted with and through the sole per-
or at least to its most effective members (short ception of the coordinators. We consider this to be the
but intensive project management workshops, main and unique engine of the project’s future path and
procurement seminars, etc.) success. Obviously, validity of the empirical findings
 The beneficiaries’ concerns reside only in project depends on the sincerity of coordinators’ answers to the
IMPACT, which again looks like common sense. proposed statements of the questionnaire and is subject
Management is not a ongoing concern for ben- to limitations as discussed Section 3.1. However, ques-
eficiaries as appropriate information does not tionnaires were received for more than 90 projects fairly
reach them anyway. Beneficiaries do not care for well distributed with respect to countries, sectors and
PROFILE as it is only the fulfilment of their maturity. We think the results deserve generalisation
essential needs that matters to them. and may be extended to how the community of project
 The general populace get information through coordinators of international development projects in
the newspapers, the radio or the television. It is a Africa south of the Sahara ranks success dimensions
logical finding that the public are sensitive to and how they perceive the evaluation dimensions hier-
PROFILE. Like the beneficiaries, the public at archy of each project stakeholders.
large is unable to assess MANAGEMENT Perceptions may sometimes be incorrect representa-
quality, but the project IMPACT matters as tions of reality but as we discussed earlier, perceptions
anticipated. are the coordinator’s sole possession and are the very
30 A. Diallo, D. Thuillier / International Journal of Project Management 22 (2004) 19–31

basis upon which he makes his decisions. We are left tation. It is our hope that the future empirical results on
with the paradox that perception may be the rational these interesting and already widely debated questions
that drives the project path. will eventually complement the findings presented
The statistical analysis was able to confirm well- here.
accepted principles of project evaluation. It was also
possible to address other topics more directly linked to
the particular type of projects under investigation. Acknowledgements
Relationships between some variables and project suc-
cess dimensions were analysed. We did not however The authors would like to thank the company
directly address internal project success factors like SETYM International Inc. (Montreal, Quebec, Canada)
project team interrelations or communication quality for offering the use of its database of project managers,
between the project coordinator and the more influen- coordinators and directors of projects financed by
tial stakeholders. Such research is under implemen- international financing institutions in Africa.

Appendix. Characteristics of projects and project coordinators


Project sectors: (n=89)
% % %
Education 12.4 Rural Development 19.1 Reform & Governance 11.2
Energy 3.4 Urban Development 3.4 Health, Pop. and Nutr. 5.6
Environment 9.0 Public Works 6.7 Comm. and Telecom 2.2
Mines 2.2 Social Dev. 9.0 Agetipe9 15.7

Donors contributions: (n=83), (Millions of US $)


TOTAL WORLD AFDB EU UNDP OTHERS GOVT.
BANK
n 86 61 23 17 23 36 63
Mean 36.08 25.94 9.50 9.78 1.82 15.60 7.75
Median 16.70 19.00 2.00 2.50 0.30 5.50 2.00
Mode 5.00 4.10 0.00 0.00 0.00 0.00 2.00
Min. 0.06 0.00 0.00 0.00 0.00 0.00 0.00
Max. 600.00 120.00 60.00 90.00 15.00 250.00 100.00

Project coordinators:
Gender (n=91): Male: 89% Female: 11%
Country (n=92) : Anglo: 35% Franco: 65%
Education (n=91) : Undergraduate: 13% Graduate: 87%
Prof. status (n=91): Civil servant: 33% Civil serv. seconded: 27%
Contractual: 34% Other : 6%

Salary and benefits: (n=89)


(equivalent US $) <2 500 2500–5000 5000–7500 7500–10 000 > 10 000
% 26.1 17.4 10.9 8.7 33.7

9
Agence d’ Exécution des Travaux d’ Intérêt Public.

References [6] Shenar AJ, Levy O, Dvir D. Mapping the dimensions of project
success. Project Management Journal 1997;28(2):5–13.
[7] Lim CS, Zain MM. Criteria of project success: an explanatory re-
[1] Jack W. Social Investment Funds: An organisational approach to examination. International Journal of Project Management 1999;
improve development assistance. The World Bank Research 17(4):243–8.
Observer 2001;16(1):109–24. [8] Baccarini D. The logical framework method for defining project
[2] Youker R. Managing international development project : lessons success. Project Management Journal 1999;30(4):25–32.
learned. Project Management Journal 1999;30(2):6–7. [9] Stukenbruck L. Who determines project success? PMI Annual
[3] Freeman M, Beale P. Measuring project success. Project Man- Symposium. Montréal, 1986;85-93.
agement Journal 1992;23(1):8–17. [10] Widemann RM. How to motivate stakeholders to work together.
[4] Pinto JK, Slevin DP. Project success: definitions and measure- In: Cleland DI, editor. Field guide to project management. New
ment techniques. Project Management Journal 1988;19(1):67–72. York: Van Nostrand Reinhold; 1998. p. 212–26.
[5] Pinto JK, Slevin DP. Critical success factors across the project [11] Baker BN, Murphy DC, Fisher D. Factors affecting project
life cycle. Project Management Journal 1988;19(3):67–74. success. In: Cleland DI, King WR, editors. Project Management
A. Diallo, D. Thuillier / International Journal of Project Management 22 (2004) 19–31 31

Handbook. New York: Van Nostrand Reinhold; 1988. p. 902– viour: do men and women managers discipline men and women
19. subordinates uniformly. Journal of Business Ethics 2002;40(2):
[12] Andersen ES, Dyrhaug QX, Jessen SA. Evaluation of chinese 155–66.
projects and comparison with norwegian projects. International [19] Daniel E, Wilson H, Myers A. Adoption of e-commerce by SMEs
Journal of Project Management 2002;20(8):601–9. in the UK. International Small Business Journal 2002;20(3):253–
[13] White D, Fortune J. Current practice in project management: an 70.
empirical study. International Journal of Project Management [20] Cupach WR, Carson JM. The influence of compensation on
2002;20(1):1–11. product recommendations made by insurance agents. Journal of
[14] Dvir D, Raz T, Shenhar AJ. An empirical analysis of the rela- Business Ethics 2002;40(2):167–76.
tionship between project planning and project success. Interna- [21] Valentine S, Barnett T. Ethic codes and sales’ professionals per-
tional Journal of Project Management 2003;21:89–95. ceptions of their organisations social values. Journal of Business
[15] Jodelet D. Représentation sociale: phénomènes, concept et théo- Ethics 2002;40(3):191–201.
rie. In: Paquet-Sévigny Th. editor. Communication et développe- [22] Crowne DP, Marlowe D. A new scale of social desirability inde-
ment international. Presses de l’Université du Québec; 1996. pp. pendent of psychopathology. Journal of Consulting Psychology
357–78. 1960;24:349–54.
[16] Ravault RJ. Développement durable, communication et récep- [23] Paulhus DL. Two-component model of socially desirable
tion active. In: Paquet-Sévigny Th. editor. Communication et responding. Journal of Personality and Social Psychology 1984;
développement international. Presses de l’Université du Québec; 49:598–609.
1996. pp. 59–79. [24] Zerbe WJ, Paulhus LD. Socially desirable responding in organi-
[17] Au AKM, Tse ACB. Marketing ethics and behavioural predis- sational behaviour: a reconception. The Academy of Manage-
positions of chinese managers of SMEs in Hong Kong. Journal ment Review 1987;12(2):250–64.
of Small Business Management 2001;39(3):272–8. [25] Hair JK, Anderson RE, Tatham RL, Black WC. Multivariate
[18] Bellizi AJ, Hasty RW. Supervising unethical sales force beha- data analysis. 5th ed. Toronto: Prentice-Hall; 1998.

Das könnte Ihnen auch gefallen