Beruflich Dokumente
Kultur Dokumente
www.elsevier.com/locate/compind
Abstract
Describes the evolution of performance measurement (PM) in four sections: recommendations, frameworks, systems and
inter-organisational performance measurement. Measurement begins with a recommendation, which is a piece of advice related
to the measures or structure of performance measurement; frameworks can be dichotomised into a structural and procedural
typology that suggests structural framework development has outstripped procedural framework development. The basic
requirements for a successful PM system are two frameworksone structural and one procedural as well as a number of other
performance management tools. Inter-organisational performance measurement may be divided into supply chain and extended
enterprise performance measurement: the former relying solely on traditional logistics measures, while the latter incorporates
the structural aspects of the supply chain system and adds non-logistics perspectives to its measurement arena. Finally, the
encroachment of the performance measurement literature into the processes related to performance management is examined,
and areas for future research are suggested.
# 2005 Elsevier B.V. All rights reserved.
Keywords: Recommendations; Frameworks; Systems; Inter-organisational performance measurement; Performance management
1. Introduction
Organisational performance has always exerted
considerable influence on the actions of companies.
Consequently, the ways and means of accurately
measuring this performance is perceived as being an
increasingly important field of research for both
* Corresponding author. Tel.: +353 91 750 414;
fax: +353 91 562 894.
E-mail address: paul.folan@nuigalway.ie (P. Folan).
0166-3615/$ see front matter # 2005 Elsevier B.V. All rights reserved.
doi:10.1016/j.compind.2005.03.001
664
665
666
Table 1
Recommendations for the design and development of performance measurement frameworks and systems
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
Recommendation
Researcher
[2,9,21,24,32,42,47,62]
[2,19,66]
[19]
[19,28,29]
[2,19,27,30,31,50,57,60]
[19]
[19]
[19]
[19]
[19]
[9,19,21,23,27,47,57,62]
[21]
[21]
view of business performance measurement, and a 10step procedural model [56] to describe what needs to be
done in terms of PM. Similar to Lockamy III, Azzone
et al. [2] have focused upon developing structural PM
models to suit specific competitive priorities (i.e. time,
cost, etc.); their framework seeks to identify suitable
measures based upon an internal/external division.
Both Kaydos [45] and Wisner and Fawcett [77] have
proposed procedural stepwise framework models,
while the structural balanced scorecard [42] attempts
[21]
[21]
[21]
[21]
[29]
[29]
[32,72]
[32]
[42]
[44]
[53]
[53]
[53]
[53]
[53]
[8,10]
[67]
[7,62]
[55]
667
Table 2
A comparison of performance measurement frameworks
Framework
Researcher
Framework
typology
Does it suggest
other formal
measurement
processes?
[73]
[46]
Procedural
Structural
No
No
[26]
Structural
Performance measurement
system models
[53]
Structural
Performance pyramid
[57]
Structural
Ten-step model
Internal/external
configuration
time framework
Kaydos framework
Wisner and Fawcetts
framework
Balanced scorecard
[56]
[2]
Procedural
Structural
Time
[45]
[77]
Procedural
Procedural
No
No
[42]
Structural
No
AMBITE performance
measurement cube
Browns framework
EFQM model
SME performance
measurement
framework
Performance prism
[11]
Structural
No
[14]
EFQM
[35]
Structural
Structural
Procedural
No
No
No
[65]
Structural
No
Framework for
multi-national companies
[78]
Structural
Integrated performance
measurement framework
[71]
Structural
No
No
No
No
Yes (principles)
668
financial perspective;
customer perspective;
internal business perspective;
learning and growth perspective.
669
670
3. Measures are then selected from a separate predefined list of performance measures (this separate
list is not supplied; however, we are told that it
contains 105 mainly non-financial measures, with
full descriptions and methods of calculation). Next
is stage 4, which is omitted if the company has no
existing PM system.
4. Auditthe existing set of measures is listed down
and compared with the new measures that have
been identified in the previous stage. Three rules
are applied:
existing measures that are congruent with new
measures are kept and continually used;
existing measures that are divergent with the
new selected measures are deemed no longer
relevant or useful to a companythey are
scrapped;
new measures selected that do not tie with
existing measures are implemented. They
represent gaps in the PM system;
if no gaps are identified then stage 5 (next) is
omitted.
5. Implementation of measuresan eight-step plan is
provided for company implementation of the new
measures.
6. Periodic maintenancethe last stage of the system
revolves around periodically reviewing a companys PM system.
Medori and Steeple [62] proceed to illustrate their
PM system with a case study that took 3 months to
complete from start to finish. Two problems identified
with the system are:
difficulties can be found in relating a companys
strategy to the performance measurement grids
competitive priorities;
the separate pre-defined list of performance
measures may become dated.
Both of these points are similar to the problems
faced by the PM system proposed by Bradley [11].
The merits of the three academic systems are
compared in Table 3, where it is clear that each PM
system must have two PM frameworks (structural and
procedural) that when combined, produce the methodology which forms the pivot for various performance management aids, such as lists of performance
Yes (pre-defined,
non-adjustable)
Yes
Quality, cost, flexibility, time,
delivery, future growth
[62]
Medori and Steeple
PM system
No
Yes (pre-defined,
non-adjustable)
Yes (implied)
[11]
BPR PM system
Yes (BPR)
No (process may be
repeated, but tools
are static in nature)
No (process may be
repeated, but tools are
static in nature)
Yes (number of
performance
management tools
([3841,43,44])
Yes (process
design matrix)
No (suggestions in
case studies though)
Yes
Financial, internal business,
customer perspective,
innovation and learning
[42]
Balanced scorecard
PM system
No
Specific measures
Set of steps towards
system design
(procedural framework)
Dimensions of measurement
(structural framework)
Specific
context
Researcher
System
Table 3
A comparison of performance measurement systems
Other distinguishing
measurement aids
671
5. Inter-organisational performance
measurement
The concept of designing a PM system specifically
tailored to the requirements of inter-organisational PM
(as opposed to intra-organisational PMthe systems
and frameworks dealt with above), is in general, a
neglected, but fast-growing facet of the PM literature.
Current studies of inter-organisational PM usually
focus upon supply chain PM; extended enterprise PM
has been touched upon only briefly by the PM
literature. A supply chain PM system focuses upon
what are termed by Brewer and Speh [12] as
traditional logistics performance measures (i.e. measures such as order fill rates, error rates, inventory
costs, delivery time, etc.). By focusing almost
completely upon the logistics control system, supply
chain PM cannot answer a number of wider ranging,
more holistic questions: for example, How effectively
are the firms in the supply chain interacting? How does
this supply chain fare compared to competing supply
chains? How flexible is the entire supply chain in
responding to requests for customised packages,
672
673
674
675
676
677
7. Conclusions
This paper tackles what Marr and Schiuma [58]
have termed the diverse body of literature upon
PM, by providing an overview of the evolution of the
concept of PM, from its modern beginnings to the
various recommendations, frameworks and systems
that have been developed under its umbrella. Further
evolutions of the PM literature are indicated in the
inter-organisational PM research, which is here
dichotomised into supply chain PM and extended
678
References
[1] D. Amaratunga, D. Baldry, Moving from performance measurement to performance management, Facilities 20 (56)
(2002) 217223.
[2] G. Azzone, C. Masella, U. Bertele, Design of performance
measures for time-based companies, International Journal of
Operations and Production Management 11 (3) (1991) 7785.
[3] W. Band, Performance metrics keep customer satisfaction
programmes on track, Marketing News (MNW) 12 (May)
(1990).
[4] R. Basu, New criteria of performance management: a transition from enterprise to collaborative supply chain, Measuring
Business Excellence 5 (4) (2001) 712.
[5] B. Beamon, Supply chain design and analysis: models and
methods, International Journal of Production Economics 55
(1998) 281294.
[6] B.M. Beamon, Measuring supply chain performance, International Journal of Operations and Production Management 19
(3) (1999) 275292.
[7] U. Bititci, Integrated Performance Measurement Systems: An
Audit Approach. Parts 1 and 2: Control, FebruaryMarch,
2002.
[8] U. Bititci, P. Suwignjo, A. Carrie, Strategy management
through quantitative modelling of performance measurement
systems, International Journal of Production Economics 69
(2001) 1522.
[9] U. Bititci, T. Turner, C. Begemann, Dynamics of performance
measurement systems, International Journal of Operations and
Production Management 20 (6) (2000) 692704.
[10] M. Bourne, J. Mills, M. Wilcox, A. Neely, K. Platts, Designing,
implementing and updating performance measurement systems, International Journal of Operations and Production
Management 20 (7) (2000) 754771.
[11] P. Bradley, A performance measurement approach to the reengineering of manufacturing enterprises, Ph.D. Thesis,
CIMRU, NUI Galway, Ireland, 1996.
[12] P. Brewer, T. Speh, Using the balanced scorecard to measure
supply chain performance, Journal of Business Logistics 21 (1)
(2000) 7593.
[13] P. Brewer, T. Speh, Adapting the balanced scorecard to supply
chain management, Supply Chain Management Review
(MarchApril) (2001) 4856.
[14] M. Brown, Keeping Score: Using the Right Metrics to Drive
World Class Performance, Quality Resources, New York, NY,
1996.
679
[34] S. Holmberg, A systems perspective on supply chain measurements, International Journal of Physical Distribution and
Logistics 30 (10) (2000) 847868.
[35] M. Hudson, J. Lean, P. Smart, Improving control through
effective performance measurement in SMEs, Production
Planning and Control 12 (8) (2001) 804813.
[36] H. Jagdev, A. Brennan, J. Browne, Strategic Decision Making
in Modern Manufacturing, Kluwer Academic Publishers,
Massachusetts, 2004.
[37] H. Jagdev, J. Browne, The extended enterprisea context for
manufacturing, Production Planning and Control 9 (3) (1998)
216229.
[38] R. Kaplan, D. Norton, Putting the balanced scorecard to work,
Harvard Business Review (SeptemberOctober) 71 (5) (1993)
134147.
[39] R. Kaplan, D. Norton, Linking the balanced scorecard to
strategy, California Management Review 39 (1) (1996) 5379.
[40] R. Kaplan, D. Norton, Having trouble with your strategy? Then
map it, Harvard Business Review 78 (SeptemberOctober)
(2000) 167176.
[41] R. Kaplan, D. Norton, The Strategy-Focused Organization,
Harvard Business School Press, Massachusetts, 2001.
[42] R. Kaplan, D. Norton, The balanced scorecardmeasures that
drive performance, Harvard Business Review (JanuaryFebruary) 70 (1) (1992) 7179.
[43] R. Kaplan, D. Norton, Translating Strategy into Action: The
Balanced Scorecard, Harvard Business School Press, Boston,
1996.
[44] R. Kaplan, D Norton, Using the Balanced Scorecard as a
Strategic Management System, Harvard Business Review
(JanuaryFebruary) 74 (1) (1996) 7585.
[45] W. Kaydos, Measuring, Managing and Maximising
.Performance, Productivity Press, Cambridge, MA, USA, 1991
[46] D. Keegan, R. Eiler, C. Jones, Are your performance measures
obsolete? Management Accounting (June) 70 (12) (1989)
4550.
[47] M. Kennerley, A. Neely, Measuring performance in a changing
business environment, International Journal of Operations and
Production Management 23 (2) (2003) 213229.
[48] J. Kleijnen, M. Smits, Performance metrics in supply chain
management, Journal of the Operational Research Society 54
(5) (2003) 507514.
[49] L. Lapide, True measures of supply chain performance,
Supply Chain Management Review (JulyAugust) 4 (3)
(2000) 2528.
[50] R. Lea, B. Parker, The JIT spiral of continuous improvement,
IMDS 4 (1989) 1013.
[51] M. Lebas, Performance measurement and performance management, International Journal of Production Economics 41
(13) (1995) 2325.
[52] H.L. Lee, Creating value through supply chain integration,
Supply Chain Management Review (SeptemberOctober)
(2000).
[53] A. Lockamy III, a study of operational and strategic performance measurement systems in selected world class manufacturing firms: an examination of linkages for competitive
advantage, Ph.D. Thesis, University of Georgia, 1991.
680
Jim Browne is registrar and deputy president of the National University of Ireland, Galway, as well as the founder of
the Computer Integrated Manufacturing
(CIM) research unit there. He has many
years experience of working in applied
research and development, including
extensive experience of EU and industrially funded projects. His research interests are in the design, analysis, modelling
and operation of extended and virtual enterprises. He holds bachelors and masters degrees from NUI, Galway and PhD and DSc
degrees in engineering from the University of Manchester Institute
of Science and Technology. His most recent book, co-authored with
Dr Hari Jagdev and Dr Attracta Brennan is entitled Strategic
Decision Making in Modern Manufacturing and published by
Klewer Academic Publishers in 2004.