Sie sind auf Seite 1von 7

RESEARCH.

T ECHNOLOGY, DEVELOPMENT AND TRAI NING

Maintenance Audits
Using Balanced Scorecard
.-._Matu r:. t}! 1,_ _ _ _-----'
There is increasing interest in the use of maintenance performance measurement (MPM)
and the possibility of using the maintenance audits for bench marking metrics. This articie proposes
a methodology for simple measurement, one that accepts the indicators used on a scorecard with
j four perspectives and is hierorchized according to organizational level. The maintenance audit will
Ii evaluate the degree of fulfillment of objectives and the degree of satisfaction obtained from each
of those perspectives. It will provide a ciear picture of the current status of maintenance
i organization and the success of implemented policies taking into account the maintenance
f, maturity model, i.e, the logical evolution of maintenance function in the company
!
:1 _ _ _ _ _ _ _ _ _ _ _ _~~

I. ferent nationa l adaptation s and translations


propose a set of more than 70 indicators
tive audit is a nuclear power plant mainte-
nance performance audit, which is similar to
j, [2]. These two sta ndards are not mandato- ReM analysis, Martorell et al. [4]. Each type
ry and they consider different (incompat- has its own strengths and weaknesses.
ible) metric characteristics in their quali- The proper measurement of maintenance
UO AY K UMAR
Professor, Or. tative (surveys) and quantitative (indica- performance requires an associa tion between

I uday.kumar@ttu.se tors) aspects. As will be shown, to correct-


ly measure the maintenance function, the
coherent and compatible objectives and in-
dicators. This article proposes a method for
DI EGO GALAR
two should be combined. grouping maintenance performance indica-
Professor, Dr:
Depending on its goals, a maintenance tors using the hierarchized Balanced Score-
diego.galar@ltu.se
audit can be either qualitative or quantita- card (BSC) and considering different organ-
AOI TYA PARIOA tive. Classic examples of audits wich a strong izationallevels. While the contributions of
Associate Professor. Dr. qualitative component are those concerned authors like Wireman [5], and the recom-
aditya.parida@ttu.se with safety, Sorensen [3]. A classic quantita- mendations of the EFNMS an d the North
CHR ISTER STENSTRbM
Researcher
christer.stenstrom@ttu.se
SUI"'"U aMI ob)t'".u
l1i1nt_"'" pcJI!c>u
Lulea University of Q"woty 5t .... t., I" .I'd obj",t,.."
fffltltoq
Technology Costs
Sweden

vision, how must they In order to obtain the


he criteria for maintenance audits dif-

T fer fro m other types of audits; the ab-


see the maintenance

s~::n"~~ms~
?
VISion, how must we
learn and Impro}

vi s,. . ., ' '~


sence of standardi zed procedures as
well as little literature on the topic means
Hu man f i ctOl' INTERNAL
also th at research and development have F'nvI;nflO/\
RAMS Parl~V"'
PERSPECTIVE .",o ••
Competition.
lagged behind the burgeoning interest.
~
Inl.-ulTUCtUret
Hiri<1&
WanonouUI ., In order to satisfy the Llborc~mllle
A classic maintenance audit standard, O"J.l client, what processes
COVENIM 2500-93 [1] fro m Venezuela must be excellent?
(1993 ), uses surveys to gather data. The
most recent standard is EN 15341; its dif- FIGURE 1. The BSC of maintenance.

34 MAINTWORLD 3 - 2011
best tine to begin improvements; see War-
dehoff [7J.

The maintenance scorecard


Typically, scorecards indicate the level
reached in the attainment of objectives, usu-
ally upper management's financial objectives.
They have remained unchanged, even though
the management of organizations has con-
siderably modified its strategic vision in re-
FIGURE 2. Projection of indicators. cent years. Various criteria of management,
as in the EFQM Excellence Model, are of-
ten isolated and independent of each oth-
er; for example, an organisation's technical
and economic aspects are separated. Each
follows different directives and operates
at different functional and hierarchic lev-
References els, creating the fa lse impression that objec-
tives can be separated. In some departments,
like maintenance, operating and economic
indicators are clearly divided, the former fol-
lowing the directives of the head of mainte-
nance and the latter following the compa-
ny's overall direction.
On the Maintenance Scorecard (MSC),
maintenance-based BSC is reorganized; ob-
Comparison Results and
wrth references and proposals of
jectives are integrated in a logical way. The
combination of data Improvement MSC helps to transform good intentions in-
to actions directly applicable to employees'
daily work, while bearing in mind the four
Measurement strategic business perspectives mentioned
of the indicators above: financial, client, internal processes
and learning-growth. In the case of mainte-
nance, however, the head of maintenance of-
fiG U RE 3. Model of qualitative and quantitative audit. ten knows only a few production objectives.
For the most part, no one tells him! her ex-
American SMRP to the field of the mainte- indicators within the organization's hierar- actly what the organization expects, leaving
nance metrics are useful, they propose an chy, by using a break down process. The use him/her to figure it out on hislher own.
excessive number of indicators and do not of a hierarcruzed BSC is a logical integrating The structure of the MSC, represented
provide a clear approach. Present methods tool for MPM and allows the maintenance in f IGUR E 1 , indicates the modus operandi
can use toO many indicators, read the data department to achieve the goals set by the used to translate the organization'S mission
too optimistically, and fail to clearly articu- top management layer. into concrete objectives; strategies to achieve
late or even understand objectives and pur- A maintenance audit is an apparently sim- them can be generated by using the four per-
pose of the measurement. This absence of ple concept but is, in fact, extremely com- spectives. The objectives are derived from the
vision, added to poorly communicated cor- plex. Given the lack of standardization and general company objectives but are specif-
porative objectives, constitutes the main de- the number of divergent opinions, it is sel- ic to the maintenance. For this to work, the
ficiency in traditional systems. dom performed. whole maintenance hierarchy must know the
The present proposal uses the framework The present article will suggest a meth- objectives of the upper management.
of rhe Balanced Scorecard (BSC), Kaplan & odology of simple measurement, using the Based on this knowledge, maintenance
Norton [6], and classifying indicators ac- framework of the BSC with its four perspec- managets must consider their own depart-
cordingly. Following the BSC guidelines, it tives. The goal is to audit the degree of the ments and improve their activity. This com-
uses the four general perspectives: client's fulfilment of objectives and the degree of sat- prises the "knowledge pool" of the organi-
perspective, financial perspective, perspec- isfaction obtained from each of the four per- zation. More specifically, the indicators be-
tive of internal processes, and perspective of spectives. This will provide a clear picture of come control indices with predetermined fre-
learning and growth. The article sets these the department's situation and indicate the quencies, allowing managers to see if the »)}

MAINTWORlD 3.2011 35
RecognrtJon of To organize the
results are in line with the specified objec- /ntel'Vle:WS
!he place collectIOn of data
tives. If not, then suitable corrective meas-
ures must be taken.
Warnings and
The maintenance indicators should be recommendations for t he
grouped into one of the four perspectives departments imphed In and
with the maintenance functlon
mentioned in FIGURE 1; their objectives
should be also be included. The indicators
measure the degree of success of the diverse
Compda1Jon and
strategies and the extent to which the objec- anal)'SlS of results
tives have been attained. Audrt report

T he maintenance audit
FIGURE 4 . Scheme of audit and previous stages.
The presented audit model consists of two

.. ..
aspects, one qualitative and one quantitative,
Zahra Mohaghegh et aL [8J, The quantita-
tive parr measures numerical indicators in-
cluded in the scorecard, located in the four
different BSC perspectives and hierarchized
at different levels. The qualitative aspect con-
stitutes a set of surveys carried out at differ-
ent hierarchical levels.
In the model, the indicators and the sur-
veys are combined, thereby validating the
Creation of
the control
panel
.., .. ..Measurement
of the
mcicators
Comparison or
benchmarlong
Proposals of
m provement

~
"
: quantitative indicators with the qualitative ,.".
I
i perceptions of the surveys. They are collat-
I ed with the references associated with each """"""",,ment
of",,...,.,
i measurement to reveal deviations and iso-
late possible problems.
Some indicators will contribute measures
in conventional units, like monetary units,
temporary units or number of actions, prod-
r uCts etc. Others will be ratios of certain mag-
nitudes, representing a percentage of differ- FIGU RE 5. Steps to follow in the accomplishment of the audit.
f ent costs or types of maintenance, or repre-

I senting indices of efficiency or inefficiency


whose ideal value is zero.
It is important to know the present state
The developed methodology combines
the scorecard, the strategy of the company
scribed methodology, the fonawing phases
are suggested.
[ of the maintenance and to be able to com- and what is requested of the maintenance
I pare different aspects on the same scale. This department, as observed in FIGURE 5. That Phase 1: Creation of the scorecard
,I
is more important than knowing the val- is to sa y, the measurements and the score- First, a scorecard with clear indicators and
ue itself of indicators, as an absolute va lue card will reflect what the company expects repeatable measures must be created. The
lacks interest; the trend gives much more from the maintenance department. measures selected must be performed in
value. Therefore, it is best to be especial- The benefit of this method is its rapidi - similar conditions and should not be af-
ly careful in the first audit, as it will be a ty; the audit team only needs to know the fected by the audit process. Among all hier-
bench marking and reference point in sub- business objectives that involve the mainte- archized indicators, those considered both
sequent audits. nance department. representative and independent wil1 be se-
Objectives can be classified into two lected.
PRO CESS O F A PPLI CATION types: effective yield and organizational ef- This first step filters the necessary and
OF TH E AUDIT ficiency. The improvement derived from the independent indicators (the only ones that
An audit involves more than a predeter- recommendations should not be considered, will be considered) from all those includ-
mined questionnaire or the measurements as the proposal of improvements constitutes ed on the scorecard. Considering daily per-
of numerical indicators. A number of com- the last step of the process. It is external and formance controls can lead to the addition
plementary stages are required to obtain a subsequent to the audit. of many more indices, but the audit must be
result that is useful to decision making; see To perform a maintenance audit in an done quickly, making it impossible to con-
FIGURE 4. organization for the first time using the de- sider all measures.

36 MAINTWORlD 3.2011
Set of indICators to be
audited In a regular time
Selection of indicators baSIS
is useful to have individual perceptions and
to be able to compare them to the measured
numerical figures.
There are four possi ble sources for in-
formation in the measurement of indicators,
as shown in FIGURE 7. The required data
are usually not integrated into one system,
and their dispersion in different applicati ons
and computer systems is often chaotic. Thus,
the data collection process is time consum-
ing, and auditors have to check the quality
of the data and ass ure that all records are
properly updared.

Phase 3: Comparison or benchmarking


When the measures have been obtained, they
are collated with the set reference points. The
FIG U R E 6. Extraction of parameters of the integral scorecard. deviation of the measurements from the ref-
erence points will indicate the positive or
negative result of the audit. These reference
points can have several origins: benchmark-
ing, the experience of technicians and the
previ ous performance of assets, the recom-
mendations of the manufactu rer or the ex-
perience of the auditor who, according to
Lemos [10], mu st set proper thresholds for
the organization.
Measurement of parameters
Operation of data of the
of which there are no registries Phase 4: Proposals of improvement
different Infor mation
systems The most important res ult of the audit will
be the deviations from the reference values.
Measurement Based on these deviations, some improve-
of indicators ments should be proposed and scheduled to
be corrected before the next audit.

PROGRAMM ING AND PLANNING


OF THE AUDI T PROC ESS

Operation manual
The first step is the preparati on of the score-
of data noncomputenzed card, but the use of many surveys and indi-
cators demands a stru ctured measurement
process with a tight schedule. Obviously, the
auditor wants to be able to visualize the four
perspectives of the BSC during the progress
FI GURE 7. Sources of intelligence to consider in the measurement of the indicators. of the audit, and understand why the audit
is considering specific indicators. Therefore,
it is necessary to create a clear and trans-
Phase 2: Measurement of the indicators ures to an organization's objectives. Other parent methodology that makes the meas-
and accomplishment of the surveys authors like Wani et al. [9] propose the use urements possible.
This process must be systematic; it must al- of nonstandard indicators, arguing that if in- To plan a logical sequence in the measure-
so be performed quickly without consum- dicators are custom-designed, they will best ment of those parameters and to secure par-
ing too many reSOurces. In addition, the au- suit the audit's needs; on the other hand, it tial results throughout the process, Wireman
dit must be agile and trustworthy. Some au- will be more difficult to perform compari- [3J and Campbell [11J look at the evolution
thors recognize the need to work with stand- sons or benchmarking. of the maturity of the maintenance in an or-
ard and generic measures, but are conscious The weak point of the surveys, mean- ganization on the basis of levels. Wireman's
of the possible inapplicability of these meas- while, is their human factor. N evertheless it definiti on of the necessa ry steps to fo llow »»
MAINTWOR L D 3.2011 37
I
I
I
!I takes a pyramid shape, shown in FIGURE 8.
I,
I
This maintenance evolution pyramid can be
used to organize the audit in a chronolog- Production &
i ical way with the intention of identifying maintenance integration

I
Level 2
the level of where the organization is in the
Warehouse CMMS work order
, pyramid. It can also be used to determine if Human factor
I the correct actions have been taken to as- level I

sure maintenance evolution based on solid


1 and well defined steps. FIGURE 8. Relocotion of indicators (or audit.
As the figure shows, the indicators asso-
ciated with the four BSC perspectives can
I be transferred to the pyramid, so that a new
,i set of indicators for each level of the pyra-
mid is created.
i When the indicators are relocated in the
maintenance evolution pyramid, the meas-
urement process can start, beginning at the
,f· bottom of the pyramid and using the bench-
, marks associated with each level as a basis
I for comparison. The audit C3n be stopped
,I , at any point if the organization's real level
of maturity turns out to be different than is Warehouse CM MS work order
i mapped on the pyramid. Human factor State of maturity of level 2
,
"
This methodology creates a srructured level I

,,
i measurement process that allows partial
Set of State of maturrty of level t
'. results throughout the audit. The different
measured indicators
stages in the evolution of the maintenance
I
are audited, leading to useful recommen-
dations. If the benchmarked levels are sur-
passed, only small nonconformities will ap-
I pear. More serious recommendations derive
II from the benchmarking discrepancies in the
Re-transfer of the indicators
to t he BSC to conSIder what
Cllen! F,n~ntlal
indicators on non mature levels. Success or needs to be deve loped
I!np~tI"1l ~rspH"""

II non success in one level will be explained


on the scorecard.

by the indicators on lower levels. In!crnal l earn,ng ~nd


prv'c~s grcw!h
It is important to emphasize (see FI G- penpeC!'VIl perspl!u,ve
r URE 9 ) that in cases of high levels of immatu-
rity, the audit's value is considerably reduced
I
;
because the obtained figures are not relevant.
FIGURE 9. Process of the audit based on the degrees o(maturity of the maintenance
In this case, it is time to re-transfer the indi-
cators to the BSC and to consider what needs are proposed, indicators can be transferred greater efficiency and effectiveness. The au·
to be developed on the scorecard. once again to the BSC. The last audit stage dit's recommendations will describe suitable
The complete process can be seen in FIG- consists of the projection of the indicators development of the maintenance function in
URE 10. The audit begins at the base of the measured with their benchmarks onto the the organization, showing the logical steps
pyramid; the indicators associated with dif- four BSC perspectives. This will show a BSC to be taken and indicating where shortcom·
ferent levels are evaluated and compared of maintenance that has been properly com~ ings still exist. The chronology of accomplish
with the corresponding benchmarks to de- pleted, so that users will be able to mon- ment of the audit marks forms an evolution
tect potential deviations. Once the audit itor success in terms of strategies and ob- ary pyramid; for this reason, the errors indi
progress reaches the top of the pyramid, au- jectives. cated on upper levels will have their causes
ditors have information about the real ma- Therefore, a double set of information is in lower levels. The analysis of the problems
turity of the organization and can formulate obtained from this audit, as seen in FIGURE 11 . indicated by indicators or surveys will there
suggestions for improvement corresponding First, we learn the state of maturity in the ev- fore be easily processed.
to the maturity levels. olution of maintenance; this operating infor- The second obtained result is the BSC it
Once the real maturity level is identified, mation is crucial if we wish to develop and self, when the measurements realized in the
problems are identified, and improvements use more complex methodologies to attain pyramidal process are transferred back to it

38 MAINTWORLD 3.2011
More specifically, it integrates the
following:

'\o----s·t·,,~'o~
• It connects qualitative aspects of
Productlon & ,...--..... surveys, climate perceptions and at-
maintenance IntegratIon q ... titudes and also includes quantifia-
Level 2 ~ 10.-_..1 ble indicators of diverse natures and
Warehouse CMMS work order State of maturity of the level objectives.
Human factor
• evel I
• It considers maintenance at different
~_ _ _-"P~
rev
~en~t~"C ~a~ln~t~
ena "-_ _ _-a
~n~ce vertical organizational levels, look-
ing at the indicators on each level to

Cre~r«»of

the,onttol
-- fill out the overa ll audit scorecard.
It defines the proprietor of the indi-
cator, who contributes the informa-
ti on, who calculates it and who uses
it in for decision making.
• It proposes a structured process to
obtain the results most common-
FIGURE 10. Partial and final results on the state of maturity o(che maintenance in the ly demanded by users. It takes in -
organization. to account the target organization
and the time when data are collect-
ed and audits are performed to get a
clear picture of the progress in goal
achievement.
An advantage of the system is its ability to
Reference points determine the current maturity level of each
level in the maintenance pyramid. The audit
Chcnt F,"~nC'il
p~rspcctlVt' pcr'pCH'VC
can be stopped at any p oint if there is toO
great a discrepancy between benchmarked
In[crnJI lc~rn,"gand
measurements and the audit's findings. The
process Rrow[h combination of data collection (qualitative
pcrspecuvc perspecllve
Measured and quantitative) ensures valid r esults.

t
mdlcators Finally, the audit is based on a set of indi-
State of mawrtty cators, hierarchized and organized, accord-
of the different levels
ing to the four perspectives of the BSC. Once
the audit is performed and the indica tors are
relocated in the BSC, the degree of develop-
ment and the satisfaction of each stakehold-
er are reliably measured. _
Recommendations
of Improvement
» WHO are the authors?
FIGURE 11. Movement of indicators to the BSC. Dr. Uday Kumar obtained his B. Tech from
India during the year 1979. After working for
The indicators associated with maturity lev- ment, mainly with respect to the directi on 6 years in Indian min ing industries, he ob-
els will offer a clear picture of the fou r per- of maintenance; and finall y, the learning and tained a PhD degree in t he field of Reliabili-
spectives of the BSC. This will prove use- growth perspective will show how the human ty and Maintenance in 1990. He then worked
ful for the organization, especially with re- factor is handled in the organization. as a Senior Lecturer and Associate Professor
spect to the efficiency and effectiveness of at LuteA Un iversity from 1990 to 1996. In 1997,
the maintenance department. Conclusions he was appointed as a Professor of Mechan-
In FI GURE 11 , one can observe how the The proposed model is a multidimension- ical Engineering (Maintenance) at the Uni-
transferred indicators fill up the scorecard's al integration of a series of uncontrolled as- versity of Stavanger, Norway. Presently, he
perspectives: the client's perspective will be pects in the maintenance function, over time is Professor of Operation and Maintenance
especially relevant for production; the finan - and in an isolated form. The proposed mod- Engineering at Lulea University of Tech nolo-
cial perspective will show the accuracy of the el includes methodological or technological gy, Sweden. He has published more than 170
budget; the internal processes perspective will tools proven successful elsewhere but not papers in International Journals and Confer-
show the internal efficiency of the depart- generally used in the management of assets. ence Proceed ings. »»
MAINTWORLD 3 -10 1 1 39
Dr. Diego Galar has an Msc in Te l ecom~ rials Engineering from LTU; and an Msc in En ~ maintenance. Industrial Press (First edition):
munications and a PhD degree in M anufactur~ gineering Mechanics from the University of New York. USA
ing from the University of Saragossa. He has Nebraska - Lincoln. At present, Christer is a ) 6. Kaplan, R.S. and Norton, D.P. (1996),
been Professor in several universities indud~ researcher at the Division of Operation and Using the balanced scorecard as a strategic
ing the University of Saragossa or the Euro~ Maintenance Engineering at LTU in Mainte~ management system, Harvard Business
pean University of Madrid, researche r in the nance Performance Measurement in the rail~ Review, January-February, pp. 75~84.
department of design and manufacturing en ~ way industry. ) J. Wardehoff, E.C. (1992). journey to World-
gineering from the University of Saragossa, Class Levels of Excellence: A Multi-Stage
researcher in 13A, institute for engineering re~ » 8IBlIOGRAPHY Process. Plant Engineering, VoL46, nO.18,
search in Aragon, director of academ ic i nno~ ) 1. COVENI M 2500-93. Manual para evaluar November 19, P194
vation and subsequently pro~vice-chancellor. los sistemas de mantenimiento en la ) 8. Zahra Mohaghegh, Reza Kazemi
In industry, he has also been technical direc- industria. 1& Revision. Comisi6n Venezolana & A li Mosleh. (2008). Incorporating
tor and CBM manager. He is senior research ~ de Normas Industriales. Ministerio de organizational factors into Probabilistic
er in LTU LuteA University of Technology. fomento. 1993- FONDONORMA: Caracas Risk Assessment (PRA) of complex socio-
Dr Aditya Parida is an Associate Profes~ ) 2. UNE-EN 15341:2008 Mantenimiento. technical systems: A hybrid technique
sor in Operation and Maintenance Engineer- Indicadores dave de rendimiento del formalization Reliability Engineering &
ing of LuleA University of Technology. He mantenimiento. AENOR: Madrid System Safety Volume 94, Issue 1, January
obtained his PhD in Operation and Mainte~ ) 3- Sorensen, J.N. (2002). Safety culture: a 2009, Pages 97-110
nance Engineering. With more than three survey of the state ~of~the~art. Re liability ) 9. Wani, M. F. & Gandhi, O. P. (1999).
decades experience in maintenance engi- Engineering & System Safety, Volume 76, Development of maintainability index for
neering and management from the Indian Ar- Issue 2, May 2002, Pages 189~204 mechanical systems. Reliability Engineering
my and in multinational firms, his present ar~ >4. Martore ll, S., Sanchez, A, MuRoz, A, & System Safety 65, pp. 259-270.
ea of research is asset and maintenance per- Pitarcha, j.L., Serradella, V. & Roldanb j. ) 10. De Lemos, L. (2003). Metodologia

forman ce measurement, RCM and eMa in~ (1999). The use of maintenance indicators general para auditar programas de
tenance. Besides teaching, he is actively to evaluate the effects of maintenance mantenimiento. III congreso bolivariano de
involved in research projects. And has more programs on NPP performance and safety. Ingen ie ria Mecanica. Lima, Peru.
than 52 publications to his credit. Reliability Engineering & System Safety, Vol: ) 11. Campbell, j.D. (1999). Uptime:
Christer Stenstrom has an MSc in En~ 65, Issue: 2, pp 85-94 Strategies for Excellence in Maintenance
gineering Physics from LuleA University of ) 5. W ireman, T. (1998). Developing Management. Productivity Press, Portland,
Technology (LTU), Sweden; an Msc in Mate- performance indicators for managing pp.10-20, '58-,64.

• NEWS
Briiel & Kj:er Teams Up With Instantel fer Censtru~tion Neise and Vibration Se ~vices

» LARGE infrastructure con- the world and is pleased to an- struction Industry that will help worldwide with high -quality
struction projects take several nounce a partnership with Inst- to reduce impact on communi ~ instrumentation and we are
years to complete and are of~ antel to add vibration monitor- ties, demonstrate compliance very pleased to be associated
ten located within built-up ar~ ing to its Noise Sentinel man ~ with regulations and manage w~h them."
eas. This can give rise to signif- aged services. project risk."
icant noise and vibration nui~ "We've chosen to part- About the
sance which, if left unmanaged. ner with Instantel as they have partnership,
can lead to project delays and field-proven instrumentation Rcn Mask.
..
InstrumentatJon~
significantly increased costs.
Importantly, excessive vibra-
that we can integrate with our
established noise mon itOring
Sales Manag-
er for Instan~ cS 61J
tion from pi le driving and
other construction activities
technology to target solutions
at the Construction indus-
tel said, "We're
obviously de- I~
can lead to damage to near ~ try," said Phi! Stollery, Product lighted that
by property and potential lit- Marketing Manager for Bruel Bruel & Kj<er
igation. & Kjcer Environment Manage- has chosen In-
Bruel & Kjcer has been ac- ment Solutions. "Simultane- stantel and the
tive for many years providing ous noise and vibration mon- I Minimate PR04.
noise monitoring solutions to itoring will enable us to del iv~ I Bruel & KJcer is
manage nOise nuisance around er unique solutions to the Con~ synonymous

40 MAINTWORLD 3' 2011

Das könnte Ihnen auch gefallen