Sie sind auf Seite 1von 10

Risk Analysis, Vol. 32, No. 10, 2012 DOI: 10.1111/j.1539-6924.2012.01798.

Perspective

Foundational Issues in Risk Assessment


and Risk Management

Terje Aven

In spite of the maturity reached by many of the methods used in risk assessment and risk man-
agement, broad consensus has not been established on fundamental concepts and principles.
The risk fields still suffer from a lack of clarity on many key scientific pillars. The purpose
of this article is to point to this situation and through some illustrating examples discuss the
challenges that the fields here face. Moreover, the purpose of the article is to reflect on how
to improve the present situation and enhance the risk fields. We argue that the establishment
of some common scientific pillars as well as a strong and continuous research focus on foun-
dational issues are critical success factors. The article specifically addresses the role of the
peer-reviewed journals and the international standards in the fields. We hope that the article
can contribute to a revitalization of the discussion of foundational issues in risk assessment
and risk management.

KEY WORDS: Foundational issues; principles; risk terminology

1. INTRODUCTION how risk is best described.(3,4) It seems that the scien-


tific platforms of the fields are rather shaky.
Risk assessment and management are today in
The purpose of this article is to review and dis-
many respects acknowledged as scientific disciplines
cuss this situation (Section 2) and present some sug-
per se: there are many master and Ph.D. programs
gestions for how to improve it (Section 3). Focus will
worldwide covering the fields, as well as a consider-
be on some rather general issues, in particular, termi-
able number of scientific journals and conferences.
nology and the need for establishing some common
There is also an enormous drive and enthusiasm to
scientific pillars for the risk fields. The part on im-
implement risk management principles and methods
provement measures specifically addresses the role
in organizations, and international standards such as
of the peer-reviewed journals and the international
ISO 31000(1) and the COSO(2) provide guidance on
standards in the field. How can the scientific jour-
the way to proceed.
nals contribute to strengthening the scientific basis
At the same time, any observer of the fields of
of the risk fields? Frequently, we see that the sci-
risk assessment and risk management cannot avoid
entific journals accept papers based on perspectives
noticing that there are a number of diverging ideas
for which the arguments against are massive. Is the
and conceptions of risk out there. Many of these are
reviewing process poor or does the paper screening
related to the foundation of the fields and the use of
process simply reflect that there are many views on
risk assessments, for example, what risk means and
what is a suitable perspective?
Several international standards and guidelines
exist for providing a common understanding of
University of Stavanger, Center of Risk Management and Soci- risk management concepts, principles, and methods.
etal Safety, Stavanger, Norway; terje.aven@uis.no. However, these standards and guidelines have not

1647 0272-4332/12/0100-1647$22.00/1 
C 2012 Society for Risk Analysis
1648 Aven

been successful in establishing this common under- ment, risk characterization, risk communication, risk
standing. Why is this so? Can measures be taken to management, and policy relating to risk, in the con-
strengthen the ability of the standards to obtain more text of risks of concern to individuals, to public and
authoritative definitions? private sector organizations, and to society at a local,
Section 4 provides some overall conclusions and regional, national, or global level.
recommendations from the discussion. However, to many, risk analysis is a part of risk
assessment; see, for example, ISO,(1,6) which states
that risk analysis is the process to comprehend the
2. AN EVALUATION OF THE STATUS OF
nature of risk and to determine the level of risk, that
THE SCIENTIFIC FOUNDATION OF THE
is, a completely different understanding of this term
FIELDS OF RISK ASSESSMENT AND
compared to the SRA definition. It is obviously a
RISK MANAGEMENT
very unfortunate situationa source for misunder-
In this section we will provide a review and dis- standings and confusion. There are many other defi-
cussion of the scientific foundation of the fields of risk nitions of the term risk analysis,(7) for example, the
assessment and risk management, with a focus on ter- one being used by this journal:(8) risk analysis is the
minology and basic principles. science of evaluating health, environmental, and en-
gineering risks resulting from past, current, or antici-
pated future activities.
2.1. Terminology
There are historical reasons for the SRAs use of
Many attempts have been made to establish the term risk analysis but it is not difficult to pro-
broadly accepted definitions of key terms for the vide arguments against it: look at any dictionary and
fields of risk assessment and risk management, for see how the term analysis is defined. There is no
example, related to the general concepts of risk and support for this broad SRA definition of risk analysis:
risk analysis. To turn these fields into recognizable analysis is not about management and communica-
disciplines and professions, many scholars and insti- tion. Following this way of thinking, an understand-
tutions have devoted considerable time and effort to ing in line with the one used by ISO(1,6) is more rea-
bringing definitions and some sort of unity to the sonable. Note that according to ISO,(1,6) risk analysis
fields.(5) Their work has been based on the com- does not include source (hazard/threat/opportunity)
mon conviction that a scientific field or discipline identification as a part of risk analysis. Many authors
relies on well-defined and universally understood prefer to include this element in their definitions of
terms. risk analysis/assessment.(9,10)
Thompson et al.(5) give an overview of some of Today, there exists a vast number of definitions
the initiatives taken in this regard by the Society of of risk and risk-related concepts.(7,11) The situation
Risk Analysis (SRA) from its development in 1980 is rather chaotic. Organizations like the SRA have
until 2005. The first attempt occurred soon after the neither been able to establish consensus on key con-
founding of the SRA, but the group involved found cepts, nor have the standard organizations. Several
difficulty in reaching consensus and abandoned its ef- initiatives have been taken recently from the stan-
forts. The work was followed up in the mid 1980s dard organizations but instead of bringing clarity to
with the establishment of a special committee, but a the field, they have introduced new problems and
few years later this committee had to conclude that confusion. Take, for example, the recent ISO stan-
it found it impossible to reach consensus on terms dard on risk management,(1,6) which defines risk as
such as hazard, risk, risk analysis, risk assess- the effect of uncertainty on objectives. But what does
ment, and risk characterization. this mean? Risk has to do with uncertainty, but is it
The SRA later defined risk analysis officially the effect of uncertainty? And risk is related to objec-
in its vision statement and, with the launch of its tives, but what if objectives are not defined? Then we
website, it posted a glossary that provided a list of have no risk? Asking experts on risk, it is no doubt
definitions based on the work of a Definitions Com- that this definition would lead to numerous differ-
mittee along with a disclaimer about the SRA never ent interpretations. The definition per se is not suf-
officially adopting and not necessarily endorsing the ficiently precise, and one may certainly also ques-
terms.(5) According to this vision statement, risk tion its rationale as indicated. Detailed studies(12,13)
analysis is broadly defined to include risk assess- have shown that the standard fails in several ways in
Perspective 1649

producing consistent and meaningful definitions of 2.2. Risk Assessment and Risk
many of the key concepts covered. Management Principles
The chaotic situation on terminology will be fur-
International standards could be seen as a tool
ther illustrated by two examples.
for obtaining consensus on what are good concepts,
principles, and methods. In Ale et al.(22) a set of stan-
2.1.1. Risk Defined as an Expected Value dards on risk management were reviewed, includ-
ing the AS/NZS 4360 Risk Management Standard(23)
It is common to define and express risk by the and the COSO Enterprise Risk Management Frame-
expected value.(3,1416) But such a perspective can work.(2) Ale et al.(22) conclude that these standards
be challenged, as emphasized by many analysts and are broadly similar when it comes to basic underly-
researchers:(3,17) Two probability distributions may ing ideas. Considerable agreement exists on the steps
have the same expected values, one with mass cen- needed for proper risk management: from the defini-
tered around its expected value, the other having tion of critical functions to risk assessment and risk
high probabilities for severe outcomes, and clearly control.
the risk management should be different. For the The standards on risk management (see e.g.,
latter probability distribution, cautionary measures ISO(1) ) also address the need for defining principles
like emergency preparedness are normally required for managing risk. These are related to aspects like
to meet a possible severe outcome if it should in fact transparency, the need for seeing the risk manage-
occur. From this line of argument we have to con- ment in a broader context of value creation and de-
clude that expected values (loss) cannot be adopted cision making. There is broad agreement on such is-
as a general definition of risk, but of course it can be sues. However, there is not a requirement related to
used as a risk index or metric, and depending on the fundamental scientific principles for risk assessment
situation it can be more or less informative and useful and risk management, although these are critical for
as such. the adequate understanding and use of the standards.
Examples of such principles and issues are (i) the
use of expected values in risk management, (ii) the
2.1.2. Risk Is Restricted to the Case of
precautionary principle, and (iii) how to represent
Objective Distributions
and deal with uncertainties in risk assessments. For
In economic applications it is common to dis- many of these principles and issues there are diverg-
tinguish between risk and uncertainty based on the ing views on their meaning/importance/solution. The
availability of information. In the case of risk, the terminology problems pointed to in the previous sec-
probability distribution of the quantities studied can tion can often be traced back to disputes about such
be assigned objectively, whereas in the case of un- principles and issues.
certainty these probabilities must be assigned or esti- The risk = expected value definition discussed
mated on a subjective basis.(18) This definition, which in the previous section is a good illustration. The in-
goes back to Knight,(19) is often referred to in the lit- teresting issue from a risk management point of view
erature(3) but it is not compatible with most uses of is to what extent an expected value provides ade-
the word risk in society today. quate decision support in a practical situation (not
Economists and others have for a long time the definition of risk per se). As commented in Sec-
struggled to interpret Knights work from 1921.(20,21) tion 2.1, expected values are often used in risk man-
A number of interpretations of Knights work have agement to guide the decisionmakers, although there
been presented and discussed. Why are we doing are strong arguments against this practice. One can
this? It is clear that if we refer to the former situa- compute an expected number of fatalities in relation
tion as risk and the latter as uncertainty would to terrorist attacks but as discussed in Section 2.1
mean that we exclude the risk concept from most sit- management could be seriously misguided by using
uations of interest, as objective distributions are rare this value as a basis for the decision making.(24) See
in practice. If we adopt the subjective/Bayesian per- Section 3.2 for some references that present alterna-
spective on probability, Knights definition of risk be- tives to the expected value-based approach.
comes empty.(3) The definition of the precautionary principle is
Given all this, we unfortunately have to conclude another illustration of the link between chaos in ter-
that the risk fields still lack a proper terminology. minology and strong disagreement on fundamental
1650 Aven

principles and issues in risk management. There ex- ing and describing uncertainties and risk have been
ists a number of different definitions of this princi- suggested, including imprecise probabilities, random
ple(25,26) (in particular related to the term scientific sets, and possibility theory.(30,31) Work has also
uncertainties) and it is fact that few policies for risk been carried out to combine different approaches,
management have created more controversy than the for example, probabilistic analysis and possibility
precautionary principle. Many researchers and ana- theory.(30,32,33)
lysts are skeptical of the precautionary principle as All these theories produce epistemic-based un-
it is not consistent with rational theories and tools certainty descriptions and in particular intervals. Al-
such as the expected utility theory and cost-benefit though much effort has been made in this area, still
analyses, whereas others acknowledge the need for many questions are open related to the foundation
the principle to give proper weight to uncertainties of these approaches and their use in risk and uncer-
when making decisions under uncertainty.(3) tainty decision making.(3438) Many risk researchers
Then we come to the final example, the treat- and risk analysts are skeptical of the use of the alter-
ment of uncertainties in risk assessments. Traditional native approaches (such as those mentioned earlier)
statistical analyses based on frequentist probabilities for the representation and treatment of uncertainty
and confidence intervals to describe variation have in risk assessment for decision making, and some also
been the basis for a large proportion of the risk as- argue intensively against them.(38)
sessments carried out since the early days of the risk However, others consider such a perspective as
field. However, in the 1980s and 1990s quantified too restrictive(30) and also welcome research direc-
risk assessment (QRA, or probabilistic risk assess- tions outside the traditional probabilistic framework.
ment (PRA)) for complex systems and rare events This discussion is related to the issue of risk as-
was rapidly developing and, to analyze and treat un- sessment being a scientific methoda topic discussed
certainties of these systems and events, the Bayesian as early as in 1981 by Cumming and Weinberg in
framework became the preferred framework, in par- the editorials of the first issue of the journal Risk
ticular in the nuclear industry.(27) Analysis,(39,40) in relation to the establishment of the
However, the probability-based approaches to SRA. Both editorials conclude that risk assessment
risk and uncertainty analysis can be challenged. comprises scientific elements but is not a scientific
Many researchers and analysts find these approaches method per se, as accurate risk estimation and pre-
for assessing risk and uncertainties to be too nar- dictions cannot be obtained in case of large uncer-
row.(4,28,29) Stirling(29) makes his point clear when tainties. Their reference is obviously the traditional
stating that using risk assessment when strong knowl- scientific method, which is the pillar for the natu-
edge about the probabilities and outcomes does ral sciences. The method is based on the collection of
not exist, is irrational, unscientific, and potentially data through observation and experimentation, and
misleading. the formulation and testing of hypotheses. These re-
The critique is partly motivated by the (lack of) flections are about 30 years old, but they are still rel-
ability of probabilities to represent or express un- evant. Risk assessment fails in general as a scientific
certainties and risk: the risk related to an activity method if the traditional scientific method is the ref-
is more than variations and some analysts subjec- erence.(41) However, risk assessment is also seen as a
tive probabilities, which may be based on a more or tool for representing/expressing the knowledge and
less strong background knowledge and lead to poor lack of knowledge available(42,43) (for short we just
predictions of the quantities addressed in the refer to this aim as uncertainty representations). In
study.(30) The fundamental argument used is that the the latter case, the traditional scientific method is ob-
information commonly available in the practice of viously not applicable.
risk-uncertainty decision making does not provide a If the main task of the risk assessment is un-
sufficiently strong basis for a specific probability as- certainty representations, we need a measure of un-
signment. In addition, in a risk assessment context certainty. Most risk analysts consider probability to
there are often many stakeholders, and they may be the appropriate tool to represent or express such
not be satisfied with a probability-based assessment uncertainties, but as discussed earlier there are dif-
expressing the subjective judgments of the analysis ferent views, and many alternative approaches have
group: a broader risk description is sought.(30) been suggested. An interesting question is to what
Based on the above critiques, it is not sur- extent risk assessment can be viewed as scientific
prising that alternative approaches for represent- when uncertainty representation is the aim. A way of
Perspective 1651

analyzing this issue is to use the scientific criteria terms risk analysis and risk assessment. These
of reliability and validity, where the former require- terms may either refer to a specific study to be car-
ment relates to the extent to which the risk assess- ried out, or to the scientific field (discipline) with this
ment yields the same results when repeating the anal- name. In the former case we can discuss the issue of
ysis, and the latter requirement refers to the degree this study being a scientific method, as addressed in
to which the risk assessment describes the specific Sections 1 and 2. In the latter case, we are concerned
concepts that one is attempting to describe.(41,44) A about the development of concepts, principles, meth-
detailed discussion of this issue is, however, beyond ods, and models to analyze (assess) risk, and the use
the scope of this article, but the topic is important as of these in practical contexts.(41,45)
it is linked to the ability of probabilities to represent Cumming and Weinberg concluded that risk as-
or describe the uncertainties. sessment (QRA) is not in general a scientific method
These and other examples(3) demonstrate that per se, when the reference is the traditional scien-
there are diverging views and perspectives on fun- tific method (accurate estimations and predictions).
damental principles of risk assessment and manage- However, as discussed in Section 2.2, a risk assess-
ment. For the purpose of this article the examples ment is also a tool used to represent and describe un-
presented are sufficient for showing that the risk certainties, and then other criteria need to be used
fields struggle with obtaining some proper scientific to evaluate whether the assessment is a scientific
pillars on important issues. method, as was commented on in Section 2.2 when
referring to the reliability and validity criteria. A risk
assessment may, to varying degrees, meet the scien-
3. HOW TO IMPROVE THE PRESENT tific requirements for this purpose, and considerable
SITUATION? research is conducted to fill the gaps.(41)
The previous section has pointed to some severe This fact, that risk assessment struggles to be
problems in the scientific platforms for the fields of accepted as a scientific method, does not, however,
risk assessment and risk management. In this section have anything to do with the question whether risk
we will discuss how these problems can be rectified. assessment or risk analysis is a scientific field or disci-
We will discuss the following issues: pline. There should, according to the author of this
article, be no doubt that risk assessment (analysis,
(1) The need for being precise on the difference management) is actually a scientific field and even a
between the scientific method of risk assess- discipline. The many (highly ranked) scientific jour-
ment/analysis and the (scientific) field of risk nals and the many study programs at our univer-
assessment (analysis). sities specifically devoted to these areas justify this
(2) The need for distinguishing between the con- view. The areas face some serious foundational chal-
cept of risk and how it is described or lenges, as discussed in Section 2, for example, related
measured. to a lack of unity on terminology, but this does not
(3) The need for establishing some common sci- change the conclusion that risk assessment (risk anal-
entific pillars for the risk fields. ysis, risk management) is a scientific field/discipline;
(4) The need for more focus on foundational it is, for example, based on the same type of universal
issues. scientific criteria as other fields/disciplines for the
(5) The need for improving the reviewing judgment of the quality of its scientific publications.
processes for publication in scientific risk
journals.
(6) The need for a change in the way the interna- 3.2. The Need for Distinguishing Between the
tional standard organizations work. Concept of Risk and How It Is Described
or Measured
As pointed to in Section 2, there are many di-
3.1. The Need for Being Precise on the Difference
verging views on how to understand the risk concept.
Between the Scientific Method of Risk
The author of this article believes that clarifications
Assessment/Analysis and the (Scientific) Field
and a logic structure for defining risk require that we
of Risk Assessment (Analysis)
distinguish between the concept of risk and how it
The confusion concerning risk terminology has is described or measured. As an analogy, consider
many reasons; one of these is the double use of the the concept distance. We can formulate a general
1652 Aven

qualitative definition of this concept but there are as recognized as useful tools for understanding phe-
we know many different ways of measuring distance. nomena and describing risk, but due attention also
By such a dichotomy we can avoid risk being has to be placed on the boundaries and limitations
identified by, for example, an expected value. An of these methods. A key point is the problem of ad-
expected value can be an informative risk metric in equately representing and characterizing the uncer-
some cases, but cannot serve as a general definition tainties, as discussed in Section 2.2.
of risk. The dichotomy stimulates a continuous focus The risk-basedrisk-informed issue is of course
on the suitability of the tool used in measuring the also about other matters, in particular the risk man-
concept we study. agers and the risk analysts mindset concerning the
Based on such ideas a general conceptual risk use of risk assessments in the decision-making pro-
framework can be established.(41,43,46,47) A key point cess, as was clearly formulated by one of the review-
is that risk captures consequences of an activity as ers of an earlier version of this article.
well as uncertainties (we do not know what the con- Too many risk managers want to be absolved of
sequences will be), and risk description or measure- the responsibility for having to make decisionsthey
ments specify a set of consequences and use a mea- want a risk-based approach in which their actions
sure of uncertainty. The background knowledge that are dictated by risk assessments. Then, if their actions
this measure of uncertainty is based on also needs turn out to be wrong (poor), they can claim absolu-
to be included in this description. For a summary of tion on the basis that We did what the numbers told
arguments why it is necessary to see beyond prob- us to do. If the numbers were wrong, its the analysts
ability to represent/express the uncertainties, see fault. Risk analysts, for their part, too often lack suf-
Aven.(47) ficient analytic humility and fall into the trap of trying
The point made here is of theoretical impor- to give answers with far greater certainty than can be
tance, but it also has implications for risk manage- justified.
ment and decision making. The above perspective Adopting a risk perspective, as outlined earlier,
on risk is consistent with the view that decision such a mindset may not disappear, but it would be
making under risk and uncertainties should be risk- more difficult to adopt as there would be no justifica-
informed, not risk-based. The risk numbers do not tion for it in the way risk is understood.
prescribe what to do, how to treat risk. This view
is supported by many analysts and researchers in
3.3. The Need for Establishing Some Common
the risk fields.(28,42) Yet risk assessment consultants
Scientific Pillars for the Risk Field
and the formal decision making on the regulation of
risk remain relatively unaffected by this recognition The lack of consensus on basic terminology and
(Stirling,(48) p. 100). The risk-based approach is com- principles is an unacceptable situation. The situa-
mon in practice, and the literature includes a vast tion is chaotic and leads to poor communication. It
number of theories and methods, as well as applica- also hampers effective risk management as well as
tions based on this thinking. An example is the use of the development of the risk field, as many of these
risk acceptance criteria where an activity is consid- definitions and interpretations lack proper scientific
ered unacceptable if the accident probability exceeds support and justification, as illustrated by, for exam-
a predefined level.(49) ple, the use of the risk = expected value thesis in
This practice is linked to the understanding of Section 2.2.
the concept of risk. Following an approach where risk Of course, business needs a different set of risk
is identified with, for example, a probability or an ex- methods and models than, for example, medicine and
pected value, it is not a long step to risk-based think- engineering. There is, however, no reason why these
ing. On the other hand, if a perspective as outlined areas should have completely different perspectives
earlier is adopted where we distinguish clearly be- on how to think when studying risk and uncertainty,
tween the concept of risk and how it is described or when the basic challenge is the sameto conceptu-
measured, there are reasons to believe that a more alize that the performance of a system or an activ-
humble attitude toward knowing the truth about risk ity could lead to consequences (outcomes) different
will emerge. The risk-informed thinking becomes a from those desired and planned, or not in line with
part of the conceptual framework, which should in- stated objectives.
crease the likelihood for proper implementation in Establishing some basic pillars for the risk field
practice. Following this view QRA/PRA methods are means to agree on some fundamental terminology
Perspective 1653

and principles, as well as pointing to misconceptions. that it must be given a relative frequency interpreta-
This should, however, not in any way be seen as a tion;(50,51) we need to construct an infinite large popu-
way of limiting critical analysis and research. On the lation of thought-constructed repeated experiments,
contrary, identifying the proper pillars requires anal- similar to the one studied. This is, however, impossi-
ysis and research, and the debate should not cease ble to doa frequentist probability of an attack has
even though some form of consensus is achieved. We no meaning.(26)
know from the history that what has been seen as a From a statistical point of view we may be con-
truth for a long time can later be questioned and then cerned about the estimation procedures of p, but
rejected. from a risk assessment and risk management per-
The author of this article (encouraged by a re- spective we need to see beyond this: Is the concept
viewer of an earlier version of this article) suggests we study well defined and an adequate index for the
that a new initiative is taken by the SRA to convene purpose of the assessment and decision problem at
a senior expert group to tackle the definitional and hand? These questions are the interesting ones seen
other fundamental issues head-on. Such an author- from a risk assessment and risk management per-
itative panel that provided an imprimatur could re- spective, but are not so interesting from a purely sta-
vitalize the debate on key issues and hopefully con- tistical point of view.
tribute to institutionalizing improved thinking. His- Special journal issues on foundation topics are a
tory shows that it is difficult to obtain consensus, but means to obtaining increased focus on scientific pil-
previous attempts go many years back. Now the fields lars of the risk field/disciplines. And from time to
of risk assessment and risk management are more time such issues have been published; see, for exam-
mature, and new insights have been obtained con- ple, the special issues of Reliability Engineering and
cerning the pros and cons of different definitions and System Safety.(52,53) However, the intensity and ex-
perspectives. Also, new conceptual frameworks have tensions of such issues are rather limited. More ini-
been established, such as the one outlined in Sec- tiatives should be taken, in particular by the journal
tion 3.2. A new generation of risk researchers has editors, but also by leading scientists, to encourage
entered the scene and they may have a different the development of such issues, where in-depth dis-
attitude to some of the problems raised some 20 cussions are provided on fundamental topics in risk
30 years ago. assessment and risk management.
Initiatives such as the one indicated in the previ-
ous section (the panel of experts) do not replace the
3.4. The Need for More General Focus
need for further papers and research on fundamen-
on Foundational Issues
tal issues. For such a panel to be able to succeed it
Most papers published in the field of risk as- must be supported by a sufficiently mature research
sessment and management are method and proce- community and this can only be achieved if funda-
dure oriented. Foundation and reliability and va- mental issues have been thoroughly discussed in the
lidity issues are not focused on very much. Look, scientific literature.
for example, at recent issues of the most recog-
nized journals in the risk field. Very few articles
3.5. The Need for Improving the Reviewing
are addressing general foundational issues. The typ-
Processes for Publication in Scientific
ical paper presents a new method for solving a
Risk Journals
specific problem or provides insight to a specific
problem. There is of course nothing wrong with such The normal procedure for reviewing a paper is
papers, but we also need papers of more fundamen- that two or three experts give their independent eval-
tal character, where the frameworks and concepts uation of the paper submitted as a basis for the
adopted are being scrutinized. How often do we see editor to conclude on acceptance, revision, or rejec-
such papers? Not often. For example, probabilities tion. The reviewers for a risk assessment and/or risk
are often introduced without explaining their mean- management paper often have different backgrounds
ing. Consider, for instance, the terrorism risk case. A and scientific competences. Some are, for example,
probability p of an attack is defined and the issue of experts in statistical methods, some in risk-related
estimation is considered. However, this means that topics directed at specific applications, and others
a certain framework is tacitly understood, namely, in social sciences. If a statistical or method-oriented
that p has a true value and in practice this means paper is submitted, the justification of a thesis like
1654 Aven

risk = expected values is not given much atten- in the community (communities). These processes
tion. A statistician reviewing the paper may not be would also stimulate the focus on foundational is-
aware that this thesis is problematic, as his or her sues, which is important in itself, as discussed earlier.
competence is more in probabilistic and statistical One of the reviewers of an earlier version of this
procedures and methods, and not so much in risk article indicated some other potential measures re-
management principles. In the case of a more applied lated to the reviewing process: putting reviews online
work, the reviewers may focus most on the practical and allowing for informal reviews to expand online
aspects and implications of a proposed method, and after publication, as well as identifying the expertise
pay less attention to the fundamental issues. The fact of the reviewers of the article so that the readers will
that risk assessment and risk management are based know which aspects of the article have in fact been
on many other scientific disciplines makes this point examined.
especially relevant. The reviewers may only be ex-
perts in some of the areas covered by the paper be-
3.6. The Need for a Change in the Way the
ing reviewed. This makes it particularly difficult to
International Standard Organizations Work
review papers in this field. Another challenge is re-
lated to the necessity of seeing the assessment in a It is not difficult to point to many examples
broader decision-making context: a perfect analy- where the international standards and guidelines fail
sis may not meet the risk managers information and in providing consistent and meaningful definitions of
decision-support needs. Not so many reviewers are key concepts. We refer to Section 2 where the use
able to evaluate the papers from such a perspective. of standards was briefly discussed, and reference was
Some reviewers, in particular social scientists, made to the review by Ale et al.(22) According to this
may also be reluctant to disregard a specific risk per- review, all the studied risk frameworks are based on a
spective. The attitude is that we should allow for likelihood and consequence description of risk, that
many types of risk perspectives: one should avoid is, all acknowledge the need for seeing beyond ex-
saying that a perspective is not appropriate. pected values in risk management. Hence, we can
Given these challenges, what can we then do for conclude that the risk = expected values thesis is
improving the reviewing process? rejected by these standards. Given this fact, it is even
The selection of reviewers is essential for en- more surprising that we see the risk = expected val-
suring the scientific quality of the papers. At mini- ues thesis still being adopted by so many researchers
mum, one reviewer should have broad competence and analysts today. A full clarification of the proba-
in the risk assessment/management fieldsome may bilistic framework is, however, not obtained as the
have specialized competence, but the main reviewers standards are not precise on the meaning of proba-
should be experts in risk assessment/management. bilities and uncertainties.
Broad competence would mean, for example, that One may question the processes that are in-
the reviewers have an understanding of, for example, volved in the development of such standards when
common risk perspectives, including Knights think- looking at the ISO(1,6) definition of risk: risk is
ing, Bayesian ideas, etc. Seeing this field (these fields) the effect of uncertainty on objectives, discussed in
as a scientific discipline (scientific disciplines) per se, Section 2.1. These processes are obviously difficult
some basic pillars for the discipline(s) should be iden- as there are many different views and perspectives
tified. What is suggested is that the journals in the out there. Seeing suggestions like the one mentioned
field develop documents summarizing their scientific above (the ISO definition of risk), one may question
basis, and use these documents as guidelines for all the judgments made by the standardization commit-
reviewers and editors. It is expected that the con- tee. One may also question why many of the worlds
tent of these documents would vary from journal to leading experts on risk are not involved in these pro-
journal, reflecting the different paradigms that the cesses. Attempts should be made to improve the links
journals support. Through the process of establish- between the scientific risk communities and organi-
ing such documents, we may obtain consensus on zations like ISO.
some issues and clarify those where there are dif- As pointed to by one of the reviewers of this
ferent views. There must of course always be room article, the existence of standard organizations may
for papers that challenge the accepted wisdom. To in fact represent a barrier for consensus building
develop the documents, the editors should initiate processes on terminology: the possibility of unify-
broad processes to ensure that the results are rooted ing different stands is reduced when a definition is
Perspective 1655

approved. Yes, this is true and underlines the impor- dards are in line with the best competence and
tance of having proper standardization processes. knowledge available.

4. CONCLUSIONS AND ACKNOWLEDGMENTS


RECOMMENDATIONS
The author is grateful to several anonymous re-
Here are some of the main conclusions and rec- viewers for their useful comments and suggestions to
ommendations made in the article: earlier versions of the article.

It is important to distinguish between the sci-


entific method of risk assessment and the (sci- REFERENCES
entific) field of risk assessment. 1. Risk Management: Principles and Guidelines, ISO 31000:
Risk assessment (QRA) is not in general a sci- 2009.
entific method per se, when the reference is the 2. Enterprise Risk Management Framework. Committee of
Sponsoring Organizations (COSO), 2004. Available at:
traditional scientific method (accurate esti- http://www.coso.org/guidance.htm, Accessed 18 February
mations and predictions). 2012.
If the aim of the risk assessment is to represent 3. Aven T. Misconceptions of Risk. Chichester, UK: Wiley,
2010.
and describe uncertainties, other criteria need 4. Aven T. Selective critique of risk assessments with recom-
to be used to evaluate whether the assessment mendations for improving methodology and practice. Relia-
is a scientific method. What criteria should ap- bility Engineering and System Safety, 2011; 96:509514.
5. Thompson KM, Deisler Jr. PH, Schwing RC. Interdisci-
ply and the degrees to which they are met, plinary vision: The first 25 years of the Society for Risk
are important topics being discussed in the Analysis (SRA), 19802005. Risk Analysis, 2005; 25:1333
literature. 1386.
6. Risk managementVocabulary. ISO Guide 73:2009.
Although facing some serious foundational 7. IRGC (International Risk Governance Council). Risk Gover-
challenges, risk assessment can be viewed as nance: Towards an Integrative Approach, White Paper No. 1,
a scientific field/discipline covering the devel- O. Renn with an Annex by P. Graham. Geneva, Switzerland:
IRGC, 2005.
opment of concepts, principles, methods, and 8. Risk Analysis: An International Journal Website, Aims
models to assess risk, and the use of these in and Scope. Available at: http://www.wiley.com/bw/aims.
practical contexts. asp?ref=02724332&site=1, Accessed 25 January 2012.
9. Modarres M, Kamiskiy M, Krivtsov V. Reliability Engineer-
The risk fields are characterized by a lack of ing and Risk Analysis. New York: Taylor & Francis, CRC
clarity on many concepts and principles. There Press, 1999.
is a strong need for establishing some common 10. Aven T. Risk Analysis. Chichester: Wiley, 2008.
11. Aven T, Renn O. On risk defined as an event where the out-
scientific pillars for the risk fields. come is uncertain. Journal of Risk Research, 2009; 12:111.
It is essential to distinguish between the con- 12. Leitch M. ISO 31000, 2009: The new international standard
cept of risk and how it is described or mea- on risk management. Risk Analysis, 2010; 30(6):887892.
13. Aven T. On the new ISO guide on risk management terminol-
sured. Risk as a concept should not be founded ogy. Reliability Engineering and System Safety, 2011; 96(7):
on one specific measurement tool. 719726.
The SRA should revitalize its work on founda- 14. Willis HH. Guiding resource allocations based on terrorism
risk. Risk Analysis, 2007; 27(3):597606.
tions and establish a group of experts to discuss 15. Lirer L, Petrosino P, Alberico I. Hazard assessment at vol-
and clarify issues related to fundamental defi- canic fields: The Campi Flegrei case history. Journal of Vol-
nitions and principles. canology and Geothermal Research, 2001; 112:5373.
16. Verma M, Verter V. Railroad transportation of dangerous
The leading journals in the risk fields should goods: Population exposure to airborne toxins. Computers &
encourage more contributions focusing on Operations Research, 2007; 34:12871303.
foundational issues to refute obvious unfortu- 17. Haimes YY. Risk Modelling, Assessment, and Management,
2nd ed. New York: Wiley, 2004.
nate conceptions. 18. Douglas EJ. Managerial Economics: Theory, Practice and
The journals should develop documents show- Problems, 2nd ed. New Jersey: Prentice Hall, 1983.
ing the scientific pillars of the fields to guide 19. Knight FH. Risk, Uncertainty and Profit. Washington, DC:
BeardBooks, 1921, Reprinted 2002.
reviewers and editors in the paper-reviewing 20. Langlois RN, Cosgel M. Frank Knight on risk, uncertainty,
processes. and the firm: A new interpretation. Economic Inquiry, 1993;
Experts in the risk fields should be more in- XXXI:456465.
21. Runde J. Clarifying Frank Knights discussion of the mean-
volved in standardization committees to en- ing of risk and uncertainty. Cambridge Journal of Economics,
sure that the directions supported by the stan- 1998; 22:539546.
1656 Aven

22. Ale B, Aven T, Jongejan RB. Review and discussion of ba- Dempster-Shafer Theory of Evidence. New York: Wiley,
sic concepts and principles in integrated risk management. 1994.
Pp. 421427 in Bris R, Soares SG, Martorell S (eds). Reliabil- 36. Lindley DV. The philosophy of statistics. Statistician, 2000;
ity, Risk and Safety, Theory and Applications. London: CRC 49(3):293337.
Press, Taylor & Francis Group; 2009. 37. Bernardo JM, Smith AFM. Bayesian Theory. Chichester, UK:
23. Risk Management Standard, AS/NZS 4360, 2004. Sydney: Wiley, 1994.
Standards Australia International Ltd.; Wellington, New 38. North W. Probability theory and consistent reasoning. Risk
Zealand: Standards New Zealand, 2004. Analysis, 2010, 30:377380.
24. Aven T, Renn O. The role of quantitative risk assessments for 39. Cumming RB. Is risk assessment a science? Risk Analysis,
characterizing risk and uncertainty and delineating appropri- 1981; 1:13.
ate risk management options, with special emphasis on terror- 40. Weinberg AM. Reflections on risk assessment. Risk Analysis,
ism risk. Risk Analysis, 2009; 29:587600. 1981; 1:57.
25. Sandin P. Dimensions of the precautionary principle. Human 41. Aven T. Quantitative Risk Assessment: The Scientific Plat-
and Ecological Risk Assessment, 1999; 5:889907. form. Cambridge: Cambridge University Press, 2011.
26. Aven T. On different types of uncertainties in the context of 42. Apostolakis GE. How useful is quantitative risk assessment?
the precautionary principle. Risk Analysis, 2011; 31(10):1515 Risk Analysis, 2004; 24:515520.
1525. With discussion 15381542. 43. Aven T. A new scientific framework for quantitative risk as-
27. Apostolakis G. The concept of probability in safety assess- sessments. International Journal of Business Continuity and
ments of technological systems. Science, 1990; 250:13591364. Risk Management, 2009; 1:6777.
28. Renn O. Three decades of risk research: Accomplishments 44. Aven T, Heide B. Reliability and validity of risk analysis. Re-
and new challenges. Journal of Risk Research, 1998; 1:4971. liability Engineering and System Safety, 2009; 94:18621868.
29. Stirling A. Science, precaution and risk assessment: Towards 45. Aven T. Risk analysis and science. International Journal of
more measured and constructive policy debate. European Reliability, Quality and Safety Engineering, 2004; 11:115.
Molecular Biology Organisation Reports, 2007; 8:309315. 46. Aven T. On how to define, understand and describe risk. Re-
30. Aven T, Zio E. Some considerations on the treatment of un- liability Engineering and System Safety, 2010; 95:623631.
certainties in risk assessment for practical decision-making. 47. Aven T. The risk concept. Historical and recent develop-
Reliability Engineering and System Safety, 2011; 96:6474. ment trends. Reliability Engineering and System Safety, 2012;
31. Dubois D. Representation, propagation and decision issues in 99:3344.
risk analysis under incomplete probabilistic information. Risk 48. Stirling A. Risk at a turning point? Journal of Risk Research,
Analysis, 2010; 30:361368. 1998; 1:97109.
32. Baraldi P, Zio E. A combined Monte Carlo and possibilistic 49. Aven T, Vinnem JE. On the use of risk acceptance criteria in
approach to uncertainty propagation in event tree analysis. the offshore oil and gas industry. Reliability Engineering and
Risk Analysis, 2008; 28:13091325. System Safety, 2005; 90:1524.
33. Baudrit C, Dubois D, Guyonnet D. Joint propagation of prob- 50. Kujawski E, Miller GA. Quantitative risk-based analysis
abilistic and possibilistic information in risk assessment. IEEE for military counterterrorism systems. Systems Engineering,
Transactions on Fuzzy Systems, 2006; 14:593608. 2007; 10:273289.
34. Cooke R. The anatomy of the squizzel. The role of opera- 51. Garrick BJ, et al. Confronting the risks of terrorism: Mak-
tional definitions in representing uncertainty. Reliability En- ing the right decisions. Reliability Engineering and System
gineering and System Safety, 2004; 85:313319. Safety, 2004; 86:12976.
35. Smets P. What is Dempster-Shafers model? Pp. 534 in 52. Reliability Engineering and System Safety, 1988; 23(4).
Yager RR, Fedrizzi M, Kacprzyk J (eds). Advances in the 53. Reliability Engineering and System Safety, 1996; 54 (23).

Das könnte Ihnen auch gefallen