Beruflich Dokumente
Kultur Dokumente
Introduction
Decision often must be made in uncertain
environments.
Examples:
Manufacturer introducing a new product in the
marketplace.
Government contractor bidding on a new contract.
Oil company deciding to drill for oil in a particular
location.
Prototype example
Goferbroke Company owns a tract of land that can
contain oil.
Contracted geologist reports that chance of oil is 1 in 4.
Another oil company offers 90 000 for land.
Cost of drilling is 100 000. If oil is found, revenue is
800 000 (expected profit is 700 000).
Status of land
Payoff
Alternative
Oil
Dry
700 000
100 000
90 000
90 000
1 in 4
3 in 4
Chance of status
559
560
State of nature
Alternative
Oil
Dry
700
100
90
90
Prior probability
0.25
0.75
561
Oil
Dry
700
100
90
90
Prior probability
0.25
0.75
Minimum
100
90
Maximin value
562
Oil
Dry
700
100
90
90
Prior probability
0.25
0.75
Most likely
563
564
566
567
Posterior probabilities
n = number of possible states.
P(State = state i) = prior probability that true state is
state i.
Finding = finding from experimentation (random var.)
Finding j = one possible value of finding.
P(State = state i| Finding = finding j) = posterior
probability that true state of nature is state i, given
Finding = finding j.
Given P(State=state i) and P(Finding = find j|P(State=state i),
what is P(State=state i | Finding = finding j)?
568
Posterior probabilities
From probability theory the Bayes theorem can be
obtained:
P(State = state i | Finding = finding j )
P (Finding = finding j | State = state i ) P(State = state i )
n
569
0.4(0.25)
0.4(0.25) 0.8(0.75)
1
7
1
,
7
6
.
7
0.6(0.25)
0.6(0.25) 0.2(0.75)
1
2
1
,
2
1
.
2
570
571
Expected payoffs
Expected payoffs can be found using again Bayes
decision rule for the prototype example, with posterior
probabilities replacing prior probabilities:
Expected payoffs if finding is USS:
E[Payoff (drill | Finding = USS)
E[Payoff (sell | Finding = USS)
1
6
(700)
( 100) 30
7
7
1
6
(90)
(90) 30 60
7
7
15.7
1
1
(700)
( 100) 30 270
2
2
1
1
(90)
(90) 30 60
2
2
572
Optimal policy
Using Bayes decision rule, the optimal policy of
optimizing payoff is given by:
Finding from
seismic survey
Optimal
alternative
USS
FSS
Expected payoff
Expected payoff
excluding cost of survey including cost of survey
90
60
300
270
573
Value of experimentation
Before performing an experimentation, determine its
potential value.
Two methods:
1. Expected value of perfect information it is assumed
that all uncertainty is removed. Provides an upper
bound of potential value of experiment.
2. Expected value of information is the expected
increase in payoff, not just its upper bound.
574
Oil
Dry
700
100
90
90
Maximum payoff
700
90
Prior probability
0.25
0.75
576
10
577
Decision trees
Prototype example has a sequence of two questions:
1. Should a seismic survey be conducted before an
action is chosen?
2. Which action (drill for oil or sell the land) should be
chosen?
These questions have a corresponding tree search.
11
579
probability
cash flow
580
12
582
13
Utility theory
You are offered the choice of:
1. Accepting a 50:50 chance of winning $100.000 or
nothing;
2. Receiving $40.000 with certainty.
What do you choose?
14
Utility theory
Utility functions u(M) for money M: usually there is a decreasing
marginal utility for money (individual is risk-averse).
585
15
Utility theory
Fundamental property: the decision makers utility
function for money has the property that the decision
maker is indifferent between two alternatives if they
have the same expected utility.
Example. Offer: an opportunity to obtain either
$100000 (utility = 4) with probability p or nothing
(utility = 0) with probability 1 p. Thus, E(utility) = 4p.
Decision maker is indifferent for e.g.:
Offer with p = 0.25 (E(utility) = 1) or definitely
obtaining $10 000 (utility = 1).
Offer with p = 0.75 (E(utility) = 3) or definitely
obtaining $60 000 (utility = 3).
587
588
16
Utility
130
150
100
105
60
60
90
90
670
580
700
600
589
590
17
Estimating u(M)
A popular form is the exponential utility function:
u(M )
R 1 e
M
R
591
592
18
593
19