additional problem 2

A random sample from a Bernoulli(p) distribution has 80 successes and 20 failures. Construct a
consistent estimator for the odds ratio p/(1−p). What is the approximate pdf of this estimator?
iid
Solution: If X1 , . . . , Xn ∼ Bernoulli(p), then EX1 = p. Hence, a consistent estimator of p is
p
p̂ := nj=1 Xj /n because p̂ −
P
→ EX1 = p by the WLLN. Hence, by the continuous mapping theorem
d
(CMT), p̂/(1 − p̂) is a consistent estimator of p/(1 − p). From the CLT, we know that n1/2 (p̂ − p) −
→
1/2 d
N(0, p(1−p)). Hence, letting g(p) := p/(1−p), the exact delta method implies that n (g(p̂)−g(p)) − →
d
N(0, p(1−p)[g 0 (p)]2 ). But g 0 (p) = 1/(1−p)2 . Hence, it follows that n1/2 (g(p̂)−g(p)) −
→ N(0, p/(1−p)3 ).
d
Consequently, g(p̂) ≈ N(g(p), p/[n(1−p)3 ]). In the given dataset, we know that n = 100, p̂ = 80/100 =
d d
0.8, and g(p̂) = 0.8/0.2 = 4. Therefore, g(p̂) ≈ N(4, 0.8/[100(1 − 0.8)3 ]) = N(4, 1).

additional problem 5
d
Let θ̂ be a consistent estimator of θ > 0 such that n1/2 (θ̂ − θ) →
− N(0, θ2 ) as n → ∞.
(i) What is Pr(θ̂ ≥ 1.196θ) when n = 100?
(ii) What is the standard error of θ̂?
(iii) Find the approximate mean and variance of 1/θ̂.
(iv) What is the distribution of 1/θ̂?
Solution:
(i) Note that
Pr(θ̂ ≥ 1.196θ) = Pr(n1/2 (θ̂ − θ) ≥ n1/2 (1.196θ − θ))
.
= Pr(N(0, θ2 ) ≥ n1/2 0.196θ)
= Pr(N(0, 1) ≥ n1/2 0.196)
= Pr(N(0, 1) ≥ 1.96) (n = 100)
= 0.025.
√
q
(ii) se(θ̂) := asvar(
[ θ̂)/n = θ̂/ n.
.
(iii) Let g(θ) := 1/θ. By a first order Taylor expansion, g(θ̂) = g(Eθ̂) + g 0 (Eθ̂)(θ̂ − Eθ̂). Hence,
. . d .
Eg(θ̂) = g(Eθ̂) = 1/Eθ̂ = 1/θ because θ̂ ≈ N(θ, θ2 /n). Similarly, var g(θ̂) = [g 0 (Eθ̂)]2 var(θ̂) =
.
var(θ̂)/(Eθ̂)4 = 1/(nθ2 ).
d d
(iv) By the exact delta method, n1/2 (g(θ̂) − g(θ)) −→ N(0, [g 0 (θ)]2 θ2 ) = N(0, 1/θ2 ), i.e.,
1 1 d 1
n1/2 ( − ) − → N(0, 2 ) as n → ∞.
θ̂ θ θ
The practical implication of this result is that, for large enough n,
1 d 1 1
≈ N( , 2 ).
θ̂ θ nθ