ECE 534: Random Processes

Spring 2016

Problem Set 6
Due Date: 4/20
1. Problem 1
(a) Differentiation with respect to t would suggest that the m.s. derivative of X is given by
Xt0 = B + 2Ct. Direct verification:
"
2 #
Xt+h Xt
lim E
(B + 2Ct)
= lim E[h2 C 2 ] = 0
h0
h0
h

(b)

R1
0

Xs ds = A + B/2 + C/3, which is a N (0, 2 ) random variable with 2 = 1 + 41 + 19 . So

Z
P
0


 
1
Xs ds 1 = Q

2. Problem 2
(a) Yes. Let n 1 and t1 < < tn < tn+1 . Note that Ytn+1 = (1)D Ytn where D =
Ntn+1 Ntn . (We write D for brevity, even though it depends on tn and tn+1 ). The
distribution of D is Poisson with mean , where = tn+1 tn . The vector (Yt1 , . . . , Ytn )
is determined by (Nt : 0 t tn ), and is thus independent of D by the independent
increment property of Poisson processes. To summarize, if tn is viewed as the present
time, the future value Ytn+1 is a function of the present value Ytn , and D, which is
independent of the past and has a distribution depending on (tn , tn+1 ) only through the
difference . Thus, Y is a time-homogeneous Markov process.
One way to identify the transition rate matrix Q and the transition probabilities is to
directly find the transition probabilities, as follows. For i, j {1, 1},






i
D
D
P Ytn+1 = j|Ytn = i = P (1) Ytn = j|Ytn = i = P (1) =
j
Since

X


e
( )2k
P (1) = 1 =
(2k)!
D

=
=
=

k=0
e

2
e

X
( )m + ( )m
m!
m=0


e + e
2

1 + e2
,
2

ECE 534: Random Processes, Problem Set 6

it follows that, for i, j {1, 1},

1 + e2

, i=j

2
pij ( ) =
2

1e
, i=
6 j
2
The transition rates are given by qij =

p0ij (0),


yielding Q =


.

(b) E[|Yt+ Yt |2 ] = 4P (Yt+ 6= Yt ) = 2(1 e2 ) 0 as 0, so that Y is m.s. continuous.

(c) If Y were m.s. differentiable, then E[| Yt+Yt |2 ] would have a finite limit as 0. But
this expectation is equal to
m.s. differentiable.

2(1e2 )
,
2

which diverges to as 0, so that Y is not

(d) Note that RY (t + , t) = E[Yt+ Yt ] = P {Yt+ = Yt } P {Yt+ 6= Yt } =

1e2
= e2 . Then,
2
" Z
2 #
Z T

Z T
1 T
1
E
Yt dt
=
E
Yt dt
Ys ds
T 0
T2
0
0
Z TZ T
1
RY (s, t)dsdt
=
T2 0 0
=
which converges to 0 as T . Hence,

1
T

1+e2
2

1
e2T 1
+
,
T
22 T 2
RT
0

Yt dt converges to 0 in m.s. sense.

3. Problem 3
(a) Since An A, the corollary in Section 2.12 of the notes implies that E[AAn ] E[A2 ]
and E[A2n ] E[A2 ]. Since A and the An are jointly Gaussian, the hint and the statement
just proved imply that:
E[A4 ] = 3E[A2 ]2
E[A4n ] = 3E[A2n ]2 3E[A2 ]2
E[A2n A2 ] = 2E[AAn ]2 + E[A2 ]E[A2n ] 3E[A2 ]2
Therefore E[(A2n A2 )2 ] = E[A4n ] 2E[A2n A2 ] + E[A4 ] 0.
m.s.

m.s.

m.s.

(b) By the assumptions and part (a), A2n A2 and Bn2 B 2 . Furthermore, An + Bn
m.s.
m.s.
A + B and thus (An + Bn )2 (A + B)2 . Then, (An + Bn )2 A2n Bn2 (A + B)2
A2 B 2 , which is equivalent to what is to be proved.

ECE 534: Random Processes, Problem Set 6

Y

(c) Fix any t. Then for h 6= 0, t+hh t = t+hh t (Xt+h +Xt ) = Ah Bh , where Ah Xt0 m.s.
Y
Y
and Bh 2Xt m.s. as h 0. Therefore, by part (b), t+hh t = Ah Bh 2Xt0 Xt m.s.
That is, if X is mean zero, Gaussian and m.s. differentiable, then X 2 is also m.s. differentiable, and, just as for deterministic functions, (X 2 )0 = 2XX 0 .
4. Problem 4
(a) A stationary Markov chain is also time homogeneous. Hence, the state transition matrix
from t to t + , 0, denoted by H( ), can be obtained by solving
H( )
= H( )Q,

and we have

e2 + 1

2
H( ) =
1 e2
2

1 e2

e2 + 1
2

Then,
RX ( ) = E[Xt+ Xt ]
= E[Xt+ |Xt = 1]P (Xt = 1) E[Xt+ |Xt = 1]P (Xt = 1)
= e2
Hence, the correlation function for general R is RX ( ) = e2| | .
(b) For any 0, RX ( ) is continuous over R. Hence, X is m.s. continuous (Proposition
7.7 on textbook).
0 ( ) = R00 ( ) = 0, for all R. Then, R ( ), R0 ( ), R00 ( ) exist and
(c) When = 0, RX
X
X
X
X
are continuous in . Hence, X is m.s. continuously differentiable (Proposition 7.10 on
0 does not exist at = 0. Hence, X is not m.s. continuously
textbook). When > 0, RX
differentiable.

(d) When > 0, lim RX ( ) = 0, by Proposition 7.18, X is mean ergodic in the m.s.
sense. When = 0, CX ( ) = RX ( ) = 1 (since the Markov chain has zero mean). Then,
lim CX ( ) = 1 6= 0. Hence, X is not mean ergodic in the m.s. sense.
5. Problem 5
(a)
Z

RX (s, t) = E

Zu e

du

Z
0

=
0

Zv e


dv

sZ t

=
Z

0
st

2 euv (u v)dudv

2 e2v dv =

2
(1 e2(st) )
2

ECE 534: Random Processes, Problem Set 6

X

(b) No. If the ratio t+hh t converged in the m.s. sense as h 0, its mean square value
2 R t+h
X
X
would converge to a finite number. But E[( t+hh t )2 ] = h2 t e2u du , so the
answer is no.
(c) Yes. Observe from part (a) that lims,t RX (s, t) exists and is finite. Thus, the Cauchy
criterion for m.s. convergence (Proposition 2.11) holds.
6. Problem 6
(a) The sample paths of Y are piecewise linear. The initial slope is zero, and the slope of Y
increases by one at each jump of N .
(b)
Z
E[Yt ] =

Z
E[Ns ]ds =

sds =
0

(c) Using the fact CN (u, v) = (u v), yields

Z tZ t
Z tZ
Var(Yt ) =
CN (u, v)dudv = 2
0

t2
2

Z
ududv =

v 2 dv =

(d) Note that if Nt/2 2, then Yt t. So P [Yt < t] P [Nt/2 1] = (1 +

as t .

t3
3

t
t
2 ) exp( 2 )

7. Problem 7
(a) The solution to the differential equation is
Z t
e(th) N (u)du
Xt = et x0 +
0

Since N 0 it follows that X (t) = et x0 . Assume that s t, the covariance function

of X is given by:
CX (s, t) = Cov(Xs , Xt )
Z t

Z s
= Cov
e(tv) N (v)dv,
e(su) N (u)du
0
0
Z sZ t
=
e(su) e(tv) 2 (u v)dvdu
Z0 s 0
=
e(su) e(tu) 2 du
0
Z s
2 st
= e
e2u du
0

2 st
e
est
2

ECE 534: Random Processes, Problem Set 6

By the symmetry of CX , it is given in general by


2  |ts|
e
ets
2

CX (s, t) =
(b) Let r < s < t. It must be checked that

CX (r, s)CX (s, t) = CX (r, t)CX (s, s)

or (ers ers )(est est ) = (ert ert )(1 e2s ) which is easily done.
(c) As t , X (t) 0, CX (t + , t)
E[Xt+ ]E[Xt ] = CX (t + , t) + e2t x20

2 | |
,
2 e
2 | |
e
.
2

and RX (t + , t) = CX (t + , t) +

8. Problem 8
2

0 ( ) = e /2 and R00 ( ) = ( 2 1)e /2 . Since R , R0 and

(a) It is easy to see that RX
X
X
X
00
R (X) exist and are continuous, (Xt ) is m.s. continuously differentiable (Proposition
7.10 on textbook).

X 0 (t) =

d
X = 0,
dt

00
RX 0 ( ) = RX
( ) = (1 2 )e

2 /2

Since RX ( ) 0 as , X is mean ergodic in the m.s. sense, and then

1
lim
T T
Consider E[( T1

RT
0

Xt dt = X m.s.
0

Xt dt 0)2 ], we have
"

2 #
Z
1 T
E
Xt dt
T 0
Z T

Z T
1
=
E
Xt dt
Xs ds
T2
0
0
Z TZ T
1
=
RX (s, t)dsdt
T2 0 0
Z TZ T
(st)2
1
2
=
e
dsdt
T2 0 0

Since for any fixed t,

Z

we have
1
T2

e
0

(st)2
1
e 2 ds = 1,
2

(st)2
2

1
dsdt 2
T

which converges to 0 as T . Hence, X = 0.

Z
0

2
2dt =
,
T

ECE 534: Random Processes, Problem Set 6

6
2

(b) RX 0 ( ) = CX 0 ( ) = (1 2 )e /2 . It is easy to see using LHopitals rule that

CX 0 ( ) 0 as . Thus (Xt0 ) is mean ergodic in m.s. sense.
(c) Xt and Xt0 are jointly Gaussian, and we have established that they are zero mean.
Furthermore,
Var(Xt ) = RX (0) = 1,

Var(Xt0 ) = RX 0 (0) = 1,

0
Cov(Xt , Xt0 ) = RX 0 X (0) = RX
(0) = 0.

Thus, for fixed t, Xt and Xt0 are independent N (0, 1) random variables.
0 ( ) = e
(d) RX 0 X ( ) = RX

2 /2

E[X1 |X20 = 2] = 0 + Cov(X1 , X20 ) Var(X20 )1 (2 0) = RX 0 X (1)RX 0 (0)1 (2) = 2e1/2