2. Let {X t = 0, 1, 2,...} be a discrete-time Markov chain. Prove that given X₁ = i, Xn+1 is independent of {Xo, X₁,..., Xn-1}. In other words, prove that P(Xn+1 = j, Xo = io, X₁ = 1,..., Xn-1=in-1 Xn = i) =P(Xn+1 =jXn = i)P(Xo = io, X₁ = ₁,..., Xn-1=in-1|Xn = i) for any j, io, i1,..., in-1,i in the state space.

Linear Algebra: A Modern Introduction
4th Edition
ISBN:9781285463247
Author:David Poole
Publisher:David Poole
Chapter3: Matrices
Section3.7: Applications
Problem 13EQ
icon
Related questions
Question
100%
2. Let {Xt: t = 0, 1, 2,...} be a discrete-time Markov chain. Prove that given X₂ = i,
Xn+1 is independent of {Xo, X₁,..., Xn-1}. In other words, prove that
P(Xn+1 = J, Xo = 20, X₁ = 1,..., Xn-1 = in-1|Xn = i)
= P(Xn+1 =jXn = i) P(Xo = io, X1 = 1,..., Xn-1 = in-1 Xn = i)
for any j, io, i1,..., in-1,i in the state space.
Transcribed Image Text:2. Let {Xt: t = 0, 1, 2,...} be a discrete-time Markov chain. Prove that given X₂ = i, Xn+1 is independent of {Xo, X₁,..., Xn-1}. In other words, prove that P(Xn+1 = J, Xo = 20, X₁ = 1,..., Xn-1 = in-1|Xn = i) = P(Xn+1 =jXn = i) P(Xo = io, X1 = 1,..., Xn-1 = in-1 Xn = i) for any j, io, i1,..., in-1,i in the state space.
Expert Solution
steps

Step by step

Solved in 3 steps with 6 images

Blurred answer
Recommended textbooks for you
Linear Algebra: A Modern Introduction
Linear Algebra: A Modern Introduction
Algebra
ISBN:
9781285463247
Author:
David Poole
Publisher:
Cengage Learning
Elementary Linear Algebra (MindTap Course List)
Elementary Linear Algebra (MindTap Course List)
Algebra
ISBN:
9781305658004
Author:
Ron Larson
Publisher:
Cengage Learning
Big Ideas Math A Bridge To Success Algebra 1: Stu…
Big Ideas Math A Bridge To Success Algebra 1: Stu…
Algebra
ISBN:
9781680331141
Author:
HOUGHTON MIFFLIN HARCOURT
Publisher:
Houghton Mifflin Harcourt