A Markov chain Xo, X₁, X₂... on states 0, 1, 2 has the transition probability matrix P (shown on the right) and initial distribution P(X₁ = 0) = 0.3, P(X。 = 1) = 0.4 and P(X₁ = 2) = 0.3. (1) Show that P is regular. (2) Find P(Xo = 2, X₁ = 0, X₂ = 1). (3) Find P(X₂ = 2, X₁ = 1|X₁ = 0). (4) Determine the limiting distribution. 0 0 0.7 P=10 1 2 0.2 0.1 0.6 0.4 20.5 0 0.5

A First Course in Probability (10th Edition)
10th Edition
ISBN:9780134753119
Author:Sheldon Ross
Publisher:Sheldon Ross
Chapter1: Combinatorial Analysis
Section: Chapter Questions
Problem 1.1P: a. How many different 7-place license plates are possible if the first 2 places are for letters and...
icon
Related questions
Question
A Markov chain X₁, X₁, X₂... on states 0, 1, 2 has the
transition probability matrix P (shown on the right) and initial
distribution P(X₁ = 0) = 0.3, P(X。 = 1) = 0.4 and P(Xo
2) = 0.3.
(1) Show that P is regular.
(2) Find P(Xo = 2, X₁ = 0, X₂ = 1).
(3) Find P(X₂ = 2, X₁ = 1|X₁ = 0).
(4) Determine the limiting distribution.
=
0
0 0.7
P = 1 0
20.5
1
2
0.2 0.1||
0.6
0.4
0
0.5
Transcribed Image Text:A Markov chain X₁, X₁, X₂... on states 0, 1, 2 has the transition probability matrix P (shown on the right) and initial distribution P(X₁ = 0) = 0.3, P(X。 = 1) = 0.4 and P(Xo 2) = 0.3. (1) Show that P is regular. (2) Find P(Xo = 2, X₁ = 0, X₂ = 1). (3) Find P(X₂ = 2, X₁ = 1|X₁ = 0). (4) Determine the limiting distribution. = 0 0 0.7 P = 1 0 20.5 1 2 0.2 0.1|| 0.6 0.4 0 0.5
Expert Solution
steps

Step by step

Solved in 5 steps with 11 images

Blurred answer
Similar questions
Recommended textbooks for you
A First Course in Probability (10th Edition)
A First Course in Probability (10th Edition)
Probability
ISBN:
9780134753119
Author:
Sheldon Ross
Publisher:
PEARSON
A First Course in Probability
A First Course in Probability
Probability
ISBN:
9780321794772
Author:
Sheldon Ross
Publisher:
PEARSON