3.1.5 A Markov chain Xo, X1, X2,... has the transition probability matrix 012 0 0.3 0.2 0.5 P 10.5 0.1 0.4 = 2 0.5 0.2 0.3 and initial distribution po = 0.5 and p₁ = 0.5. Determine the probabilities Pr{Xo = 1, X₁ = 1, X₂ = 0} and Pr{X₁ = 1, X2 = 1, X3 = 0}.

A First Course in Probability (10th Edition)
10th Edition
ISBN:9780134753119
Author:Sheldon Ross
Publisher:Sheldon Ross
Chapter1: Combinatorial Analysis
Section: Chapter Questions
Problem 1.1P: a. How many different 7-place license plates are possible if the first 2 places are for letters and...
icon
Related questions
Question

Please do the following questions with handwritten working out 

The answer is  in the other image 

3.1.5 0.025, 0.0075.
Transcribed Image Text:3.1.5 0.025, 0.0075.
3.1.5 A Markov chain Xo, X₁, X2,... has the transition probability matrix
0
1
2
0 0.3
0.2 0.5
P 10.5 0.1 0.4
=
2 0.5 0.2 0.3
and initial distribution po = 0.5 and p₁ = 0.5. Determine the probabilities
Pr{Xo = 1, X₁ = 1, X₂=0} and Pr{X₁ = 1, X₂ = 1, X3 = 0}.
Transcribed Image Text:3.1.5 A Markov chain Xo, X₁, X2,... has the transition probability matrix 0 1 2 0 0.3 0.2 0.5 P 10.5 0.1 0.4 = 2 0.5 0.2 0.3 and initial distribution po = 0.5 and p₁ = 0.5. Determine the probabilities Pr{Xo = 1, X₁ = 1, X₂=0} and Pr{X₁ = 1, X₂ = 1, X3 = 0}.
Expert Solution
steps

Step by step

Solved in 4 steps with 10 images

Blurred answer