8 k=1 Show that | Ajk = {X0 = i,X₁ = j i.o.} Hint: show set inclusion both ways. Show that Pi(Ajk) = fij fjjk-¹.

A First Course in Probability (10th Edition)
10th Edition
ISBN:9780134753119
Author:Sheldon Ross
Publisher:Sheldon Ross
Chapter1: Combinatorial Analysis
Section: Chapter Questions
Problem 1.1P: a. How many different 7-place license plates are possible if the first 2 places are for letters and...
icon
Related questions
Question

Visiting a state infinitely often. Suppose that X0 = i and consider the event
Ajk defined as the event that the chain visits state j at least k times. Note that if
Ajk occurs, then it must be true that the chain must have made a visit from i to j
and then revisited j at least k − 1 times. Realizing the Pi probability that the chain
visits state j from state i is fij and the Pi probability that the chain visits state j
from state j (k − 1) times is f k−1
jj , we conclude that Pi(Ajk) ≤ fij f k−1
jj . On the other
hand, if the chain happens to visit j from i and also revisit j at least k − 1 times,
then we would know that the event Ajk has occurred.

8
k=1
Show that
| Ajk = {X0 = i,X₁ = j i.o.}
Hint: show set inclusion both ways.
Show that Pi(Ajk) = fij fjjk-¹.
Transcribed Image Text:8 k=1 Show that | Ajk = {X0 = i,X₁ = j i.o.} Hint: show set inclusion both ways. Show that Pi(Ajk) = fij fjjk-¹.
Expert Solution
steps

Step by step

Solved in 2 steps

Blurred answer
Similar questions
Recommended textbooks for you
A First Course in Probability (10th Edition)
A First Course in Probability (10th Edition)
Probability
ISBN:
9780134753119
Author:
Sheldon Ross
Publisher:
PEARSON
A First Course in Probability
A First Course in Probability
Probability
ISBN:
9780321794772
Author:
Sheldon Ross
Publisher:
PEARSON