Problem 5. Consider a Markov chain with n states arranged in a circle. At each step the chain jumps one step clockwise with probability 2/3 and one step anticlockwise with probability 1/3. (a) Show that this is periodic if n is even and aperiodic if n is odd. (b) What is the stationary measure for this chain?

A First Course in Probability (10th Edition)
10th Edition
ISBN:9780134753119
Author:Sheldon Ross
Publisher:Sheldon Ross
Chapter1: Combinatorial Analysis
Section: Chapter Questions
Problem 1.1P: a. How many different 7-place license plates are possible if the first 2 places are for letters and...
icon
Related questions
Question
5
Problem 5. Consider a Markov chain with n states arranged in a circle. At each step the chain jumps one
step clockwise with probability 2/3 and one step anticlockwise with probability 1/3.
(a) Show that this is periodic if n is even and aperiodic if n is odd.
(b) What is the stationary measure for this chain?
Transcribed Image Text:Problem 5. Consider a Markov chain with n states arranged in a circle. At each step the chain jumps one step clockwise with probability 2/3 and one step anticlockwise with probability 1/3. (a) Show that this is periodic if n is even and aperiodic if n is odd. (b) What is the stationary measure for this chain?
Expert Solution
steps

Step by step

Solved in 2 steps with 1 images

Blurred answer