Two people A and B play a series of games, in which they bet on a particular share price increasing or decreasing on a particular day. If the share price increases, player B pays player A £1; whereas if the share price decreases, player A pays player B £1. The probability of the share price increasing on any particular day is p independently of any other day, and the probability of the share price decreasing is q = (1 – p). Initially, both A and B have £2, and the series of games ends when one player runs out of money. We let X, be amount of money possessed by player A after n days, so X, = 2, and we consider the random process Xo, X1, X2, .... (a) Explain why the state space of this random process is {0, 1, 2, 3, 4}. (b) Explain why this random process is a Markov process. (c) Explain why the transition matrix for this random process is 1 0 0 0 0 q0 P 0 0 0 q 0 p 0 0 0 q 0 p 0 0 0 0 1 (d) What is the 2-step transition matrix for this Markov process? (e) Classify the states of this random process.
Two people A and B play a series of games, in which they bet on a particular share price increasing or decreasing on a particular day. If the share price increases, player B pays player A £1; whereas if the share price decreases, player A pays player B £1. The probability of the share price increasing on any particular day is p independently of any other day, and the probability of the share price decreasing is q = (1 – p). Initially, both A and B have £2, and the series of games ends when one player runs out of money. We let X, be amount of money possessed by player A after n days, so X, = 2, and we consider the random process Xo, X1, X2, .... (a) Explain why the state space of this random process is {0, 1, 2, 3, 4}. (b) Explain why this random process is a Markov process. (c) Explain why the transition matrix for this random process is 1 0 0 0 0 q0 P 0 0 0 q 0 p 0 0 0 q 0 p 0 0 0 0 1 (d) What is the 2-step transition matrix for this Markov process? (e) Classify the states of this random process.
MATLAB: An Introduction with Applications
6th Edition
ISBN:9781119256830
Author:Amos Gilat
Publisher:Amos Gilat
Chapter1: Starting With Matlab
Section: Chapter Questions
Problem 1P
Related questions
Question

Transcribed Image Text:Two people A and B play a series of games, in which they bet on a
particular share price increasing or decreasing on a particular day. If
the share price increases, player B pays player A £1; whereas if the
share price decreases, player A pays player B £1. The probability
of the share price increasing on any particular day is p independently
of any other day, and the probability of the share price decreasing is
q = (1– p). Initially, both A and B have £2, and the series of games
ends when one player runs out of money. We let X, be amount of
money possessed by player A after n days, so Xo = 2, and we consider
the random process Xo, X1, X2, ....
(a) Explain why the state space of this random process is {0, 1, 2, 3, 4}.
(b) Explain why this random process is a Markov process.
(c) Explain why the transition matrix for this random process is
1 0 0 0 0
q 0 p 0 0
0 0 q 0 p
0 0 0 0 1
(d) What is the 2-step transition matrix for this Markov process?
(e) Classify the states of this random process.
Expert Solution

This question has been solved!
Explore an expertly crafted, step-by-step solution for a thorough understanding of key concepts.
Step by step
Solved in 7 steps

Recommended textbooks for you

MATLAB: An Introduction with Applications
Statistics
ISBN:
9781119256830
Author:
Amos Gilat
Publisher:
John Wiley & Sons Inc

Probability and Statistics for Engineering and th…
Statistics
ISBN:
9781305251809
Author:
Jay L. Devore
Publisher:
Cengage Learning

Statistics for The Behavioral Sciences (MindTap C…
Statistics
ISBN:
9781305504912
Author:
Frederick J Gravetter, Larry B. Wallnau
Publisher:
Cengage Learning

MATLAB: An Introduction with Applications
Statistics
ISBN:
9781119256830
Author:
Amos Gilat
Publisher:
John Wiley & Sons Inc

Probability and Statistics for Engineering and th…
Statistics
ISBN:
9781305251809
Author:
Jay L. Devore
Publisher:
Cengage Learning

Statistics for The Behavioral Sciences (MindTap C…
Statistics
ISBN:
9781305504912
Author:
Frederick J Gravetter, Larry B. Wallnau
Publisher:
Cengage Learning

Elementary Statistics: Picturing the World (7th E…
Statistics
ISBN:
9780134683416
Author:
Ron Larson, Betsy Farber
Publisher:
PEARSON

The Basic Practice of Statistics
Statistics
ISBN:
9781319042578
Author:
David S. Moore, William I. Notz, Michael A. Fligner
Publisher:
W. H. Freeman

Introduction to the Practice of Statistics
Statistics
ISBN:
9781319013387
Author:
David S. Moore, George P. McCabe, Bruce A. Craig
Publisher:
W. H. Freeman