It costs $10 to play a gambling game. If the player wins, then this $10 is returned and an additional $10 is given to the player. If the player loses, then the player loses the $10. The probability of winning is .4. Assume that a player starts with $20 and plays until either losing everything or having a total of $30. This is a gambler's ruin Markov chain. a) Describe the state and draw the transition diagram. b) Write the transition matrix in standard form. c) What is the probability that the player wins, i.e. the player finishes with $30.

Elementary Linear Algebra (MindTap Course List)
8th Edition
ISBN:9781305658004
Author:Ron Larson
Publisher:Ron Larson
Chapter2: Matrices
Section2.5: Markov Chain
Problem 16E: Consumer Preference In a population of 100,000 consumers, there are 20,000 users of Brand A, 30,000...
icon
Related questions
Question
It costs $10 to play a gambling game. If the
player wins, then this $10 is returned and
an additional $10 is given to the player. If
the player loses, then the player loses the
$10. The probability of winning is .4.
Assume that a player starts with $20 and
plays until either losing everything or
having a total of $30. This is a gambler's
ruin Markov chain.
a) Describe the state and draw the
transition diagram.
b) Write the transition matrix in standard
form.
c) What is the probability that the player
wins, i.e. the player finishes with $30.
d) What is the probability that the player
loses, i.e. the player finishes with $0.
e) For each transient state, find the
expected number of times that we visit that
state.
f) How many rounds do we expect the
game to last?
Transcribed Image Text:It costs $10 to play a gambling game. If the player wins, then this $10 is returned and an additional $10 is given to the player. If the player loses, then the player loses the $10. The probability of winning is .4. Assume that a player starts with $20 and plays until either losing everything or having a total of $30. This is a gambler's ruin Markov chain. a) Describe the state and draw the transition diagram. b) Write the transition matrix in standard form. c) What is the probability that the player wins, i.e. the player finishes with $30. d) What is the probability that the player loses, i.e. the player finishes with $0. e) For each transient state, find the expected number of times that we visit that state. f) How many rounds do we expect the game to last?
Expert Solution
steps

Step by step

Solved in 4 steps with 4 images

Blurred answer
Similar questions
Recommended textbooks for you
Elementary Linear Algebra (MindTap Course List)
Elementary Linear Algebra (MindTap Course List)
Algebra
ISBN:
9781305658004
Author:
Ron Larson
Publisher:
Cengage Learning
College Algebra
College Algebra
Algebra
ISBN:
9781337282291
Author:
Ron Larson
Publisher:
Cengage Learning
Holt Mcdougal Larson Pre-algebra: Student Edition…
Holt Mcdougal Larson Pre-algebra: Student Edition…
Algebra
ISBN:
9780547587776
Author:
HOLT MCDOUGAL
Publisher:
HOLT MCDOUGAL
Algebra & Trigonometry with Analytic Geometry
Algebra & Trigonometry with Analytic Geometry
Algebra
ISBN:
9781133382119
Author:
Swokowski
Publisher:
Cengage
College Algebra (MindTap Course List)
College Algebra (MindTap Course List)
Algebra
ISBN:
9781305652231
Author:
R. David Gustafson, Jeff Hughes
Publisher:
Cengage Learning