Suppose that a Markov chain with 3 states and with transition matrix P is in state 3 on the first observation. Which of the following expressions represents the probability that it will be in state 1 on the third observation? (A) the (3, 1) entry of P (B) the (1,3) entry of P3 (C) the (3,1) entry of P4 (D) the (1,3) entry of P2 (E) the (3, 1) entry of P (F) the (1,3) entry of P4 (G) the (3, 1) entry of P2 (H) the (1,3) entry of P

Elementary Linear Algebra (MindTap Course List)
8th Edition
ISBN:9781305658004
Author:Ron Larson
Publisher:Ron Larson
Chapter4: Vector Spaces
Section4.7: Cooridinates And Change Of Basis
Problem 57E
icon
Related questions
Question
Suppose that a Markov chain with 3 states and with transition matrix P is in state 3
on the first observation. Which of the following expressions represents the probability
that it will be in state 1 on the third observation?
(A) the (3, 1) entry of P3
(B) the (1,3) entry of P3
(C) the (3, 1) entry of Pª
(D) the (1,3) entry of P2
(E) the (3, 1) entry of P
(F) the (1,3) entry of P4
(G) the (3, 1) entry of P2
(H) the (1,3) entry of P
Transcribed Image Text:Suppose that a Markov chain with 3 states and with transition matrix P is in state 3 on the first observation. Which of the following expressions represents the probability that it will be in state 1 on the third observation? (A) the (3, 1) entry of P3 (B) the (1,3) entry of P3 (C) the (3, 1) entry of Pª (D) the (1,3) entry of P2 (E) the (3, 1) entry of P (F) the (1,3) entry of P4 (G) the (3, 1) entry of P2 (H) the (1,3) entry of P
Expert Solution
steps

Step by step

Solved in 2 steps

Blurred answer
Knowledge Booster
Markov Processes and Markov chain
Learn more about
Need a deep-dive on the concept behind this application? Look no further. Learn more about this topic, advanced-math and related others by exploring similar questions and additional content below.
Recommended textbooks for you
Elementary Linear Algebra (MindTap Course List)
Elementary Linear Algebra (MindTap Course List)
Algebra
ISBN:
9781305658004
Author:
Ron Larson
Publisher:
Cengage Learning
Linear Algebra: A Modern Introduction
Linear Algebra: A Modern Introduction
Algebra
ISBN:
9781285463247
Author:
David Poole
Publisher:
Cengage Learning