Problem 1PP: Consider the Markov chain on {1, 2, 3} with transition matrix P = [1/201/21/21/2001/21/2] a. Show... Problem 1E: In Exercises 1 and 2, consider a Markov chain on {1, 2} with the given transition matrix P. In each... Problem 2E Problem 3E: In Exercises 3 and 4, consider a Markov chain on {1, 2, 3} with the given transition matrix P. In... Problem 4E Problem 5E Problem 6E: In Exercises 5 and 6, find the matrix to which Pn converges as n increases. 5. P =... Problem 7E: In Exercises 7 and 8, determine whether the given matrix is regular. Explain your answer. 7. P =... Problem 8E Problem 9E: Consider a pair of Ehrenfest urns with a total of 4 molecules divided between them. a. Find the... Problem 10E: Consider a pair of Ehrenfest urns with a total of 5 molecules divided between them. a. Find the... Problem 11E: Consider an unbiased random walk with reflecting bound-aries on {1, 2, 3, 4}. a. Find the transition... Problem 12E: Consider a biased random walk with reflecting boundaries on {1, 2, 3, 4} with probability p = .2 of... Problem 13E Problem 14E: In Exercises 13 and 14, consider a simple random walk on the given graph. In the long ran, what... Problem 15E: In Exercises 15 and 16, consider a simple random walk on the given directed graph. In the long run,... Problem 16E: In Exercises 15 and 16, consider a simple random walk on the given directed graph. In the long run,... Problem 17E Problem 18E Problem 19E Problem 20E: Consider the mouse in the following maze, which includes one-way doors. What fraction of the time... Problem 21E: In Exercises 21 and 22, mark each statement True or False. Justify each answer. 21. a. Every... Problem 22E: In Exercises 21 and 22, mark each statement True or False. Justify each answer. 22. a. Every... Problem 23E Problem 24E: Suppose that the weather in Charlotte is modeled using the Markov chain in Section 10.1, Exercise... Problem 25E: In Exercises 25 and 26, consider a set of webpages hyperlinked by the given directed graph. Find the... Problem 26E: In Exercises 25 and 26, consider a set of webpages hyperlinked by the given directed graph. Find the... Problem 27E Problem 28E: Consider beginning with an individual of known type and mating it with a hybrid, then mating an... Problem 29E Problem 30E: Consider the Bernoulli-Laplace diffusion model studied in Section 10.1, Exercise 30. a. Let k = 5... Problem 31E Problem 32E Problem 33E Problem 34E: Let 0 p, q 1, and define P = [p1q1pq] a. Show that 1 and p + q 1 are eigenvalues of P. b. By... Problem 35E: Let 0 p, q 1, and define P = [pq1pqq1pqp1pqpq] a. For what values of p and q is P a regular... Problem 36E: Let A be an m m stochastic matrix, let x be in m and let y = Ax. Show that |y1| + + |ym| |x1| + +... Problem 37E Problem 38E: Consider a simple random walk on a finite connected graph. (A graph is connected if it is possible... Problem 39E format_list_bulleted