Question

plz help me with this question.Thank you

(a) Show (Xn is ergodic. (b) What percent of transitions are from an odd state to an even state? What percent of transitions are from an even state to an even state? (c) Upon entering an odd state what is the expected number of transi- tions that the chain will remain in an odd state? (d) Suppose the chain transitions once per hour. Suppose 15 units are earned for every hour the chain is in state 1 or state 2. Suppose 5 units are lost each hour when the chain is in state 3 and 20 units lost each hour when it's in state 4. What is the expected winning or losing if someone invests in this system? Below is the matrix Let P800 -2 be a transition matrix for (Xn) with S- 001 0/ 1, 2, 3,4

Answer 1

Gil von Thal Solution: Rossible value of The Stade of The stom Ci) 2) 3) 4) of main oom one vlue of The Seate to anotheγ in one period 01 020.304-

Tis The anbabite Cintia dinbuon eaul in The 9vem p. The Pra habil obi ty of Moving state ito stete .J to

K:15 PK - 10.352。648 o 3386-9- The urconsitn Poababiudy disfibui o

TTo becomes ob solete