On Direct Convergence and Periodicity for Transition Probabilities of Markov Chains in Random Environments
Cogburn, Robert
Ann. Probab., Tome 18 (1990) no. 4, p. 642-654 / Harvested from Project Euclid
We study direct convergence of the products $P(\theta_0) \cdots P(\theta_n)$ of random stochastic matrices. These products can be interpreted as the transition probabilities of nonhomogeneous Markov chains selected at random by a stationary "environmental" sequence $\{\theta_n\}$, in other words, a Markov chain in a random environment. Rather than make assumptions analogous to irreducibility and aperiodicity for homogeneous Markov chains, we introduce equivalence relations that allow convergence results on the equivalence classes. The classical decomposition into a cycle of periodic sets is not possible in general, so the "periodicity" in the title is meant only to be suggestive. We also examine the frequency of times of positive probability of return to a state or set.
Publié le : 1990-04-14
Classification:  Markov chains in random environments,  products of random stochastic matrices,  direct convergence,  Kingman's subadditive ergodic theorem,  60J10,  60J99
@article{1176990850,
     author = {Cogburn, Robert},
     title = {On Direct Convergence and Periodicity for Transition Probabilities of Markov Chains in Random Environments},
     journal = {Ann. Probab.},
     volume = {18},
     number = {4},
     year = {1990},
     pages = { 642-654},
     language = {en},
     url = {http://dml.mathdoc.fr/item/1176990850}
}
Cogburn, Robert. On Direct Convergence and Periodicity for Transition Probabilities of Markov Chains in Random Environments. Ann. Probab., Tome 18 (1990) no. 4, pp.  642-654. http://gdmltest.u-ga.fr/item/1176990850/