Zero-sum continuous-time Markov games with unbounded transition and discounted payoff rates
Guo, Xianping ; Hernández-Lerma, Onésimo
Bernoulli, Tome 11 (2005) no. 1, p. 1009-1029 / Harvested from Project Euclid
This paper is concerned with two-person zero-sum games for continuous-time Markov chains, with possibly unbounded payoff and transition rate functions, under the discounted payoff criterion. We give conditions under which the existence of the value of the game and a pair of optimal stationary strategies is ensured by using the optimality (or Shapley) equation. We prove the convergence of the value iteration scheme to the game's value and to a pair of optimal stationary strategies. Moreover, when the transition rates are bounded we further show that the convergence of value iteration is exponential. Our results are illustrated with a controlled queueing system with unbounded transition and reward rates.
Publié le : 2005-12-14
Classification:  controlled Q-process,  discounted payoffs,  value of the game,  zero-sum Markov games
@article{1137421638,
     author = {Guo, Xianping and Hern\'andez-Lerma, On\'esimo},
     title = {Zero-sum continuous-time Markov games with unbounded transition and discounted payoff rates},
     journal = {Bernoulli},
     volume = {11},
     number = {1},
     year = {2005},
     pages = { 1009-1029},
     language = {en},
     url = {http://dml.mathdoc.fr/item/1137421638}
}
Guo, Xianping; Hernández-Lerma, Onésimo. Zero-sum continuous-time Markov games with unbounded transition and discounted payoff rates. Bernoulli, Tome 11 (2005) no. 1, pp.  1009-1029. http://gdmltest.u-ga.fr/item/1137421638/