The value function in ergodic control of diffusion processes with partial observations II
Borkar, Vivek
Applicationes Mathematicae, Tome 27 (2000), p. 455-464 / Harvested from The Polish Digital Mathematics Library
Access to full text
Full (PDF)

The problem of minimizing the ergodic or time-averaged cost for a controlled diffusion with partial observations can be recast as an equivalent control problem for the associated nonlinear filter. In analogy with the completely observed case, one may seek the value function for this problem as the vanishing discount limit of value functions for the associated discounted cost problems. This passage is justified here for the scalar case under a stability hypothesis, leading in particular to a "martingale" formulation of the dynamic programming principle.

Publié le : 2000-01-01
EUDML-ID : urn:eudml:doc:219288 
@article{bwmeta1.element.bwnjournal-article-zmv27i4p455bwm,
     author = {Vivek Borkar},
     title = {The value function in ergodic control of diffusion processes with partial observations II},
     journal = {Applicationes Mathematicae},
     volume = {27},
     year = {2000},
     pages = {455-464},
     zbl = {1047.93555},
     language = {en},
     url = {http://dml.mathdoc.fr/item/bwmeta1.element.bwnjournal-article-zmv27i4p455bwm}
}

Borkar, Vivek. The value function in ergodic control of diffusion processes with partial observations II. Applicationes Mathematicae, Tome 27 (2000) pp. 455-464. http://gdmltest.u-ga.fr/item/bwmeta1.element.bwnjournal-article-zmv27i4p455bwm/

[000] D. G. Aronson (1967), Bounds for the fundamental solution of a parabolic equation, Bull. Amer. Math. Soc. 73, 890-896. | Zbl 0153.42002

[001] G. K. Basak, V. S. Borkar and M. K. Ghosh (1997), Ergodic control of degenerate diffusions, Stochastic Anal. Appl. 15, 1-17. | Zbl 0872.93079

[002] A. G. Bhatt and V. S. Borkar (1996), Occupation measures for controlled Markov processes: characterization and optimality, Ann. Probab. 24, 1531-1562. | Zbl 0863.93086

[003] R. N. Bhattacharya (1981), Asymptotic behaviour of several dimensional diffusions, in: Stochastic Nonlinear Systems in Physics, Chemistry and Biology, L. Arnold and R. Lefever (eds.), Springer Ser. Synerg. 8, Springer, Berlin, 86-99.

[004] V. S. Borkar (1989), Optimal Control of Diffusion Processes, Pitman Res. Notes Math. Ser. 203, Longman Sci. and Tech., Harlow. | Zbl 0669.93065

[005] V. S. Borkar (1999), The value function in ergodic control of diffusion processes with partial observations, Stochastics Stochastics Reports 67, 255-266. | Zbl 0947.93038

[006] W. F. Fleming and E. Pardoux (1982), Optimal control of partially observed diffusions, SIAM J. Control Optim. 20, 261-285. | Zbl 0484.93077

[007] N. Ikeda and S. Watanabe (1981), Stochastic Differential Equations and Diffusion Processes, North-Holland, Amsterdam, and Kodansha, Tokyo. | Zbl 0495.60005

[008] C. Striebel (1984), Martingale methods for the optimal control of continuous time stochastic systems, Stochastic Process. Appl. 18, 329-347.