In this paper, we present a result on relaxability of partially observed control problems for infinite dimensional stochastic systems in a Hilbert space. This is motivated by the fact that measure valued controls, also known as relaxed controls, are difficult to construct practically and so one must inquire if it is possible to approximate the solutions corresponding to measure valued controls by those corresponding to ordinary controls. Our main result is the relaxation theorem which states that the set of solutions corresponding to ordinary controls is weakly dense in the set of solutions corresponding to relaxed controls. This is presented in Theorem 5.3 after giving some existence results on optimal controls for the infinite dimensional Zakai equation used for its proof.
@article{bwmeta1.element.bwnjournal-article-doi-10_7151_dmdico_1086,
author = {N.U. Ahmed},
title = {A relaxation theorem for partially observed stochastic control on Hilbert space},
journal = {Discussiones Mathematicae, Differential Inclusions, Control and Optimization},
volume = {27},
year = {2007},
pages = {295-314},
zbl = {1147.93045},
language = {en},
url = {http://dml.mathdoc.fr/item/bwmeta1.element.bwnjournal-article-doi-10_7151_dmdico_1086}
}
N.U. Ahmed. A relaxation theorem for partially observed stochastic control on Hilbert space. Discussiones Mathematicae, Differential Inclusions, Control and Optimization, Tome 27 (2007) pp. 295-314. http://gdmltest.u-ga.fr/item/bwmeta1.element.bwnjournal-article-doi-10_7151_dmdico_1086/
[000] [1] G. Da Prato and J. Zabczyk, Regular Densities of Invariant Measures in Hilbert Spaces, Journal of Functional Analysis 130 (1995), 427-449 . | Zbl 0832.60069
[001] [2] V. Barbu and G. Da Prato, Hamilton Jacobi Equations in Hilbert Spaces, Pitman Res. Notes in Math. 86, Pitman, 1983.
[002] [3] G. Da Prato and J. Zabczyk, Stochastic Equations in Infinite Dimension, Encyclopedia of Mathematics and it's Applications series, 44, Cambridge University Press, 1992.
[003] [4] G. Da Prato, Parabolic Equations in Infinitely Many Variables, Preprint n. 140, Scuola Normale Superiore, Pisa, Sept. 1992.
[004] [5] Q. Zhu and N.U. Ahmed, Some results on parabolic equations in Banach space, Nonlinear Analysis, Theory and Methods 24 (9) (1995), 1305-1319. | Zbl 0839.93078
[005] [6] N.U. Ahmed, Generalized solutions of HJB equations applied to stochastic control on Hilbert space, Nonlinear Analysis 54 (2003), 495-523. | Zbl 1018.93030
[006] [7] N.U. Ahmed, Relaxed controls for stochastic boundary value problems in infinite dimension, Lect. Notes in Contr. and Inf. Sciences 149 (1990), 1-10.
[007] [8] N.U. Ahmed, Existence of optimal relaxed controls for a class of systems governed by differential inclusions on a Banach space, JOTA 50 (2) (1986), 213-237. | Zbl 0577.49025
[008] [9] N.U. Ahmed, Optimal relaxed controls for nonlinear infinite dimensional stochastic differential inclusions, International Symposium on Optimal Control of infinite Dimensional Systems, Lect. Notes in Pure and Applied Math, Marcel Dekker, New York and Basel 160 (1994), 1-19. | Zbl 0854.49006
[009] [10] E.J. Balder, A general denseness result for relaxed control theory, Bull. Austral. Math. Soc. 30 (1984), 463-475. | Zbl 0544.49008
[010] [11] H.O. Fattorini, Relaxation theorems, differential inclusions, and Filippov's theorem for relaxed controls in semilinear infinite dimensional systems, Journal of Differential Equations 112 (1994), 131-153. | Zbl 0806.93028
[011] [12] D. Gątarek and B. Gołdys, On solving stochastic evolution equations by the change of drift with applications to optimal control, Polish Academy of Sciences, (personal communication). | Zbl 0797.60047
[012] [13] W.H. Fleming and E. Pardoux, Optimal control for partially observed diffusions, SIAM J. Contr. Optim. 20 (1982), 261-285. | Zbl 0484.93077
[013] [14] N.J. Cutland and T. Lindström, Random relaxed controls and partially observed stochastic systems, Acta Applicandae Mathematicae 32 (1993), 157-182. | Zbl 0801.93059
[014] [15] O. Hijab, Partially observed control of Markov processes IV, J. Func. Anal. 109 (1992), 215-256. | Zbl 0767.60063
[015] [16] A. Bensoussan, Stochastic Control of Partially Observable Systems, Cambridge University press, 1992. | Zbl 0776.93094
[016] [17] V.S. Borkar, Existence of optimal controls for partially observed diffusions, Stochastics 11 (1983), 103-141. | Zbl 0571.60054
[017] [18] N.U. Ahmed and X. Xiang, Admissible relaxation in optimal control problems for infinite dimensional uncertain systems, J. Appl. Math. and Stoch. Anal. 5 (3) (1993), 227-236.
[018] [19] N.U. Ahmed and J. Zabczyk, Partially observed optimal controls for nonlinear infinite dimensional stochastic systems, Dynamic Systems and Applications 5 (1996), 521-538. | Zbl 0866.93099
[019] [20] J. Diestel and J.J. Uhl, Jr., Vector Measures, Mathematical Surveys, 15, AMS, American Mathematical Society, Providence, Rhode Island, 1977.
[020] [21] N.U. Ahmed and K.L. Teo, Optimal Control of Distributed Parameter Systems, North Holland, New York Oxford, 1981. | Zbl 0472.49001
[021] [22] S.H. Hou, On property (Q) and other semicontinuity properties of multifunctions, Pacific J. Math. 103 (1) (1992), 39-56. | Zbl 0451.54015
[022] [23] N.U. Ahmed, Optimal relaxed controls for infinite dimensional stochastic systems of Zakai type, SIAM J. Control and Optimization 34 (5) (1996), 1592-1615. | Zbl 0861.93030
[023] [24] N.U. Ahmed, M. Fuhrman and J. Zabczyk, On filtering equations in infinite dimensions, J. Func. Anal. 143 (1) (1997), 180-204. | Zbl 0880.60043
[024] [25] N. Dunford and J.T. Schwartz, Linear Operators, Part 1, Interscience Publishers, Inc., New York, 1964.
[025] [26] K.R. Parthasarathy, Probability Measures on Metric Spaces, Academic Press, New York and London, 1967. | Zbl 0153.19101