In this paper the adaptive control problem for a continuous infinite time-varying stochastic control system with jumps in parameters and quadratic cost is investigated. It is assumed that the unknown coefficients of the system have limits as time tends to infinity and the boundary system is absolutely observable and stabilizable. Under these assumptions it is shown that the optimal value of the quadratic cost can be reached based only on the values of these limits, which, in turn, can be estimated through strongly consistent estimators.
@article{bwmeta1.element.bwnjournal-article-amcv15i1p53bwm,
author = {Czornik, Adam and \'Swiernik, Andrzej},
title = {On adaptive control for the continuous time-varying JLQG problem},
journal = {International Journal of Applied Mathematics and Computer Science},
volume = {15},
year = {2005},
pages = {53-62},
zbl = {1083.93030},
language = {en},
url = {http://dml.mathdoc.fr/item/bwmeta1.element.bwnjournal-article-amcv15i1p53bwm}
}
Czornik, Adam; Świernik, Andrzej. On adaptive control for the continuous time-varying JLQG problem. International Journal of Applied Mathematics and Computer Science, Tome 15 (2005) pp. 53-62. http://gdmltest.u-ga.fr/item/bwmeta1.element.bwnjournal-article-amcv15i1p53bwm/
[000] Abou-Kandil H., Freiling G. and Jank G. (1994): Solution and asymptotic behavior of coupled Riccati equations in jump linear systems. - IEEE Trans. Automat. Contr., Vol. 39, No. 8, pp. 1631-1636. | Zbl 0925.93387
[001] Abou-Kandil H., Freiling G. and Jank G. (1995): On the solution of discrete-time Markovian jump linear quadratic control problems. - Automatica, Vol. 31, No. 5, pp. 765-768. | Zbl 0822.93074
[002] Afanas'ev V.N., Kolmanovskij V.B. and Nosov V.R. (1989): Mathematical Theory of Control System Design. - Moscow: Vyssha Shkola, (in Russian).
[003] Blom H.A.P.(1990): Bayesian estimation for decision-directed stochastic control. - Amsterdam, The Netherlands: Technical Univ. Delft Press.
[004] Boukas E.K. and Haurie A. (1990): Manufacturing flow control andpreventive maintenance: A stochastic control approach - IEEE Trans. Automat. Contr., Vol. 35, No. 9, pp. 1024-1031. | Zbl 0718.90036
[005] Costa L.V. and Fragoso M.D. (1995): Discrete-time LQ-optimal control problems for infinite markov jump parameter systems. - IEEE Trans. Automat. Contr., Vol. 40, pp. 2076-2088. | Zbl 0843.93091
[006] Chizeck H.J., Willsky A.S. and Castanon D. (1998): Discrete-time markovian-jump linear quadratic optimal control. -Int. J. Contr., Vol. 43, No. 2, pp. 213-231. | Zbl 0591.93067
[007] Czornik A. (1998): On time-varying LQG. - Proc. IFAC Conf. Syst. Struc. Contr., Nantes, France, pp. 427-432.
[008] Czornik A. (1999): On discrete-time linear quadratic-control. - Syst. Contr. Lett., Vol. 36, No. 2, pp. 101-107. | Zbl 0914.93068
[009] Czornik A. (2000): Continuity of the solution of the Riccati equations for continuous time JLQP. - IEEE Trans. Automat. Contr., Vol. 45, No. 5, pp. 934-937. | Zbl 0977.34062
[010] Czornik A. and Swierniak A. (2001): On the discrete JLQ and JLQG problems. - Nonlin. Anal., Vol. 47, No. 1, pp. 423-434. | Zbl 1042.49537
[011] Czornik A. and Swierniak A. (2002): On the discrete time-varying JLQG problem. - Int. J. Appl. Math. Comput. Sci., Vol. 12, No. 2, pp. 101-105. | Zbl 1049.93087
[012] Czornik A. (2004): Adaptive control for jump linear system with quadratic cost. - Contr. Cybern., Vol. 33, No. 1, pp. 51-71 . | Zbl 1121.49034
[013] Czornik A. and Swierniak A. (2004): On the continuous time-varying JLQ problem. - Europ. J. Contr, Vol. 10, No. 3, pp. 264-272. | Zbl 1293.49077
[014] Duncan T.E., Guo L. and Pasik-Duncan B. (1999): Adaptive continous-time linear quadratic gaussian control. - IEEE Trans. Automat. Contr., Vol. 44, No. 9, pp. 1653-1662. | Zbl 0963.93080
[015] Dufour F. and Elliott R. (1998): Adaptive control for linear systems with Markov perturbations. - IEEE Trans. Automat.Contr., Vol. 43, No. 3, pp. 351-372. | Zbl 0919.93085
[016] Feng X., Loparo K.A., Ji Y. and Chizeck H.J. (1992): Stochastic stability properties of jump linear systems. - IEEE Trans. Automat. Contr., Vol. 37, No. 3, pp. 38-53. | Zbl 0747.93079
[017] Ghosh M.K. (1995): On an LQG regulator with Markovian switching and pathwise average cost. - IEEE Trans. Automat. Contr., Vol. 40, No. 4, pp. 1919-1921. | Zbl 0843.93090
[018] Griffiths B.E. and Loparo K. (1985): Optimal control of jump-linear Gaussian systems. - Int. J. Contr., Vol. 42, No. 5, pp.791-819. | Zbl 0583.93070
[019] Guo L. (1996): Self-convergence of weighted least-squares with applications to stochastic adaptive control. - IEEE Trans. Automat. Contr., Vol. 41, No. 1, pp. 79-89. | Zbl 0844.93081
[020] Ji Y. and Chizeck H.J. (1988): Controllability, observability and discrete-time Markovian jump linear quadratic control. - Int. J. Contr., Vol. 48, No. 6, pp. 481-498. | Zbl 0669.93007
[021] Ji Y. and Chizeck H.J. (1989): Optimal quadratic control of jump linear systems with seperately controlled transition probabilities. - Int. J. Contr., Vol. 49, No. 2, pp. 481-491. | Zbl 0677.93071
[022] Ji Y. and Chizeck H.J. (1990): Controllability, stability, and continuous-time Markovian jump linear quadratic control. - IEEE Trans. Automat. Contr., Vol. 35, No. 7, pp. 777-788. | Zbl 0714.93060
[023] Mariton M. (1987): Jump linear quadratic control with random state discontinuities. - Automatica, Vol. 23, No. 3, pp. 237-140. | Zbl 0628.93074
[024] Mariton M. (1990): Jump Linear Systems in Automatic Control.- New York: Marcel Dekker.
[025] Pan G. and Bar-Shalom Y. (1996): Stabilization of jump linear Gaussian systems without mode observations. - Int.J. Contr., Vol. 64, No. 7, pp. 631-666. | Zbl 0857.93095
[026] Prandini M. and Campi M.C. (2001): Adaptive LQG control of input-output systems: A cost-biased approach. - SIAM J. Contr.Optim., Vol. 39, No. 5, pp. 1499-1519. | Zbl 0989.93098
[027] Rami Ait M. and El Ghaoui L. (1996): LMI optimization for nonstandard Riccati equations arising in stochastic control. - IEEE Trans. Automat. Contr., Vol. 41, No. 10, pp. 1666-1671. | Zbl 0863.93087
[028] Siljak D.D. (1980): Reliable control Using Multiple Control Systems. - Int. J. Contr., Vol. 31, No. 2, pp. 303-329. | Zbl 0428.93033
[029] Świerniak A., Simek K. and Boukas E.K. (1998): Intelligent robust control of fault tolerant systems, In: Artificial Intelligence in Real-Time Control (H.E. Rauch, Ed.). - Oxford: Elsevier, pp. 245-248.
[030] Sworder D.D. and Rogers R.O. (1983): An LQ-solution to a control problem associated with solar thermal central receiver. - IEEE Trans. Automat. Contr., Vol. 28, No. 4, pp. 971-978.
[031] Sworder D.D. (1969): Feedback control of a class of linear systems with jump parameters. - IEEE Trans. Automat. Contr., Vol. 14, No. 4, pp. 9-14.
[032] Sworder D.D. and Robinson V.G. (1973): Feedback regulators for jump parameter systems with state and control dependent transition rates. - IEEE Trans. Automat. Contr., Vol. 18, No. 3, pp. 355-359. | Zbl 0279.93059
[033] Wonham W.M. (1971): Random differential equations in control theory, In: Probabilistic Methods in Applied Mathematics, Vol. 2 (A.T. Bharucha-Reid, Ed.). - New York: Academic Press. | Zbl 0223.93045