Les algorithmes stochastiques contournent-ils les pièges ?
Brandière, Odile ; Duflo, Marie
Annales de l'I.H.P. Probabilités et statistiques, Tome 32 (1996), p. 395-427 / Harvested from Numdam
Access to full text
Full (PDF)
Full (DJVU) 
@article{AIHPB_1996__32_3_395_0,
     author = {Brandi\`ere, Odile and Duflo, Marie},
     title = {Les algorithmes stochastiques contournent-ils les pi\`eges ?},
     journal = {Annales de l'I.H.P. Probabilit\'es et statistiques},
     volume = {32},
     year = {1996},
     pages = {395-427},
     mrnumber = {1387397},
     zbl = {0849.62043},
     language = {fr},
     url = {http://dml.mathdoc.fr/item/AIHPB_1996__32_3_395_0}
}

Brandière, Odile; Duflo, Marie. Les algorithmes stochastiques contournent-ils les pièges ?. Annales de l'I.H.P. Probabilités et statistiques, Tome 32 (1996) pp. 395-427. http://gdmltest.u-ga.fr/item/AIHPB_1996__32_3_395_0/

[1] W.J. Barlow, Coefficient properties of random variable sequences. Ann. of probability, vol. 3, 1975, p. 840-848. | MR 388530 | Zbl 0317.60021

[2] A Benveniste, M. Métivier et P. Priouret, Algorithmes adaptatifs et approximations stochastiques. Masson, 1987.

[3] O. Brandière, Un algorithme du gradient pour l'analyse en composantes principales. Comptes Rendus Académie des Sciences, 321, série I, 1995, p. 233-236. | MR 1345454 | Zbl 0836.60035

[4] D.L. Burkholder, Independent sequences with the Stein property, Ann. of math. stat., vol. 39, 1968, p. 1282-1288. | MR 228045 | Zbl 0162.49404

[5] B. Delyon, A deterministic approach to stochastic approximation, IRISA, prépublication n° 789, 1994.

[6] D.P. Derevitskii et A.L. Fradkov, Two models for analysing the dynamics of adaption algorithms. Avtomatika i Telemekhanika, 1, 1974, p. 67-75; en anglais, Automation and remote control, vol. 1, 1974, p. 59-67. | MR 456732 | Zbl 0282.93030

[7] M. Duflo, Méthodes récursives aléatoires. Masson, 1990. | MR 1082344 | Zbl 0703.62084

[8] J.C. Fort et G. Pagès, Sur la convergence presque sûre d'algorithmes stochastiques : le théorème de Kushner-Clark revisité. Prépublication du SAMOS 33, Université Paris 1, 1994.

[9] S.B. Gelfand et S.K. Mitter, Recursive stochastic algorithms for global optimization in Rd. SIAM J. control and optimization, vol. 29, 1991, p. 999-1018. | MR 1110084 | Zbl 0753.65051

[10] S.B. Gelfand et S.K. Mitter, Metropolis-type annealing algorithms for global optimization in Rd. SIAM J. control and optimization, vol. 31, 1993, p. 111-131. | MR 1200226 | Zbl 0814.65059

[11] P. Hartman, Ordinary Differential Equations, Wiley, 1964; seconde édition, 1982. | Zbl 0125.32102

[12] K. Hornik et C.M. Kuan, Convergence analysis of local feature extraction algorithms. Neural networks, vol. 5, 1992, p. 229-240.

[13] C.R. Hwang et S.J. Sheu, On the behaviour of a stochastic algorithm with annealing. Rapport technique, Academia sinica, Taiwan, 1990.

[14] B. Jessen et A. Wintner, Distribution functions and the Riemann zeta function. Trans. american math. soc., vol. 38, 1935, p. 725-734. | MR 1501802 | Zbl 0014.15401

[15] J. Kiefer et J. Wolfowitz, Stochastic estimation of the maximum of a regression fonction. Ann. math. stat., vol. 23, 1952, p. 462-466. | MR 50243 | Zbl 0049.36601

[16] H.J. Kushner, Asymptotic global behavior for stochastic approximation and diffusions with slowly decreasing noise effects: Global minimization via Monte Carlo. SIAM J. Appl. Math., 47, 1987, p. 169-185. | MR 873242 | Zbl 0615.60024

[17] H.J. Kushner et D.S. Clark, Stochastic approximation for constrained and unconstrained systems. Applied math. science series, vol. 26, Springer, 1978. | MR 499560 | Zbl 0381.60004

[18] T.Z. Lai et C.Z. Wei, A note on martingale difference sequences satisfying the local Marcinkiewicz-Zygmund condition. Bull. of the institute of mathematics, Academia Sinica, vol. 11, 1983, p. 1-13. | MR 718896 | Zbl 0517.60054

[19] V.A. Lazarev, Convergence of stochastic-approximation procedures in the case of a regression equation with several roots. Problems of Information Transmission, vol. 28, 1992, p. 66-78; en russe, Problemy Peredachi Informatsii, vol. 28, 1992, p. 75-88. | MR 1163142 | Zbl 0783.62058

[20] P. Lévy, Sur les séries dont les termes sont des variables éventuellement indépendantes. Studia math., vol. 3, 1931, p. 119-155. | JFM 57.0616.01 | Zbl 0003.30301

[21] L. Ljung, Analysis of recursive stochastic algorithms. IEEE Trans. Automatic Control, vol. 22, 1977, p. 551-575. | MR 465458 | Zbl 0362.93031

[22] L. Ljung, G. Pflug et H. Walk, Stochastic approximation of random systems. Birkhäuser, 1992. | MR 1162311 | Zbl 0747.62090

[23] L. Ljung et T. Soderström, Theory and practice of recursive identification, MIT Press, 1983. | MR 719192 | Zbl 0548.93075

[24] S.P. Meyn et R.L. Tweedie, Markov chains and stochastic stability. Springer, 1993. | MR 1287609 | Zbl 0925.60001

[25] M.B. Nevel'Son et R.Z. Has'Minskii, Stochastic approximation and recursive estimations. Nauka, Moscou, 1972 - Translation of math. monographs, vol. 47, American Mathematical Society, 1973. | MR 423714 | Zbl 0355.62075

[26] E. Nummelin, General irreductible Markov chains and nonnegative operators. Cambridge university press, 1984. | MR 776608 | Zbl 0551.60066

[27] E. Oja, Principal networks, principal components, and linear neural networks. Neural networks, vol. 5, 1992, p. 927-935.

[28] E. Oja et J. Karhunen, On stochastic approximation of the eigenvalues of the expectation of a random matrix. J. of math. analysis and appl., vol. 106, 1985, p. 69-84. | MR 780319 | Zbl 0583.62077

[29] H. Poincaré, Mémoire sur les courbes définies par une équation différentielle (IV). J. Math. Pures Appl., vol. 4, 1886, p. 151-217. | JFM 18.0314.01

[30] H. Robbins et S. Monro, A stochastic approximation method. Ann. math. stat., vol. 22, 1951, p. 400-407. | MR 42668 | Zbl 0054.05901

[31] L. Younes, Estimation and annealing gor Gibbsian fields. Ann. Inst. Henri Poincaré, vol. 24, 1988, p. 269-294. | Numdam | MR 953120 | Zbl 0651.62091

[32] L. Younes, Parametric inference of imperfectly observed Gibbsian fields. Probability theory and related fields, vol. 82, 1989, p. 625-645. | MR 1002904 | Zbl 0659.62115

[33] C.Z. Wei, Martingale transforms with non-atomic limits and stochastic approximation. Probability theory and related fieds, vol. 95, 1993, p. 103-114. | MR 1207309 | Zbl 0792.60034

R. Pemantle, Non convergence to unstable points in urn models and stochastic approximations. Ann. of Probability, vol. 18, 1990, p. 698-712. | MR 1055428 | Zbl 0709.60054