Transformation of Observations in Stochastic Approximation
Abdelhamid, Sami Naguib
Ann. Statist., Tome 1 (1973) no. 2, p. 1158-1174 / Harvested from Project Euclid
The general stochastic approximation procedure: $X_{n+1} = X_n - a_n c_n^{-1}h(Y_n),\quad n = 1,2, \cdots$ is considered, where $h$ is a Borel measurable transformation on the random observations $Y_n$. Under some mild requirements on $h$ and on the error random variables, the asymptotic properties, the a.s. convergence and the asymptotic normality are studied. The analysis is confined to the case where the error random variables are (conditionally) distributed according to a distribution function $G$ which is symmetric around 0 and admits a density $g$. The optimal choices of the design sequences $a_n$ and $c_n$ as well as the transformation $h$ are studied. The optimal transformation turned out to be equal to $-C(g'/g)$ (a.e. with respect to $G$) for a $C > 0$ and it is the transformation which minimizes the second moment of the asymptotic distribution of $n^\beta(X_n - \theta)$. The Robbins-Monro and the Kiefer-Wolfowitz situations are emphasized as special cases. With the optimal transformation, the new proposed generalized procedure is shown to yield asymptotically efficient estimators.
Publié le : 1973-11-14
Classification:  Transformation of observations,  optimal transformation,  stochastic approximation procedure,  optimal procedure,  Robbins-Monro situation,  asymptotically efficient estimators,  Kiefer-Wolfowitz situation
@article{1176342564,
     author = {Abdelhamid, Sami Naguib},
     title = {Transformation of Observations in Stochastic Approximation},
     journal = {Ann. Statist.},
     volume = {1},
     number = {2},
     year = {1973},
     pages = { 1158-1174},
     language = {en},
     url = {http://dml.mathdoc.fr/item/1176342564}
}
Abdelhamid, Sami Naguib. Transformation of Observations in Stochastic Approximation. Ann. Statist., Tome 1 (1973) no. 2, pp.  1158-1174. http://gdmltest.u-ga.fr/item/1176342564/