Adaptive Design and Stochastic Approximation
Lai, T. L. ; Robbins, Herbert
Ann. Statist., Tome 7 (1979) no. 1, p. 1196-1221 / Harvested from Project Euclid
When $y = M(x) + \varepsilon$, where $M$ may be nonlinear, adaptive stochastic approximation schemes for the choice of the levels $x_1, x_2, \cdots$ at which $y_1, y_2, \cdots$ are observed lead to asymptotically efficient estimates of the value $\theta$ of $x$ for which $M(\theta)$ is equal to some desired value. More importantly, these schemes make the "cost" of the observations, defined at the $n$th stage to be $\sum^n_1(x_i - \theta)^2$, to be of the order of $\log n$ instead of $n$, an obvious advantage in many applications. A general asymptotic theory is developed which includes these adaptive designs and the classical stochastic approximation schemes as special cases. Motivated by the cost considerations, some improvements are made in the pairwise sampling stochastic approximation scheme of Venter.
Publié le : 1979-11-14
Classification:  Adaptive design,  adaptive stochastic approximation,  regression,  logarithmic cost,  asymptotic normality,  iterated logarithm,  pairwise sampling schemes,  least squares,  62L20,  62K99,  60F15
@article{1176344840,
     author = {Lai, T. L. and Robbins, Herbert},
     title = {Adaptive Design and Stochastic Approximation},
     journal = {Ann. Statist.},
     volume = {7},
     number = {1},
     year = {1979},
     pages = { 1196-1221},
     language = {en},
     url = {http://dml.mathdoc.fr/item/1176344840}
}
Lai, T. L.; Robbins, Herbert. Adaptive Design and Stochastic Approximation. Ann. Statist., Tome 7 (1979) no. 1, pp.  1196-1221. http://gdmltest.u-ga.fr/item/1176344840/