We answer two open questions concerning the existence of universal
schemes for classification and regression estimation from stationary ergodic
processes. It is shown that no measurable procedure can produce weakly
consistent regression estimates from every bivariate stationary ergodic
process, even if the covariate and response variables are restricted to take
values in the unit interval. It is further shown that no measurable procedure
can produce weakly consistent classification rules from every bivariate
stationary ergodic process for which the response variable is binary valued.
The results of the paper are derived via reduction arguments and are based in
part on recent work concerning density estimaton from ergodic processes.
@article{1018031110,
author = {Nobel, Andrew B.},
title = {Limits to classification and regression estimation from ergodic
processes},
journal = {Ann. Statist.},
volume = {27},
number = {4},
year = {1999},
pages = { 262-273},
language = {en},
url = {http://dml.mathdoc.fr/item/1018031110}
}
Nobel, Andrew B. Limits to classification and regression estimation from ergodic
processes. Ann. Statist., Tome 27 (1999) no. 4, pp. 262-273. http://gdmltest.u-ga.fr/item/1018031110/