Asymptotically minimax regret procedures in regression model selection and the magnitude of the dimension penalty
Goldenshluger, Alexander ; Greenshtein, Eitan
Ann. Statist., Tome 28 (2000) no. 3, p. 1620-1637 / Harvested from Project Euclid
This paper addresses the topic of model selection in regression.We emphasize the case of two models, testing which model provides a better prediction based on $n$ observations. Within a family of selection rules, based on maximizing a penalized log-likelihood under a normal model, we search for asymptotically minimax rules over a class $\mathscr{G}$ of possible joint distributions of the explanatory and response variables. For the class $\mathscr{G}$ of multivariate normal joint distributions it is shown that asymptotically minimax selection rules are close to the AIC selection rule when the models’ dimension difference is large. It is further proved that under fairly mild assumptions on $\mathscr{G}$ any asymptotically minimax sequence of procedures satisfies the condition that the difference in their dimension penalties is bounded as the number of observations approaches infinity. The results are then extended to the case of more than two competing models.
Publié le : 2000-12-14
Classification:  Model selection,  regression,  minimax procedures,  62J05,  62C20
@article{1015957473,
     author = {Goldenshluger, Alexander and Greenshtein, Eitan},
     title = {Asymptotically minimax regret procedures in regression model
			 selection and the magnitude of the dimension penalty},
     journal = {Ann. Statist.},
     volume = {28},
     number = {3},
     year = {2000},
     pages = { 1620-1637},
     language = {en},
     url = {http://dml.mathdoc.fr/item/1015957473}
}
Goldenshluger, Alexander; Greenshtein, Eitan. Asymptotically minimax regret procedures in regression model
			 selection and the magnitude of the dimension penalty. Ann. Statist., Tome 28 (2000) no. 3, pp.  1620-1637. http://gdmltest.u-ga.fr/item/1015957473/