Consistent group selection in high-dimensional linear regression
Wei, Fengrong ; Huang, Jian
Bernoulli, Tome 16 (2010) no. 1, p. 1369-1384 / Harvested from Project Euclid
In regression problems where covariates can be naturally grouped, the group Lasso is an attractive method for variable selection since it respects the grouping structure in the data. We study the selection and estimation properties of the group Lasso in high-dimensional settings when the number of groups exceeds the sample size. We provide sufficient conditions under which the group Lasso selects a model whose dimension is comparable with the underlying model with high probability and is estimation consistent. However, the group Lasso is, in general, not selection consistent and also tends to select groups that are not important in the model. To improve the selection results, we propose an adaptive group Lasso method which is a generalization of the adaptive Lasso and requires an initial estimator. We show that the adaptive group Lasso is consistent in group selection under certain conditions if the group Lasso is used as the initial estimator.
Publié le : 2010-11-15
Classification:  group selection,  high-dimensional data,  penalized regression,  rate consistency,  selection consistency
@article{1290092910,
     author = {Wei, Fengrong and Huang, Jian},
     title = {Consistent group selection in high-dimensional linear regression},
     journal = {Bernoulli},
     volume = {16},
     number = {1},
     year = {2010},
     pages = { 1369-1384},
     language = {en},
     url = {http://dml.mathdoc.fr/item/1290092910}
}
Wei, Fengrong; Huang, Jian. Consistent group selection in high-dimensional linear regression. Bernoulli, Tome 16 (2010) no. 1, pp.  1369-1384. http://gdmltest.u-ga.fr/item/1290092910/