Adaptive Dantzig density estimation
Bertin, K. ; Le Pennec, E. ; Rivoirard, V.
Ann. Inst. H. Poincaré Probab. Statist., Tome 47 (2011) no. 1, p. 43-74 / Harvested from Project Euclid
The aim of this paper is to build an estimate of an unknown density as a linear combination of functions of a dictionary. Inspired by Candès and Tao’s approach, we propose a minimization of the ℓ1-norm of the coefficients in the linear combination under an adaptive Dantzig constraint coming from sharp concentration inequalities. This allows to consider a wide class of dictionaries. Under local or global structure assumptions, oracle inequalities are derived. These theoretical results are transposed to the adaptive Lasso estimate naturally associated to our Dantzig procedure. Then, the issue of calibrating these procedures is studied from both theoretical and practical points of view. Finally, a numerical study shows the significant improvement obtained by our procedures when compared with other classical procedures.
Publié le : 2011-02-15
Classification:  Calibration,  Concentration inequalities,  Dantzig estimate,  Density estimation,  Dictionary,  Lasso estimate,  Oracle inequalities,  Sparsity,  62G07,  62G05,  62G20
@article{1294170229,
     author = {Bertin, K. and Le Pennec, E. and Rivoirard, V.},
     title = {Adaptive Dantzig density estimation},
     journal = {Ann. Inst. H. Poincar\'e Probab. Statist.},
     volume = {47},
     number = {1},
     year = {2011},
     pages = { 43-74},
     language = {en},
     url = {http://dml.mathdoc.fr/item/1294170229}
}
Bertin, K.; Le Pennec, E.; Rivoirard, V. Adaptive Dantzig density estimation. Ann. Inst. H. Poincaré Probab. Statist., Tome 47 (2011) no. 1, pp.  43-74. http://gdmltest.u-ga.fr/item/1294170229/