In this paper we derive an asymptotic normality result for an adaptive trimmed likelihood estimator of regression starting from initial high breakdownpoint robust regression estimates. The approach leads to quickly and easily computed robust and efficient estimates for regression. A highlight of the method is that it tends automatically in one algorithm to expose the outliers and give least squares estimates with the outliers removed. The idea is to begin with a rapidly computed consistent robust estimator such as the least median of squares (LMS) or least trimmed squares (LTS) or for example the more recent MM estimators of Yohai. Such estimators are now standard in statistics computing packages, for example as in SPLUS or R. In addition to the asymptotics we provide data analyses supporting the new adaptive approach. This approach appears to work well on a number of data sets and is quicker than the related brute force adaptive regression approach described in Clarke (2000). This current approach builds on the work of Bednarski and Clarke (2002) which considered the asymptotics for the location estimator only.
@article{bwmeta1.element.bwnjournal-article-doi-10_7151_dmps_1128,
author = {Tadeusz Bednarski and Brenton R. Clarke and Daniel Schubert},
title = {Adaptive trimmed likelihood estimation in regression},
journal = {Discussiones Mathematicae Probability and Statistics},
volume = {30},
year = {2010},
pages = {203-219},
zbl = {1272.62027},
language = {en},
url = {http://dml.mathdoc.fr/item/bwmeta1.element.bwnjournal-article-doi-10_7151_dmps_1128}
}
Tadeusz Bednarski; Brenton R. Clarke; Daniel Schubert. Adaptive trimmed likelihood estimation in regression. Discussiones Mathematicae Probability and Statistics, Tome 30 (2010) pp. 203-219. http://gdmltest.u-ga.fr/item/bwmeta1.element.bwnjournal-article-doi-10_7151_dmps_1128/
[000] [1] T. Bednarski and B.R. Clarke, Trimmed likelihood estimation of location and scale of the normal distribution, Austral. J. Statist. 35 (1993), 141-153. | Zbl 0798.62043
[001] [2] T. Bednarski and B.R. Clarke, Asymptotics for an adaptive trimmed likelihood location estimator, Statistics 36 (2002), 1-8. | Zbl 0995.62025
[002] [3] P. Billingsley, Convergence of Probability Measures. New York: John Wiley 1968. | Zbl 0172.21201
[003] [4] R.W. Butler, Nonparametric interval and point prediction using data trimmed by a Grubbs-type outlier rule, Ann. Statist. 10 (1982), 197-204 | Zbl 0487.62040
[004] [5] B.R. Clarke, Empirical evidence for adaptive confidence intervals and identification of outliers using methods of trimming, Austral. J. Statist. 36 (1994), 45-58. | Zbl 0825.62418
[005] [6] B.R. Clarke, An adaptive method of estimation and outlier detection in regression applicable for small to moderate sample sizes, Discussiones Mathematicae, Probability and Statistics 20 (2000), 25-50. | Zbl 0971.62034
[006] [7] Y. Dodge and J. Jurečková, Adaptive combination of least squares and least absolute deviation estimators, in: Statistical Data Analysis Based on the L₁-Norm and Related Methods ed. Y. Dodge, North Holland, Elsevier Science Publishers 1987.
[007] [8] Y. Dodge and J. Jurečková, Adaptive choice of trimming proportion in trimmed least-squares estimation, Statistics & Probability Letters 33 (1997), 167-176. | Zbl 1064.62540
[008] [9] Y. Dodge and J. Jurečková, Adaptive Regression, New York, Springer-Verlag 2000. | Zbl 0943.62063
[009] [10] D. Gamble, The Analysis of Contaminated Tidal Data, PhD Thesis, Murdoch University, Western Australia 1999.
[010] [11] F.R. Hampel, E.M. Ronchetti, P.J. Rousseeuw and W.A. Stahel, Robust Statistics: The Approach Based on Influence Functions, New York, Wiley 1986. | Zbl 0593.62027
[011] [12] P.J. Huber, The behaviour of maximum likelihood estimates under nonstandard conditions, Proc. Fifth Berkeley Symposium on Mathematical Statistics and Probability 1 (1967), 73-101.
[012] [13] P.J. Huber, Robust Statistical Procedures, 2nd ed., CBMS-NSF, Regional Conference Series in Applied Mathematics, Society for Industrial and Applied Mathematics, Philadelphia 1996. | Zbl 0859.62003
[013] [14] L.A. Jaeckel, Some flexible estimates of location, Ann. Math. Statist. 42 (1971), 1540-1552. | Zbl 0232.62008
[014] [15] J. Jurečková, R. Koenker and A.H. Welsh, Adaptive choice of trimming proportions, Ann. Inst. Statist. Math., 46 (1994), 737-755. | Zbl 0822.62019
[015] [16] N.M. Neykov and C.H. Müller, Breakdown point and computation of trimmed likelihood estimators in generalized linear models, Developments in robust statistics (Vorau 2001), Heidelberg, Physica 2003. | Zbl 05280058
[016] [17] C.H. Müller and N. Neykov, Breakdown points of trimmed likelihood estimators and related estimators in generalized linear models, J. Statist. Plann. Inference 116 (2004), 503-519. | Zbl 1178.62074
[017] [18] P.J. Rousseeuw, Multivariate estimation with high breakdown point, pp. 283-297 in: Mathematical Statistics and Applications. Vol.B, (1985), eds. Grossman, Pflug, Vincze and Wertz, Dordrecht:Reidel Publishing Co 1983.
[018] [19] P.J. Rousseeuw, Least Median of Squares Regression, Journal of the American Statistical Association 79 (1984), 871-880. | Zbl 0547.62046
[019] [20] P.J. Rousseeuw and A.M. Leroy, Robust Regression and Outlier Detection. New York, Wiley 1987. | Zbl 0711.62030
[020] [21] D.L. Vandev and N.M. Neykov, Robust maximum likelihood in the Gaussian case, p. 259-264 in: New Directions in Data Analysis and Robustness, Morgenthaler, S., Ronchetti, E. and Stahel, W.A. (eds.), Birkhäuser Verlag, Basel 1993. | Zbl 0819.62049