Extremum estimators are obtained by maximizing or minimizing a function of the sample and of the parameters relatively to the parameters. When the function to maximize or minimize is the sum of subfunctions each depending on one observation, the extremum estimators are additive. Maximum likelihood estimators are extremum additive whenever the observations are independent. Another instance of additive extremum estimators are the least squares estimators for multiple regressions when the usual assumptions hold. A strong law of large numbers is derived for additive extremum estimators. This law requires only the existence of first order moments and may be of interest in connection with maximum likelihood estimators, since the usual assumption that the observations are identically distributed is discarded.
@article{bwmeta1.element.bwnjournal-article-doi-10_7151_dmps_1021,
author = {Jo\~ao Tiago Mexia and Pedro Corte Real},
title = {Strong law of large numbers for additive extremum estimators},
journal = {Discussiones Mathematicae Probability and Statistics},
volume = {21},
year = {2001},
pages = {81-88},
zbl = {1013.62075},
language = {en},
url = {http://dml.mathdoc.fr/item/bwmeta1.element.bwnjournal-article-doi-10_7151_dmps_1021}
}
João Tiago Mexia; Pedro Corte Real. Strong law of large numbers for additive extremum estimators. Discussiones Mathematicae Probability and Statistics, Tome 21 (2001) pp. 81-88. http://gdmltest.u-ga.fr/item/bwmeta1.element.bwnjournal-article-doi-10_7151_dmps_1021/
[000] [1] N. Bac Van, Strong convergence of least squares estimates in polynomial regression with random explanatory variables, Acta Mathematica Vietnamica 23 (2) (1998), 195-205. | Zbl 1054.62522
[001] [2] N. Bac Van, Strong convergence of least squares estimates in polynomial regression with random explanatory variables, Acta Mathematica Vietnamica 19 (1) (1994), 111-137.
[002] [3] J. Galambos, Advanced Probability Theory, Marcel Dekker 1988. | Zbl 0681.60005
[003] [4] J.T. Mexia and P.C. Real, Extension of Kolmogorov's strong law to multiple regression, 23rd European Meeting of Statisticians, Funchal (Madeira Island), August 13-18 2001, Revista de Estatística, 2 Quadrimestre de 2001, 277-278.
[004] [5] D. Williams, Probability with Martingales, Cambridge Mathematical Textbooks 1991. | Zbl 0722.60001
[005] [6] S. Zacks, The Theory of Statistical Inference, John Wiley 1971.