We study the binary classification problem with hinge loss. We consider classifiers that are linear combinations of base functions. Instead of an [math] penalty, which is used by the support vector machine, we put an [math] penalty on the coefficients. Under certain conditions on the base functions, hinge loss with this complexity penalty is shown to lead to an oracle inequality involving both model complexity and margin.
Publié le : 2006-12-14
Classification:
binary classification,
hinge loss,
margin,
oracle inequality,
penalized classification rule,
sparsity
@article{1165269150,
author = {Tarigan, Bernadetta and Van De Geer, Sara A.},
title = {Classifiers of support vector machine type with \ell1 complexity regularization},
journal = {Bernoulli},
volume = {12},
number = {2},
year = {2006},
pages = { 1045-1076},
language = {en},
url = {http://dml.mathdoc.fr/item/1165269150}
}
Tarigan, Bernadetta; Van De Geer, Sara A. Classifiers of support vector machine type with \ell1 complexity regularization. Bernoulli, Tome 12 (2006) no. 2, pp. 1045-1076. http://gdmltest.u-ga.fr/item/1165269150/