If $M$ is not convex, and the underlying density is multi-modal, $M$-estimators can be inconsistent. Examples are given, as well as some positive results.
@article{1176345786,
author = {Freedman, D. A. and Diaconis, P.},
title = {On Inconsistent $M$-Estimators},
journal = {Ann. Statist.},
volume = {10},
number = {1},
year = {1982},
pages = { 454-461},
language = {en},
url = {http://dml.mathdoc.fr/item/1176345786}
}
Freedman, D. A.; Diaconis, P. On Inconsistent $M$-Estimators. Ann. Statist., Tome 10 (1982) no. 1, pp. 454-461. http://gdmltest.u-ga.fr/item/1176345786/