Neural Network Training via Quadratic Programming
Couellan, Nicolas ; Trafalis, Theodore B.
HAL, hal-01922634 / Harvested from HAL
We develop two new training algorithms for feed forward supervised neural networks based on quadratic optimization methods. Specifically, we approximate the error function by a quadratic convex function. In the first algorithm, the new error function is optimized by an affine scaling method, which replaces the steepest descent method in the back propagation algorithm. In the second algorithm, the steepest descent method is replaced by a trust region technique. Comparative numerical simulations for medical diagnosis problems show significant reductions in learning time with respect to the back propagation algorithm.
Publié le : 1997-07-04
Classification:  [MATH.MATH-OC]Mathematics [math]/Optimization and Control [math.OC],  [INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG]
@article{hal-01922634,
     author = {Couellan, Nicolas and Trafalis, Theodore B.},
     title = {Neural Network Training via Quadratic Programming},
     journal = {HAL},
     volume = {1997},
     number = {0},
     year = {1997},
     language = {en},
     url = {http://dml.mathdoc.fr/item/hal-01922634}
}
Couellan, Nicolas; Trafalis, Theodore B. Neural Network Training via Quadratic Programming. HAL, Tome 1997 (1997) no. 0, . http://gdmltest.u-ga.fr/item/hal-01922634/