Decentralized Approximate Newton Methods for In-Network Optimization
Wei, Hejie ; Qu, Zhihai ; Wu, Xuyang ; Wang, Hao ; Lu, Jie
arXiv, Tome 2019 (2019) no. 0, / Harvested from
This paper proposes a set of Decentralized Approximate Newton (DEAN) methods for addressing in-network convex optimization, where nodes in a network seek for a consensus that minimizes the sum of their individual objective functions through local interactions only. The proposed DEAN algorithms allow each node to repeatedly take a local approximate Newton step, so that the nodes not only jointly emulate the (centralized) Newton method but also drive each other closer. Under weaker assumptions in comparison with most existing distributed Newton-type methods, the DEAN algorithms enable all the nodes to asymptotically reach a consensus that can be arbitrarily close to the optimum. Also, for a particular DEAN algorithm, the consensus error among the nodes vanishes at a linear rate and the iteration complexity to achieve any given accuracy in optimality is provided. Furthermore, when the optimization problem reduces to a quadratic program, the DEAN algorithms are guaranteed to linearly converge to the exact optimal solution.
Publié le : 2019-03-22
Classification:  Mathematics - Optimization and Control
@article{1903.09481,
     author = {Wei, Hejie and Qu, Zhihai and Wu, Xuyang and Wang, Hao and Lu, Jie},
     title = {Decentralized Approximate Newton Methods for In-Network Optimization},
     journal = {arXiv},
     volume = {2019},
     number = {0},
     year = {2019},
     language = {en},
     url = {http://dml.mathdoc.fr/item/1903.09481}
}
Wei, Hejie; Qu, Zhihai; Wu, Xuyang; Wang, Hao; Lu, Jie. Decentralized Approximate Newton Methods for In-Network Optimization. arXiv, Tome 2019 (2019) no. 0, . http://gdmltest.u-ga.fr/item/1903.09481/