Parallel majorization minimization with dynamically restricted domains for nonconvex optimization


Conference Paper

Copyright 2016 by the authors. We propose an optimization framework for nonconvex problems based on majorization-minimization that is particularity well-suited for parallel computing. It reduces the optimization of a high dimensional nonconvex objective function to successive optimizations of locally tight and convex upper bounds which are additively separable into low dimensional objectives. The original problem is then broken into simpler parallel sub-problems while still guaranteeing the monotonic reduction of the original objective function and convergence to a local minimum. Due to the low dimensionality of each sub-problem, second-order optimization methods become computationally feasible and can be used to accelerate convergence. In addition, the upper bound can be restricted to a local dynamic convex domain, so that it is better matched to the local curvature of the objective function, resulting in accelerated convergence.

Duke Authors

Cited Authors

  • Kaganovsky, Y; Odinaka, I; Carlson, D; Carin, L

Published Date

  • January 1, 2016

Published In

  • Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, Aistats 2016

Start / End Page

  • 1497 - 1505

Citation Source

  • Scopus