Abstract

A new relaxed variant of interior point method for low-rank semidefinite programming problems is proposed in this paper. The method is a step outside of the usual interior point framework. In anticipation to converging to a low-rank primal solution, a special nearly low-rank form of all primal iterates is imposed. To accommodate such a (restrictive) structure, the first order optimality conditions have to be relaxed and are therefore approximated by solving an auxiliary least-squares problem. The relaxed interior point framework opens numerous possibilities how primal and dual approximated Newton directions can be computed. In particular, it admits the application of both the first- and the second-order methods in this context. The convergence of the method is established. A prototype implementation is discussed and encouraging preliminary computational results are reported for solving the SDP-reformulation of matrix-completion problems.

Highlights

  • We are concerned with an application of an interior point method (IPM) for solving large, sparse and specially structured positive semidefinite programming problems (SDPs)

  • Applications include problems arising in engineering, finance, optimal control, power flow, various SDP relaxations of combinatorial optimization problems, matrix completion or other applications originating from modern computational statistics and machine learning

  • We focus on the linear algebra phase and present a matrix-free implementation well suited for structured constraint matrices as those arising in the SDP reformulation of matrix completion problems [13]

Read more

Summary

Introduction

We are concerned with an application of an interior point method (IPM) for solving large, sparse and specially structured positive semidefinite programming problems (SDPs). When positive semidefinite programs are solved using interior-point algorithms, because of the nature of logarithmic barrier function promoting the presence of nonzero eigenvalues, the primal variable X typically converges to a maximum-rank solution [24,34]. Special low-rank structure of X may be imposed directly in problem (1.1), but this excludes the use of an interior point algorithm (which requires all iterates X to be strictly positive definite). We would like to preserve as many of the advantageous properties of interior point methods as possible and expect to achieve it by (i) working with the original problem (1.1) and (ii) exploiting the low-rank structure of X. Knowing that at optimality X is low-rank we impose a special form of the primal variable throughout the interior point algorithm.

46 Page 4 of 36
Relaxed Interior Point Method for Low-Rank SDP
46 Page 6 of 36
Solving the Nonlinear Least-Squares Problem
Matrix–Vector Products with Blocks of J k
Computational Effort Per Iteration
Nonlinear Gauss–Seidel Approach
4: Compute a Gauss–Newton step U for min
46 Page 14 of 36
Preconditioning JT22J22
46 Page 16 of 36
SDP Reformulation of Matrix Completion Problems
46 Page 18 of 36
Numerical Experiments on Matrix Completion Problems
Tests on Random Matrices
46 Page 20 of 36
46 Page 22 of 36
46 Page 24 of 36
46 Page 28 of 36
Tests on Real Data Sets
46 Page 30 of 36
46 Page 32 of 36
Conclusions
Findings
46 Page 36 of 36
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call