We propose a framework for building preconditioners for sequences of linear systems of the form $(A+Delta_k) x_k=b_k$, where $A$ is symmetric positive semidefinite and $Delta_k$ is diagonal positive semidefinite. Such sequences arise in several optimization methods, e.g., in affine-scaling methods for bound-constrained convex quadratic programming and bound-constrained linear least squares, as well as in trust-region and overestimation methods for convex unconstrained optimization problems and nonlinear least squares. For all the matrices of a sequence, the preconditioners are obtained by updating any preconditioner for $A$ available in the $LDL^T$ form. The preconditioners in the framework satisfy the natural requirement of being effective on slowly varying sequences; furthermore, under an additional property they are also able to cluster eigenvalues of the preconditioned matrix when some entries of $Delta_k$ are sufficiently large. We present two low-cost preconditioners sharing the above-mentioned properties and evaluate them on sequences of linear systems generated by the reflective Newton method applied to bound-constrained convex quadratic programming problems and on sequences arising in solving nonlinear least-squares problems with the regularized Euclidean residual method. The results of the numerical experiments show the effectiveness of these preconditioners.
A Preconditioning Framework for Sequences of Diagonally Modified Linear Systems Arising in Optimization
DE SIMONE, Valentina;DI SERAFINO, Daniela;
2012
Abstract
We propose a framework for building preconditioners for sequences of linear systems of the form $(A+Delta_k) x_k=b_k$, where $A$ is symmetric positive semidefinite and $Delta_k$ is diagonal positive semidefinite. Such sequences arise in several optimization methods, e.g., in affine-scaling methods for bound-constrained convex quadratic programming and bound-constrained linear least squares, as well as in trust-region and overestimation methods for convex unconstrained optimization problems and nonlinear least squares. For all the matrices of a sequence, the preconditioners are obtained by updating any preconditioner for $A$ available in the $LDL^T$ form. The preconditioners in the framework satisfy the natural requirement of being effective on slowly varying sequences; furthermore, under an additional property they are also able to cluster eigenvalues of the preconditioned matrix when some entries of $Delta_k$ are sufficiently large. We present two low-cost preconditioners sharing the above-mentioned properties and evaluate them on sequences of linear systems generated by the reflective Newton method applied to bound-constrained convex quadratic programming problems and on sequences arising in solving nonlinear least-squares problems with the regularized Euclidean residual method. The results of the numerical experiments show the effectiveness of these preconditioners.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
