Preconditioners for Sparse Iterative Methods

Iterative methods for solving sparse systems of linear equations are potentially less memory and computation intensive than direct methods, but often experience slow convergence or fail to converge at all. The robustness and the speed of Krylov subspace iterative methods is improved, often dramatically, by preconditioning. Preconditioning is a technique for transforming the original system of equations into one with an improved distribution (clustering) of eigenvalues so that the transformed system can be solved in fewer iterations. A key step in preconditioning a linear system is to find a nonsingular preconditioner matrix such that the inverse of is as close to the inverse of as possible and solving is significantly less expensive than solving . The system is then solved by solving . This particular example shows what is known as left preconditioning. There are two other formulations, known as right preconditioning and split preconditioning; the basic concept, however, is the same. Other practical requirements for successful preconditioning are that the cost of computing itself must be low and the memory required to compute and apply must be significantly less than that for solving via direct factorization.

By: Anshul Gupta

Published in: RC25077 in 2010


This Research Report is available. This report has been submitted for publication outside of IBM and will probably be copyrighted if accepted for publication. It has been issued as a Research Report for early dissemination of its contents. In view of the transfer of copyright to the outside publisher, its distribution outside of IBM prior to publication should be limited to peer communications and specific requests. After outside publication, requests should be filled only by reprints or legally obtained copies of the article (e.g., payment of royalties). I have read and understand this notice and am a member of the scientific community outside or inside of IBM seeking a single copy only.


Questions about this service can be mailed to .