A Recommendation System for Preconditioned Iterative Solvers

Preconditioned iterative methods are often used to solve very large sparse systems of linear systems that arise in many science and engineering applications. The performance and robustness of these solvers is extremely sensitive to the choices of multiple preconditioner and solver parameters. Users of iterative methods often encounter an overwhelming number of combinations of choices for solvers, matrix preprocessing steps, preconditioners, and their parameters. The lack of a unified theoretical analysis of preconditioners coupled with limited knowledge of their interaction with linear systems makes it highly challenging for practitioners to choose good solver configurations. In this paper, we propose a novel, multi-stage learning based methodology for determining the best solver configurations to optimize the desired performance behavior for any given linear system. Our solver configuration recommendation system involves three steps of modeling, namely (a) solvability modeling, (b) performance modeling, and (c) performance optimization. We model solvability and performance metrics as response functions associated with dyads of linear systems and solver configurations using classification and regression techniques. The best solver choices are then determined using a fast and efficient technique that performs rank aggregation over the learned performance models. Empirical results over real performance data for the Hypre iterative solver package demonstrates the efficacy and flexibility of the proposed approach.

By: Thomas George; Anshul Gupta; Vivek Sarin

Published in: RC24600 in 2008


This Research Report is available. This report has been submitted for publication outside of IBM and will probably be copyrighted if accepted for publication. It has been issued as a Research Report for early dissemination of its contents. In view of the transfer of copyright to the outside publisher, its distribution outside of IBM prior to publication should be limited to peer communications and specific requests. After outside publication, requests should be filled only by reprints or legally obtained copies of the article (e.g., payment of royalties). I have read and understand this notice and am a member of the scientific community outside or inside of IBM seeking a single copy only.


Questions about this service can be mailed to reports@us.ibm.com .