Middleware and Performance Issues for Financial Risk Analytics on Blue Gene/L

We describe a set of middleware components for supporting the execution of financial risk analytics applications on Blue Gene/L. Although, motivated by the requirements of a specific proprietary application involving a Value-at-Risk (VaR) computation for an asset portfolio using Monte Carlo simulation, this middleware is equally relevant to any application where the input and output data are stored in externally in SQL databases for example, where an automatic pre-staging and post-staging of the data between these external data sources and the computational platform is required. More generally, in order to support such applications on Blue Gene/L, the middleware provides a number of core features including an automated data extraction and staging gateway, a standardized high-level job specification schema, a well-defined web services (SOAP) API for interoperability with other applications, and a secure HTML/JSP web-based interface suitable for general users (i.e., non-developers). Finally, continuing with the focus on the data movement requirements, we describe generic I/O performance optimizations that were used for this application on the Blue Gene/L platform.

By: Thomas Phan; Satoki Mitsumori; Ramesh Natarajan; Hao Yu

Published in: RC23785 in 2005


This Research Report is available. This report has been submitted for publication outside of IBM and will probably be copyrighted if accepted for publication. It has been issued as a Research Report for early dissemination of its contents. In view of the transfer of copyright to the outside publisher, its distribution outside of IBM prior to publication should be limited to peer communications and specific requests. After outside publication, requests should be filled only by reprints or legally obtained copies of the article (e.g., payment of royalties). I have read and understand this notice and am a member of the scientific community outside or inside of IBM seeking a single copy only.


Questions about this service can be mailed to reports@us.ibm.com .