A Hybrid Event-Processing Architecture based on the Model-driven Approach for High Performance Monitoring

Business Activity Monitoring (BAM) is a concept for computer systems which support monitoring situations and the performance of business processes as they execute. The monitoring system needs to capture and to process numerous events while correlating them with other events stored in a database. If the database accesses become very frequent, read-only and write-only accesses can achieve high throughputs by applying well known solutions; a result cache and a batch update. However, the event processing of the monitoring includes both simultaneously. It is the case that is hard for the existing solutions to achieve high throughputs.
Here, we introduce a new architecture, HM-Hybrid, to process events for monitoring efficiently. It is a hybrid of a result cache and a batch update. And our model-driven approach makes it possible for them to work together in situations that are normally regarded as being unsuited for them. It processed 1207 events per second, about 43000 queries per second. It is 6 times better performance over a naive caching architecture in our experiments. The architecture seems useful for monitoring applications where there are many update and select queries.

By: Yosuke Ozawa, Teruo Koyanagi, Mari Abe, Liangzhao Zeng

Published in: RT0728 in 2007

LIMITED DISTRIBUTION NOTICE:

This Research Report is available. This report has been submitted for publication outside of IBM and will probably be copyrighted if accepted for publication. It has been issued as a Research Report for early dissemination of its contents. In view of the transfer of copyright to the outside publisher, its distribution outside of IBM prior to publication should be limited to peer communications and specific requests. After outside publication, requests should be filled only by reprints or legally obtained copies of the article (e.g., payment of royalties). I have read and understand this notice and am a member of the scientific community outside or inside of IBM seeking a single copy only.

RT0728.pdf

Questions about this service can be mailed to reports@us.ibm.com .