Scheduling Intense Applications. Most 'Surprising' First

Certain streaming applications are required to perform sophisticated analytics within bounded time on arriving streams of data. Such applications have the interesting characteristic that the total amount of work that could be performed is unbounded. We show how recent result from algorithmic theory are useful in scheduling such applications as they allow the efficient creation of synopses of unprocessed data. These synopses can then be used to schedule the processing of the stream. In particular, we describe a scheduler that optimizes the information rate available to applications by estimating the entropy of arriving streams. We describe the theory underlying such a scheduler and show how existing programming models can be extended to accommodate it.

By: Sean Rooney

Published in: Proc. 2010 ACM Symp. on Applied Computing "SAC 2010," Sierre, Switzerland, New York, ACM, p.2077 in 2010

Please obtain a copy of this paper from your local library. IBM cannot distribute this paper externally.

Questions about this service can be mailed to .