Analysis and Modeling of Social Influence in High Performance Computing Workloads

Social influence between users (e.g., collaborating on a project) creates bursty behavior in the underlying high performance computing (HPC) workloads. Using representative HPC and cluster workloads, this paper identifies, analyzes, and quantifies the level of social influence across HPC users. We show the existence of a social graph that is characterized by a pattern of dominant users and followers. This pattern also follows a power-law distribution, which is consistent with those observed in mainstream social networks. Given its potential impact on HPC workload prediction and scheduling, we propose a fast-converging, computationally-efficient online learning algorithm for identifying social groups. Extensive evaluation show that our online algorithm can identify stable social groups after observing only 1% of workload arrivals.

By: Shuai Zheng; Zon-Yin Shae; Xiangliang Zhang; Hani Jamjoom; Liana Fong

Published in: RC25164 in 2011

LIMITED DISTRIBUTION NOTICE:

This Research Report is available. This report has been submitted for publication outside of IBM and will probably be copyrighted if accepted for publication. It has been issued as a Research Report for early dissemination of its contents. In view of the transfer of copyright to the outside publisher, its distribution outside of IBM prior to publication should be limited to peer communications and specific requests. After outside publication, requests should be filled only by reprints or legally obtained copies of the article (e.g., payment of royalties). I have read and understand this notice and am a member of the scientific community outside or inside of IBM seeking a single copy only.

rc25164.pdf

Questions about this service can be mailed to reports@us.ibm.com .