A Bayesian Framework for Estimating Properties of Network Dilusions

The analysis of network connections, di usion processes and cascades
is of practical and academic interest across many disciplines. Many prob-
lems in this analysis involve evaluating properties of the di usion network.
However, these properties often involve variables that are not explicitly
observed in real world di usions, such as the network connection strengths
and the di usion paths of infections over the network. These hidden vari-
ables therefore need to be estimated for these properties to be evaluated.
In this paper, we propose and study this novel problem in a Bayesian
framework by capturing the posterior distribution of these hidden vari-
ables given the observed cascades, and computing the expectation of these
properties under this posterior distribution. We identify and characterize
interesting network di usion properties whose expectations can be com-
puted exactly and eciently, either wholly or in part. For properties that
are not `nice' in this sense, we propose a Gibbs Sampling framework for
Monte-Carlo integration. In detailed experiments using various network
di usion properties over multiple synthetic and real datasets, we demon-
strate that the proposed approach is signi cantly more accurate than a
frequentist plug-in baseline. We also propose a map-reduce implementa-
tion of our framework and demonstrate that this scales easily for large
datasets.

By: Satya R. K. Pasumarthi, Varun R. Embar, Indrajit Bhattacharya

Published in: RI14004 in 2014

LIMITED DISTRIBUTION NOTICE:

This Research Report is available. This report has been submitted for publication outside of IBM and will probably be copyrighted if accepted for publication. It has been issued as a Research Report for early dissemination of its contents. In view of the transfer of copyright to the outside publisher, its distribution outside of IBM prior to publication should be limited to peer communications and specific requests. After outside publication, requests should be filled only by reprints or legally obtained copies of the article (e.g., payment of royalties). I have read and understand this notice and am a member of the scientific community outside or inside of IBM seeking a single copy only.

researchReport.pdf

Questions about this service can be mailed to reports@us.ibm.com .