Convergence Speed of Binary Interval Consensus Moez Draief Imperial College London Milan Vojnović Microsoft Research IEEE Infocom 2010, San Diego, CA,

Slides:



Advertisements
Similar presentations
Milan Vojnović Microsoft Research Cambridge Collaborators: E. Perron and D. Vasudevan 1 Consensus – with Limited Processing and Signalling.
Advertisements

Impact of Interference on Multi-hop Wireless Network Performance Kamal Jain, Jitu Padhye, Venkat Padmanabhan and Lili Qiu Microsoft Research Redmond.
R 0 and other reproduction numbers for households models MRC Centre for Outbreak analysis and modelling, Department of Infectious Disease Epidemiology.
Section 11.6 – Taylor’s Formula with Remainder
Rumors, consensus and epidemics on networks
Analysis of Algorithms CS 477/677
Power Laws By Cameron Megaw 3/11/2013. What is a Power Law?
Minimum Energy Mobile Wireless Networks IEEE JSAC 2001/10/18.
Bargaining Dynamics in Exchange Networks Milan Vojnović Microsoft Research Joint work with Moez Draief Allerton 2010, September 30, 2010.
Statistics for Business and Economics
Statistics review of basic probability and statistics.
Onur G. Guleryuz & Ulas C.Kozat DoCoMo USA Labs, San Jose, CA 95110
Decentralized Dynamics for Finite Opinion Games Diodato Ferraioli, LAMSADE Paul Goldberg, University of Liverpool Carmine Ventre, Teesside University.
An Introduction to Variational Methods for Graphical Models.
Networks. Graphs (undirected, unweighted) has a set of vertices V has a set of undirected, unweighted edges E graph G = (V, E), where.
Class notes for ISE 201 San Jose State University
ONR MURI: NexGeNetSci From Consensus to Social Learning in Complex Networks Ali Jadbabaie Skirkanich Associate Professor of innovation Electrical & Systems.
Building Low-Diameter P2P Networks Eli Upfal Department of Computer Science Brown University Joint work with Gopal Pandurangan and Prabhakar Raghavan.
On Power-Law Relationships of the Internet Topology CSCI 780, Fall 2005.
EXPANDER GRAPHS Properties & Applications. Things to cover ! Definitions Properties Combinatorial, Spectral properties Constructions “Explicit” constructions.
Preference Analysis Joachim Giesen and Eva Schuberth May 24, 2006.
Artificial Neural Networks
1 Algorithms for Large Data Sets Ziv Bar-Yossef Lecture 7 May 14, 2006
Maximizing Path Durations in Mobile Ad- Hoc Networks Yijie Han and Richard J. La Department of ECE & ISR University of Maryland, College Park CISS, Princeton.
Optimal Channel Choice for Collaborative Ad-Hoc Dissemination Liang Hu Technical University of Denmark Jean-Yves Le Boudec EPFL Milan Vojnović Microsoft.
TELCOM2125: Network Science and Analysis
Computer Science 1 Web as a graph Anna Karpovsky.
Priority Models Sashka Davis University of California, San Diego June 1, 2003.
STOCHASTIC GEOMETRY AND RANDOM GRAPHS FOR THE ANALYSIS AND DESIGN OF WIRELESS NETWORKS Haenggi et al EE 360 : 19 th February 2014.
Approximations to Probability Distributions: Limit Theorems.
Estimation Goal: Use sample data to make predictions regarding unknown population parameters Point Estimate - Single value that is best guess of true parameter.
Domain decomposition in parallel computing Ashok Srinivasan Florida State University COT 5410 – Spring 2004.
The Erdös-Rényi models
Information Networks Power Laws and Network Models Lecture 3.
Fundamentals of Hypothesis Testing: One-Sample Tests
2 Introduction: phase transition phenomena Phase transition: qualitative change as a parameter crosses threshold Matter temperature magnetism demagnetism.
Decentralised load balancing in closed and open systems A. J. Ganesh University of Bristol Joint work with S. Lilienthal, D. Manjunath, A. Proutiere and.
CHAPTER 7 Continuous Probability Distributions
Fluid Limits for Gossip Processes Vahideh Manshadi and Ramesh Johari DARPA ITMANET Meeting March 5-6, 2009 TexPoint fonts used in EMF. Read the TexPoint.
Hop-limited flooding over dynamic networks M. Vojnović and A. Proutiere Microsoft Research IEEE Infocom 2011, Shanghai, April 2011.
Milan Vojnović Microsoft Research Joint work with Moez Draief, Kyomin Jung, Bo Young Kim, Etienne Perron and Dinkar Vasudevan 1 Consensus Lecture series.
Random-Graph Theory The Erdos-Renyi model. G={P,E}, PNP 1,P 2,...,P N E In mathematical terms a network is represented by a graph. A graph is a pair of.
1 Machine Learning: Lecture 8 Computational Learning Theory (Based on Chapter 7 of Mitchell T.., Machine Learning, 1997)
Synchronization in complex network topologies
1 1 Slide © 2007 Thomson South-Western. All Rights Reserved Chapter 8 Interval Estimation Population Mean:  Known Population Mean:  Known Population.
Statistics 300: Elementary Statistics Sections 7-2, 7-3, 7-4, 7-5.
Belief Propagation and its Generalizations Shane Oldenburger.
Domain decomposition in parallel computing Ashok Srinivasan Florida State University.
1 Introduction to Statistics − Day 4 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Lecture 2 Brief catalogue of probability.
Confidence Intervals for a Population Mean, Standard Deviation Unknown.
What is a Hypothesis? A hypothesis is a claim (assumption) about the population parameter Examples of parameters are population mean or proportion The.
1 NETWORKING 2012 Parallel and Distributed Systems Group, Delft University of Technology, the Netherlands May 22, 2012 Reducing the History in Decentralized.
1 Chapter 8 Interval Estimation. 2 Chapter Outline  Population Mean: Known  Population Mean: Unknown  Population Proportion.
Anonymous communication over social networks Shishir Nagaraja and Ross Anderson Security Group Computer Laboratory.
CDC 2006, San Diego 1 Control of Discrete-Time Partially- Observed Jump Linear Systems Over Causal Communication Systems C. D. Charalambous Depart. of.
Bounds on Redundancy in Constrained Delay Arithmetic Coding Ofer ShayevitzEado Meron Meir Feder Ram Zamir Tel Aviv University.
Chapter 8 Estimation ©. Estimator and Estimate estimator estimate An estimator of a population parameter is a random variable that depends on the sample.
Network Topology Single-level Diversity Coding System (DCS) An information source is encoded by a number of encoders. There are a number of decoders, each.
Data Structures & Algorithm CS-102 Lecture 12 Asymptotic Analysis Lecturer: Syeda Nazia Ashraf 1.
Random Walk for Similarity Testing in Complex Networks
Approximating the MST Weight in Sublinear Time
CONCEPTS OF ESTIMATION
Taylor Polynomials & Approximation (9.7)
Estimation Goal: Use sample data to make predictions regarding unknown population parameters Point Estimate - Single value that is best guess of true parameter.
3.3 Network-Centric Community Detection
Pradeep Kyasanur Nitin H. Vaidya Presented by Chen, Chun-cheng
Machine Learning: UNIT-3 CHAPTER-2
Shan Lu, Jieqi Kang, Weibo Gong, Don Towsley UMASS Amherst
Random Variables A random variable is a rule that assigns exactly one value to each point in a sample space for an experiment. A random variable can be.
HKN ECE 313 Exam 2 Review Session
Presentation transcript:

Convergence Speed of Binary Interval Consensus Moez Draief Imperial College London Milan Vojnović Microsoft Research IEEE Infocom 2010, San Diego, CA, March 2010

Binary Consensus Problem Each node wants answer to: was 0 or 1 initial majority? 0 2 Requirements:local interactions limited communication limited memory per node

Related Work Hypothesis testing with finite memory (ex. Hellman & Cover 1970’s...) – But typically not for dependent observations in network settings Ternary protocol ( Perron, Vasudevan & V. 2009) – Diminishing probability of error for some graphs – Ex. complete graphs – exponentially diminishing probability of error with the network size n; logarithmic convergence time in n Interval consensus (Bénézit, Thiran & Vetterli, 2009) – Convergence with probability 1 for arbitrary connected graphs – Limited results on convergence time 3

Our Problem Q: What is the expected convergence time for binary interval consensus over arbitrary connected graphs? 4

Binary Interval Consensus Four states 01e0e0 e1e1 e0e0 0 e0e0 0 e1e1 0 e0e e0e0 e1e1 e0e0 e1e1 e0e0 e1e1 e0e0 e1e1 1 1e1e1 1 e1e1 1 5 Update rules – Swaps – Annihilation

Outlook Upper bound on expected convergence time for arbitrary connected graphs Application to particular graphs – Complete – Star-shaped – Erdös-Rényi Conclusion 6

General Bound on Expected Convergence Time Let for every nonempty set of nodes S, : 7 Each edge (i, j) activated at instances a Poisson process (q i,j )

General Bound on Expected Convergence Time (cont’d) 8 Without loss of generality we assume that initial majority are state 0 nodes  n = initial fraction of nodes in state 0, other nodes in state 1,  > 1/2

General Bound on Expected Convergence Time (cont’d) Key observation: two phases – In phase 1 nodes in state 1 are depleted – In phase 2 nodes in state e 1 are depleted Phase 1 1 if node i in state 1 1 if node i in state 0 9

Phase 1 Dynamics: S k = set of nodes in state 0 The result follows by using a “spectral bound” on the expected number of nodes in state 1 10

Outlook Upper bound on expected convergence time for arbitrary connected graphs Application to particular graphs – Complete – Star-shaped – Erdös-Rényi Conclusion 11

Complete graph Each edge activated with rate 1/(n-1) Inversely proportional to the voting margin Can be made arbitrary large! 12

Complete graph (cont’d) The general bound is tight 0 and 1 state nodes annihilate after a random time that has exponential distribution with parameter cut(S 0 (t), S 1 (t)) / (n-1) 13

Star-shaped graph Each edge activated with rate 1/(n-1) 14

Star-shaped graph (cont’) By first step analysis: Same scaling, different constant 15

Erdös-Rényi graph Each edge age e activated with rate X e /np n where X e ~ Ber(p n ) 16

Erdös-Rényi graph (cont’d) For sufficiently large expected degree, the bound is approximately as for the complete graph – In conformance with intuition 17

Conclusion Established a bound on the expected convergence time of binary interval consensus for arbitrary connected graphs The bound is inversely proportional to the smallest absolute eigenvalue of some matrices derived from the contact rate matrix The bound is tight – Achieved for complete graphs – Exact scaling order for star-shaped and Erdös-Rényi graphs Future work – Expected convergence time for m-ary interval consensus? – Lower bounds on the expected convergence time? 18