The mathematical challenge of large networks László Lovász Eötvös Loránd University, Budapest Joint work with Christian Borgs, Jennifer Chayes, Balázs.

Slides:



Advertisements
Similar presentations
Deterministic vs. Non-Deterministic Graph Property Testing Asaf Shapira Tel-Aviv University Joint work with Lior Gishboliner.
Advertisements

22C:19 Discrete Math Graphs Fall 2010 Sukumar Ghosh.
22C:19 Discrete Math Graphs Fall 2014 Sukumar Ghosh.
Midwestern State University Department of Computer Science Dr. Ranette Halverson CMPS 2433 – CHAPTER 4 GRAPHS 1.
Which graphs are extremal? László Lovász Eötvös Loránd University Budapest September
A UNIFIED FRAMEWORK FOR TESTING LINEAR-INVARIANT PROPERTIES ARNAB BHATTACHARYYA CSAIL, MIT (Joint work with ELENA GRIGORESCU and ASAF SHAPIRA)
Theory of Computing Lecture 16 MAS 714 Hartmut Klauck.
Online Social Networks and Media. Graph partitioning The general problem – Input: a graph G=(V,E) edge (u,v) denotes similarity between u and v weighted.
Randomized Algorithms Randomized Algorithms CS648 Lecture 20 Probabilistic Method (part 1) Lecture 20 Probabilistic Method (part 1) 1.
Random graphs and limits of graph sequences László Lovász Microsoft Research
CSE 522 – Algorithmic and Economic Aspects of the Internet Instructors: Nicole Immorlica Mohammad Mahdian.
On the Spread of Viruses on the Internet Noam Berger Joint work with C. Borgs, J.T. Chayes and A. Saberi.
10/11/2001Random walks and spectral segmentation1 CSE 291 Fall 2001 Marina Meila and Jianbo Shi: Learning Segmentation by Random Walks/A Random Walks View.
Random Walks Ben Hescott CS591a1 November 18, 2002.
Generalized Chebyshev polynomials and plane trees Anton Bankevich St. Petersburg State University Jass’07.
Lecture 21: Spectral Clustering
Conditional Regularity and Efficient testing of bipartite graph properties Ilan Newman Haifa University Based on work with Eldar Fischer and Noga Alon.
EXPANDER GRAPHS Properties & Applications. Things to cover ! Definitions Properties Combinatorial, Spectral properties Constructions “Explicit” constructions.
CSE 222 Systems Programming Graph Theory Basics Dr. Jim Holten.
A scalable multilevel algorithm for community structure detection
Convergent Dense Graph Sequences
22C:19 Discrete Math Graphs Spring 2014 Sukumar Ghosh.
GRAPH Learning Outcomes Students should be able to:
Correlation testing for affine invariant properties on Shachar Lovett Institute for Advanced Study Joint with Hamed Hatami (McGill)
Which graphs are extremal? László Lovász Eötvös Loránd University, Budapest Joint work with Balázs Szegedy.
The Effect of Induced Subgraphs on Quasi-randomness Asaf Shapira & Raphael Yuster.
Equality Function Computation (How to make simple things complicated) Nitin Vaidya University of Illinois at Urbana-Champaign Joint work with Guanfeng.
MapReduce and Graph Data Chapter 5 Based on slides from Jimmy Lin’s lecture slides ( (licensed.
GRAPHS CSE, POSTECH. Chapter 16 covers the following topics Graph terminology: vertex, edge, adjacent, incident, degree, cycle, path, connected component,
Graph limit theory: Algorithms László Lovász Eötvös Loránd University, Budapest May
July The Mathematical Challenge of Large Networks László Lovász Eötvös Loránd University, Budapest
Algorithms on large graphs László Lovász Eötvös Loránd University, Budapest May
7.1 and 7.2: Spanning Trees. A network is a graph that is connected –The network must be a sub-graph of the original graph (its edges must come from the.
Extremal Problems of Information Combining Alexei Ashikhmin  Information Combining: formulation of the problem  Mutual Information Function for the Single.
Graph limit theory: an overview László Lovász Eötvös Loránd University, Budapest IAS, Princeton June
October Large networks: a new language for science László Lovász Eötvös Loránd University, Budapest
Convergent sequences of sparse graphs (status report) László Lovász Eötvös University, Budapest.
1 Closures of Relations: Transitive Closure and Partitions Sections 8.4 and 8.5.
Week 11 - Monday.  What did we talk about last time?  Binomial theorem and Pascal's triangle  Conditional probability  Bayes’ theorem.
Lower Bounds for Property Testing Luca Trevisan U.C. Berkeley.
CS774. Markov Random Field : Theory and Application Lecture 02
Optimization in very large graphs László Lovász Eötvös Loránd University, Budapest December
Graph algebras and extremal graph theory László Lovász April
Local and global convergence in bounded degree graphs László Lovász Eötvös Loránd University, Budapest Joint work with Christian Borgs, Jennifer Chayes.
Percolation Processes Rajmohan Rajaraman Northeastern University, Boston May 2012 Chennai Network Optimization WorkshopPercolation Processes1.
Regularity partitions and the topology of graphons László Lovász Eötvös Loránd University, Budapest Joint work Balázs Szegedy August
Data Structures and Algorithms in Parallel Computing Lecture 2.
Amplification and Derandomization Without Slowdown Dana Moshkovitz MIT Joint work with Ofer Grossman (MIT)
Extremal graph theory and limits of graphs László Lovász September
Graphs and 2-Way Bounding Discrete Structures (CS 173) Madhusudan Parthasarathy, University of Illinois 1 /File:7_bridgesID.png.
GRAPHS. Graph Graph terminology: vertex, edge, adjacent, incident, degree, cycle, path, connected component, spanning tree Types of graphs: undirected,
Limits of randomly grown graph sequences Katalin Vesztergombi Eötvös University, Budapest With: Christian Borgs, Jennifer Chayes, László Lovász, Vera Sós.
狄彥吾 (Yen-Wu Ti) 華夏技術學院資訊工程系 Property Testing on Combinatorial Objects.
Complexity and Efficient Algorithms Group / Department of Computer Science Testing the Cluster Structure of Graphs Christian Sohler joint work with Artur.
Graph algebras and graph limits László Lovász
 In the previews parts we have seen some kind of segmentation method.  In this lecture we will see graph cut, which is a another segmentation method.
Introduction to Graph Theory By: Arun Kumar (Asst. Professor) (Asst. Professor)
Nondeterministic property testing László Lovász Katalin Vesztergombi.
Dense graph limit theory: Extremal graph theory László Lovász Eötvös Loránd University, Budapest May
Hyperfinite graphs and combinatorial optimization László Lovász
Graph Algebras László Lovász Eötvös University, Budapest
Randomized Algorithms CS648
Graph limits and graph homomorphisms László Lovász Microsoft Research
Probabilistic existence of regular combinatorial objects
Partitioning and decomposing graphs László Lovász
Around the Regularity Lemma
Graph homomorphisms, statistical physics,
Embedding Metrics into Geometric Spaces
Hyperfinite graphs and combinatorial optimization László Lovász
Eötvös Loránd Tudományegyetem, Budapest
Presentation transcript:

The mathematical challenge of large networks László Lovász Eötvös Loránd University, Budapest Joint work with Christian Borgs, Jennifer Chayes, Balázs Szegedy, Vera Sós and Katalin Vesztergombi May 20121

Minimize x 3 -6x over x  0 minimum is not attained in rationals Minimize 4-cycle density in graphs with edge-density 1/2 minimum is not attained among graphs always >1/16, arbitrarily close for random graphs Real numbers are useful Graph limits are useful May Graph limits: Why are they needed?

Two extremes: - dense (cn 2 edges) - bounded degree well developed good warm-up case How dense is the graph? May Inbetween??? Bollobas-Riordan Chung Conlon-Fox-Zhao less developed, more difficult most applications

May How is the graph given? - Graph is HUGE. - Not known explicitly, not even the number of nodes. Idealize: define minimum amount of info.

May Dense case:  cn 2 edges. - We can sample a uniform random node a bounded number of times, and see edges between sampled nodes. Bounded degree (  d) - We can sample a uniform random node a bounded number of times, and explore its neighborhood to a bounded depth. How is the graph given? „Property testing”: Arora-Karger-Karpinski, Goldreich-Goldwasser-Ron, Rubinfeld-Sudan, Alon-Fischer-Krivelevich-Szegedy, Fischer, Frieze-Kannan, Alon-Shapira

May Lecture plan Want to construct completion of the set of graphs. - What is the distance of two graphs? - Which graph sequences are convergent? - How to represent the limit object? - How does this completion space look like? - How to approximate graphs? (Regularity Lemmas and sampling)

May Lecture plan Applications in (dense) extremal graph theory - Are extremal graph problems decidable? - Which graphs are extremal? - Local vs. global extrema - Is there always an extremal graph?

May Lecture plan Applications in property testing - Deterministic and non-deterministic sampling (P=NP) - Which properties are testable by sampling?

May Lecture plan The bounded degree case - Different limit objects: involution-invariant distributions, graphings - Local algorithms and distributed computing

G AGAG WGWG Pixel pictures May

A random graph with 100 nodes and with 2500 edges May Pixel pictures

Rearranging rows and columns May Pixel pictures

May Pixel pictures A randomly grown uniform attachment graph on 200 nodes At step n: - a new node is born; - any two nodes are joined with probability 1/n Ignore multiplicity of edges

Approximation by small: Regularity Lemma Szemerédi 1975 May

Nodes can be so ordered essentially random Approximation by small: Regularity Lemma May

The nodes of any graph can be partitioned into a small number of essentially equal parts so that the bipartite graphs between 2 parts are essentially random (with different densities). with  k 2 exceptions for subsets X,Y of parts V i,V j # of edges between X and Y is p ij |X||Y| ±  ( n/k) 2 Given  >0 difference at most 1 Approximation by small: Regularity Lemma May

May Original Regularity Lemma Szemerédi 1976 “Weak” Regularity Lemma Frieze-Kannan 1999 “Strong” Regularity Lemma Alon – Fisher - Krivelevich - M. Szegedy 2000 Approximation by small: Regularity Lemma

May A randomly grown uniform attachment graph on 200 nodes Graph limits: Examples

Knowing the limit W knowing many properties (approximately). Graph limits: Why are they useful? triangle density  May

May Limit objects: the math distribution of k-samples is convergent for all k t(F,G): Probability that random map V(F)  V(G) preserves edges (G 1,G 2,…) convergent:  F t(F,G n ) is convergent

May Limit objects: the math W 0 = { W: [0,1] 2  [0,1], symmetric, measurable } G n  W :  F: t(F,G n )  t(F,W) "graphon"

Randomly grown prefix attachment graph At step n: - a new node is born; - connects to a random previous node and all its predecessors May Limit objects: an example

A randomly grown prefix attachment graph with 200 nodes Is this graph sequence convergent at all? Yes, by computing subgraph densities! This tends to some shades of gray; is that the limit? No, by computing triangle densities! May

A randomly grown prefix attachment graph with 200 nodes (ordered by degrees) This also tends to some shades of gray; is that the limit? No… May Limit objects: an example

The limit of randomly grown prefix attachment graphs May Limit objects: an example

The distance of two graphs May (a) (b) cut distance (c) blow up nodes finite definition by fractional overlay

May Examples: The distance of two graphs

May p ij : density between S i and S j G P : complete graph on V(G) with edge weights p ij “Weak” Regularity Lemma

May Frieze-Kannan “Weak” Regularity Lemma

May Counting lemma: Inverse counting lemma: If for all graphs F with k nodes, then Counting Lemmas

May Equivalence of convergence notions A graph sequence (G 1,G 2,...) is convergent iff it is Cauchy in  .

December The distance of two graphons

May The semimetric space ( W 0,   ) is compact. “Strong” Regularity Lemma

May Limit objects: the math For every convergent graph sequence (G n ) there is a W  W 0 such that G n  W. W is essentially unique (up to measure-preserving transformation). Conversely,  W  (G n ) such that G n  W.

May Limit objects: the math For every convergent graph sequence (G n ) there is a W  W 0 such that G n  W. W is essentially unique (up to measure-preserving transformation). Conversely,  W  (G n ) such that G n  W. Regularity Lemma + martingales L-Szegedy Exchangeable random variables Aldous; Diaconis-Janson Ultraproducts Elek-Szegedy

May Limit objects: the math For every convergent graph sequence (G n ) there is a W  W 0 such that G n  W. W is essentially unique (up to measure-preserving transformation). Conversely,  W  (G n ) such that G n  W. W-random graphs (sampling from a graphon)

May Limit objects: the math For every convergent graph sequence (G n ) there is a W  W 0 such that G n  W. W is essentially unique (up to measure-preserving transformation). Conversely,  W  (G n ) such that G n  W. Constructing canonical representation Borgs-Chayes-L Exchangeable random variables Kallenberg; Diaconis-Janson Inverse Counting Lemma, measure compactness Bollobas-Riordan

May