Presentation is loading. Please wait.

Presentation is loading. Please wait.

1 Dimension matching in Facebook and LinkedIn networks Anthony Bonato Ryerson University Toronto, Canada ICMCE 2015.

Similar presentations


Presentation on theme: "1 Dimension matching in Facebook and LinkedIn networks Anthony Bonato Ryerson University Toronto, Canada ICMCE 2015."— Presentation transcript:

1 1 Dimension matching in Facebook and LinkedIn networks Anthony Bonato Ryerson University Toronto, Canada ICMCE 2015

2 I am very happy to be back in India. நான் இந்தியா இருக்கும் மிகவும் சந்தோஷமாக இருக்கிறேன். Dimension matching in OSNs2

3 3

4 Friendship networks network of on- and off-line friends form a large web of interconnected links 4Dimension matching in OSNs

5 6 degrees of separation 5 (Stanley Milgram, 67): famous chain letter experiment Dimension matching in OSNs

6 6 Degrees in Facebook? 1.55 billion users (Backstrom et al., 2012) –4 degrees of separation in Facebook –when considering another person in the world, a friend of your friend knows a friend of their friend, on average similar results for Twitter and other OSNs 6Dimension matching in OSNs

7 7 Complex networks in the era of Big Data web graph, social networks, biological networks, internet networks, … Dimension matching in OSNs

8 What is a complex network? no precise definition however, there is general consensus on the following observed properties 1.large scale 2.evolving over time 3.power law degree distributions 4.small world properties 8Dimension matching in OSNs

9 Examples of complex networks technological/informational: web graph, router graph, AS graph, call graph, e-mail graph social: on-line social networks (Facebook, Twitter, LinkedIn,…), collaboration graphs, co- actor graph biological networks: protein interaction networks, gene regulatory networks, food networks 9Dimension matching in OSNs

10 Properties of complex networks 1.Large scale: relative to order and size web graph: order > trillion –some sense infinite: number of strings entered into Google Facebook: > 1 billion nodes; Twitter: > 307 million nodes –much denser (ie higher average degree) than the web graph protein interaction networks: order in thousands 10Dimension matching in OSNs

11 Properties of complex networks 2.Evolving: networks change over time web graph: billions of nodes and links appear and disappear each day Facebook: grew to 1 billion users –denser than the web graph protein interaction networks: order in the thousands –evolves much more slowly 11Dimension matching in OSNs

12 12 Properties of Complex Networks 3.Power law degree distribution for a graph G of order n and i a positive integer, let N i,n denote the number of nodes of degree i in G we say that G follows a power law degree distribution if for some range of i and some b > 2, b is called the exponent of the power law Dimension matching in OSNs

13 Power laws in OSNs 13Dimension matching in OSNs

14 14 Graph parameters average distance: clustering coefficient: Dimension matching in OSNs

15 15 Properties of Complex Networks 4.Small world property introduced by Watts & Strogatz in 1998: –low distances diam(G) = O(log n) L(G) = O(loglog n) –higher clustering coefficient than random graph with same expected degree Dimension matching in OSNs

16 16 Sample data: Flickr, YouTube, LiveJournal, Orkut (Mislove et al,07): short average distances and high clustering coefficients Dimension matching in OSNs

17 17 Other properties of complex networks many complex networks (including on-line social networks) obey two additional laws: Densification power law (Leskovec, Kleinberg, Faloutsos,05): –networks are becoming more dense over time; i.e. average degree is increasing |(E(G t )| ≈ |V(G t )| a where 1 < a ≤ 2: densification exponent Dimension matching in OSNs

18 18 Decreasing distances (Leskovec, Kleinberg, Faloutsos,05): –distances (diameter and/or average distances) decrease with time (Kumar et al,06): Dimension matching in OSNs

19 Other properties Connected component structure: emergence of components; giant components Spectral properties: adjacency matrix and Laplacian matrices, spectral gap, eigenvalue distribution Small community phenomenon: most nodes belong to small communities (ie subgraphs with more internal than external links) … 19Dimension matching in OSNs

20 Blau space OSNs live in social space or Blau space: –each user identified with a point in a multi-dimensional space –coordinates correspond to socio- demographic variables/attributes homophily principle: the flow of information between users is a declining function of distance in Blau space 20Dimension matching in OSNs

21 Underlying geometry Feature space thesis: every complex network is naturally associated with an underlying feature space. For eg: –web graph: topic space –OSNs: Blau space –PPIs: biochemical space 21Dimension matching in OSNs

22 Dimensionality Question: What is the dimension of the Blau space of OSNs? what is a credible mathematical formula for the dimension of an OSN? 22Dimension matching in OSNs

23 Six dimensions of separation23

24 24 Why model complex networks? uncover and explain the generative mechanisms underlying complex networks predict the future nice mathematical challenges models can uncover the hidden reality of networks Dimension matching in OSNs

25 Networks - Bonato25

26 26 “All models are wrong, but some are more useful.” – G.P.E. Box Dimension matching in OSNs

27 27 Random geometric graphs n nodes are randomly placed in the unit square each node has a constant sphere of influence, radius r nodes are joined if their Euclidean distance is at most r G(n,r), r = r(n) Dimension matching in OSNs

28 Some properties of G(n,r) Theorem (Penrose,97) Let μ = nexp(-πr 2 n). 1.If μ = o(1), then asymptotically almost surely (a.a.s.) G is connected. 2.If μ = Θ(1), then a.a.s. G has a component of order Θ(n). 3.If μ →∞, then a.a.s. G is disconnected. many other properties studied of G(n,r): chromatic number, clique number, Hamiltonicity, random walks, … 28Dimension matching in OSNs

29 Spatially Preferred Attachment (SPA) model (Aiello, Bonato, Cooper, Janssen, Prałat,08), (Cooper, Frieze, Prałat,12) 29 volume of sphere of influence proportional to in- degree nodes are added and spheres of influence shrink over time a.a.s. leads to power laws graphs, low directed diameter, and small separators Dimension matching in OSNs

30 Ranking models (Fortunato, Flammini, Menczer,06), (Łuczak, Prałat, 06), (Janssen, Prałat,09) parameter: α in (0,1) each node is ranked 1,2, …, n by some function r –1 is best, n is worst at each time-step, one new node is born, one randomly node chosen dies (and ranking is updated) link probability r -α many ranking schemes a.a.s. lead to power law graphs: random initial ranking, degree, age, etc. 30Dimension matching in OSNs

31 Geometric model for OSNs we consider a geometric model of OSNs, where –nodes are in m- dimensional Euclidean space –volume of spheres of influence variable: a function of ranking of nodes 31Dimension matching in OSNs

32 Geometric Protean (GEO-P) Model (Bonato, Janssen, Prałat, 12) parameters: α, β in (0,1), α+β < 1; positive integer m nodes live in an m-dimensional hypercube each node is ranked 1,2, …, n by some function r –1 is best, n is worst –we use random initial ranking at each time-step, one new node v is born, one randomly node chosen dies (and ranking is updated) each existing node u has a region of influence with volume add edge uv if v is in the region of influence of u 32Dimension matching in OSNs

33 Notes on GEO-P model models uses both geometry and ranking number of nodes is static: fixed at n –order of OSNs at most number of people (roughly…) top ranked nodes have larger regions of influence 33Dimension matching in OSNs

34 Simulation with 5000 nodes 34Dimension matching in OSNs

35 Simulation with 5000 nodes 35 random geometric GEO-P Dimension matching in OSNs

36 Properties of the GEO-P model (Bonato, Janssen, Prałat, 2012) a.a.s. the GEO-P model generates graphs with the following properties: –power law degree distribution with exponent b = 1+1/α –average degree d = (1+o(1))n (1-α-β) /2 1-α densification –diameter D = n Θ(1/m) small world: constant order if m = Clog n –bad spectral expansion and high clustering coefficient 36Dimension matching in OSNs

37 Dimension of OSNs given the order of the network n and diameter D, we can calculate m gives formula for dimension of OSN: 37Dimension matching in OSNs

38 Logarithmic Dimension Hypothesis In an OSN of order n and diameter D, the dimension of its Blau space is posed independently by (Leskovec,Kim,11), (Frieze, Tsourakakis,11) 38Dimension matching in OSNs

39 Uncovering the hidden reality reverse engineering approach –given network data (n, D), dimension of an OSN gives smallest number of attributes needed to identify users that is, given the graph structure, we can (theoretically) recover the social space 39Dimension matching in OSNs

40 6 Dimensions of Separation OSNDimension Facebook7 YouTube6 Twitter4 Flickr4 Cyworld7 40Dimension matching in OSNs

41 MITACS team, UBC 2012 41 L to R: Amanda Tian, David Gleich, Myughwan Kim, Me, Stephen Young, Dieter Mitsche Dimension matching in OSNs

42 42

43 MGEO-P (Bonato, Gleich, Mitsche, Prałat, Tian, Young,14) time-steps in GEO-P form a computational bottleneck consider a GEO-P model where we forget the history of ranks –memoryless GEO-P (MGEO-P) place n points u.a.r. in the hypercube assign ranks from via a random permutation σ for each pair i > j, ij is an edge if j is in the ball of volume σ(i) –α n -β 43Dimension matching in OSNs

44 Contrasting the models by considering the evolution of ranks in GEO-P, the probability that an edge is present in GEO-P and not in MGEO-P is: intuitively, the models generate similar graphs many a.a.s properties hold in MGEO-P with similar parameters 44Dimension matching in OSNs

45 Properties of the MGEO-P model (BGMPTY,14) a.a.s. the MGEO-P model generates graphs with the following properties: –power law degree distribution with exponent b = 1+1/α –average degree d = (1+o(1))n (1-α-β) /2 1-α densification –diameter D = n Θ(1/m) 45Dimension matching in OSNs

46 Proof sketch: diameter eminent node: –highly ranked: ranking greater than some fixed R partition hypercube into small hypercubes choose size of hypercubes and R so that –each hypercube contains at least log 2 n eminent nodes –sphere of influence of each eminent node covers each hypercube and all neighbouring hypercubes choose eminent node in each hypercube: backbone show all nodes in hypercube distance at most 2 from backbone 46Dimension matching in OSNs

47 Back to question… How would we measure the dimensionality of Blau space? 47Dimension matching in OSNs

48 Aside: machine learning machine learning is a branch of AI where computers make decisions and answer questions based on data sets examples: –spam filters –Netflix recommender systems especially useful when the data or number of decisions are too large for humans to process 48Dimension matching in OSNs

49 Facebook100 Dimension matching in OSNs49

50 Validating the LDH we tested the dimensionality of large-scale samples from real OSN data –Facebook100 and LinkedIn (sampled over time) IDEA: use machine learning (SVM) to predict dimensions –features: small subgraph counts (3- and 4- vertex subgraphs) –compared sampled data vs simulations of MGEO-P with dimensions 1 through 12 50Dimension matching in OSNs

51 Graphlets Dimension matching in OSNs51

52 Experimental design Dimension matching in OSNs52

53 Sample: Michigan Dimension matching in OSNs53

54 54 Stanford3: n: 11621 edges: 568330 avgdeg: 97.81086 plexp: 3.730000 GeoP parameters alphabeta: 0.510389 alpha: 0.366300 beta: 0.144089 python geop_dim_experiment.py --logcount -s 50 -t 0 --mmax 12 --prob 0.001 Stanford3 11621 568330 0.366300 0.144089 M-GeoP dimensions: LADTree: 2 J48: 3 Logistic: 5 SVM: 5 Dimension matching in OSNs

55 FB and LinkedIn - SVM Dimension matching in OSNs55

56 FB and LinkedIn - Eigenvalues 56Dimension matching in OSNs

57 Figure 6. For three of the Facebook networks, we show the eigenvalue histogram in red, the eigenvalue histogram from the best fit MGEO-P network in blue, and the eigenvalue histograms for samples from the other dimensions in grey. Bonato A, Gleich DF, Kim M, Mitsche D, et al. (2014) Dimensionality of Social Networks Using Motifs and Eigenvalues. PLoS ONE 9(9): e106052. doi:10.1371/journal.pone.0106052 http://www.plosone.org/article/info:doi/10.1371/journal.pone.0106052

58 Future directions Other data sets Fractal dimension What are the attributes? What implications does LDH have for OSNs or social networks in general? 58Dimension matching in OSNs

59 Thank you! நன்றி ! Dimension matching in OSNs59


Download ppt "1 Dimension matching in Facebook and LinkedIn networks Anthony Bonato Ryerson University Toronto, Canada ICMCE 2015."

Similar presentations


Ads by Google