SDE: Graph Drawing Using Spectral Distance Embedding

Slides:



Advertisements
Similar presentations
Self-Organizing Maps Projection of p dimensional observations to a two (or one) dimensional grid space Constraint version of K-means clustering –Prototypes.
Advertisements

Chapter 28 – Part II Matrix Operations. Gaussian elimination Gaussian elimination LU factorization LU factorization Gaussian elimination with partial.
Graph Laplacian Regularization for Large-Scale Semidefinite Programming Kilian Weinberger et al. NIPS 2006 presented by Aggeliki Tsoli.
Force directed graph drawing Thomas van Dijk. The problem Given a set of vertices and edges, compute positions for the vertices. If the edges don’t have.
Two Technique Papers on High Dimensionality Allan Rempel December 5, 2005.
(A fast quadratic program solver for) Stress Majorization with Orthogonal Ordering Constraints Tim Dwyer 1 Yehuda Koren 2 Kim Marriott 1 1 Monash University,
Principal Component Analysis CMPUT 466/551 Nilanjan Ray.
New Techniques for Visualisation of Large and Complex Networks with Directed Edges Tim Dwyer 1 Yehuda Koren 2 1 Monash University, Victoria, Australia.
One-Shot Multi-Set Non-rigid Feature-Spatial Matching
Spectral embedding Lecture 6 1 © Alexander & Michael Bronstein
Dimensionality Reduction and Embeddings
Computer Graphics Recitation 6. 2 Last week - eigendecomposition A We want to learn how the transformation A works:
Dimension reduction : PCA and Clustering Slides by Agnieszka Juncker and Chris Workman.
1 Numerical geometry of non-rigid shapes Spectral Methods Tutorial. Spectral Methods Tutorial 6 © Maks Ovsjanikov tosca.cs.technion.ac.il/book Numerical.
SIMS 247: Information Visualization and Presentation jeffrey heer
Manifold Learning: ISOMAP Alan O'Connor April 29, 2008.
Spectral Embedding Alexander Bronstein, Michael Bronstein
Force Directed Algorithm Adel Alshayji 4/28/2005.
Predicting Communication Latency in the Internet Dragan Milic Universität Bern.
1 Localization Technologies for Sensor Networks Craig Gotsman, Technion/Harvard Collaboration with: Yehuda Koren, AT&T Labs.
Computing Sketches of Matrices Efficiently & (Privacy Preserving) Data Mining Petros Drineas Rensselaer Polytechnic Institute (joint.
Force Directed Algorithm Adel Alshayji 4/28/2005.
PATTERN RECOGNITION : PRINCIPAL COMPONENTS ANALYSIS Prof.Dr.Cevdet Demir
Spectral clustering between friends. spectral clustering (a la Ng-Jordan-Weiss) datasimilarity graph edges have weights w ( i, j ) e.g.
Dimensionality Reduction
Dimensionality Reduction. Multimedia DBs Many multimedia applications require efficient indexing in high-dimensions (time-series, images and videos, etc)
Domain decomposition in parallel computing Ashok Srinivasan Florida State University COT 5410 – Spring 2004.
Fundamentals from Linear Algebra Ghan S. Bhatt and Ali Sekmen Mathematical Sciences and Computer Science College of Engineering Tennessee State University.
Surface Simplification Using Quadric Error Metrics Michael Garland Paul S. Heckbert.
Algorithms for drawing large graphs
Structure Preserving Embedding Blake Shaw, Tony Jebara ICML 2009 (Best Student Paper nominee) Presented by Feng Chen.
Scalable and Fully Distributed Localization With Mere Connectivity.
1 Smashing Peacocks Further: Drawing Quasi-Trees from Biconnected Components Daniel Archambault and Tamara Munzner, University of British Columbia David.
1 Oblivious Routing in Wireless networks Costas Busch Rensselaer Polytechnic Institute Joint work with: Malik Magdon-Ismail and Jing Xi.
Assume correspondence has been determined…
Computer Vision Lab. SNU Young Ki Baik Nonlinear Dimensionality Reduction Approach (ISOMAP, LLE)
Non-Linear Dimensionality Reduction
Spectral Sequencing Based on Graph Distance Rong Liu, Hao Zhang, Oliver van Kaick {lrong, haoz, cs.sfu.ca {lrong, haoz, cs.sfu.ca.
Learning Spectral Clustering, With Application to Speech Separation F. R. Bach and M. I. Jordan, JMLR 2006.
CS270 Project Overview Maximum Planar Subgraph Danyel Fisher Jason Hong Greg Lawrence Jimmy Lin.
A Convergent Solution to Tensor Subspace Learning.
Domain decomposition in parallel computing Ashok Srinivasan Florida State University.
PATTERN RECOGNITION : PRINCIPAL COMPONENTS ANALYSIS Richard Brereton
Data Structures and Algorithms in Parallel Computing Lecture 7.
Lower Bounds for Embedding Edit Distance into Normed Spaces A. Andoni, M. Deza, A. Gupta, P. Indyk, S. Raskhodnikova.
Graphs, Vectors, and Matrices Daniel A. Spielman Yale University AMS Josiah Willard Gibbs Lecture January 6, 2016.
C OMMUNITIES AND B ALANCE IN S IGNED N ETWORKS : S PECTRAL A PPROACH -Pranay Anchuri*, Malik Magdon Ismail Rensselaer Polytechnic Institute, NY.
Affine Registration in R m 5. The matching function allows to define tentative correspondences and a RANSAC-like algorithm can be used to estimate the.
GWAS Data Analysis. L1 PCA Challenge: L1 Projections Hard to Interpret (i.e. Little Data Insight) Solution: 1)Compute PC Directions Using L1 2)Compute.
Krylov-Subspace Methods - II Lecture 7 Alessandra Nardi Thanks to Prof. Jacob White, Deepak Ramaswamy, Michal Rewienski, and Karen Veroy.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
Laplacian Matrices of Graphs: Algorithms and Applications ICML, June 21, 2016 Daniel A. Spielman.
Ke (Kevin) Wu1,2, Philip Watters1, Malik Magdon-Ismail1
Spectral Methods for Dimensionality
Shan Lu, Jieqi Kang, Weibo Gong, Don Towsley UMASS Amherst
Matrix Sketching over Sliding Windows
Morphing and Shape Processing
Póth Miklós Polytechnical Engineering College, Subotica
Spectral Methods Tutorial 6 1 © Maks Ovsjanikov
Finding Communities by Clustering a Graph into Overlapping Subgraphs
Towards Next Generation Panel at SAINT 2002
Principal Component Analysis
On the effect of randomness on planted 3-coloring models
Modelling and Searching Networks Lecture 3 – ILT model
3.3 Network-Centric Community Detection
Discrete Mathematics and its Applications Lecture 3 – ILT model
Feature space tansformation methods
Linear Algebra Lecture 32.
Shan Lu, Jieqi Kang, Weibo Gong, Don Towsley UMASS Amherst
ADMM and DSO.
Presentation transcript:

SDE: Graph Drawing Using Spectral Distance Embedding Ali Civril Malik Magdon-Ismail Eli Bocek Rivele Rensselaer Polytechnic Institute, Troy, NY

Graph Drawing Problem Given a graph G=(V, E), find an aesthetically pleasing layout in 2-D. Straight-line edge drawings of graphs: Find the coordinates of the vertices

Force-Directed Approaches Define an energy function or force-directed model on the graph and iterate through optimization  good results, but slow (KK ‘89, FR ‘91) Multi-scale approaches to make the convergence faster (HK ‘00, Walshaw ‘00)

Spectral Graph Drawing A new paradigm in graph drawing Spectral decomposition of the matrices associated with the graph A mathematically sound formulation of the problem preventing from iterative computation HDE (HK ‘02), ACE (Koren et al ‘03)

HDE (HK ’02) Draw the graph in high dimension (typically 50) with respect to carefully chosen pivot nodes Project the coordinates into two dimensions by using PCA Fast due to the small sizes of the matrices processed

ACE (Koren et al ’03) Minimize Hall’s energy: Modulo some non-degeneracy and orthogonality constraints Eigen-decomposition of the Laplacian of the graph with a multi-scaling approach Fast

HDE and ACE Much faster than traditional force-directed methods, but with inferior aesthetics.

SDE (Spectral Distance Embedding) Approximate the real distances of the vertices with their graph theoretical distance Aesthetically pleasing drawings for a wide range of moderately large graphs with reasonable running times

Spectral Decomposition of the Distance Matrix Writing in matrix notation, we have where

Spectral Decomposition of the Distance Matrix Introducing a projection matrix And letting We have

Spectral Decomposition of the Distance Matrix is the centralized coordinates of the vertices Approximate as closely as possible w.r.t. spectral norm Get the top d eigenvalues of

The Algorithm Requires APSP computation which is Plus power iteration Overall complexity:

Performance Analysis Theorem: When the distance matrix is nearly embeddable and satisfies some regularity conditions, SDE recovers (up to a rotation) a close approximation to the optimal embedding Details in the technical report

Run-times

Run-times

Buckyball; |V| = 60, |E| = 90

50x50 Grid; |V| = 2500, |E| = 4900

50x50 Bag; |V| = 2497, |E| = 4900

Nasa1824; |V| = 1824, |E| = 18692

3elt; |V| = 4720, |E| = 13722

4970; |V| = 4970, |E| = 7400

Crack; |V| = 10240, |E| = 30380

Comparison

Comparison

Comparison

Conclusion A new spectral graph drawing method capable of nice drawings Reasonably fast for moderately large graphs Deficiencies: Cannot draw trees (as other spectral methods)

Forthcoming work Introduce sampling over nodes to reduce the time and space overhead For details, see the technical report. A. Civril, M. Magdon-Ismail and E. B. Rivele. SDE: Graph drawing using spectral distance embedding. Technical Report, Rensselaer Polytechnic Institute, 2005.