Distance Scales, Embeddings, and Metrics of Negative Type By James R. Lee Presented by Andy Drucker Mar. 8, 2007 CSE 254: Metric Embeddings.

Slides:



Advertisements
Similar presentations
Geometry and Expansion: A survey of some results Sanjeev Arora Princeton ( touches upon: S. A., Satish Rao, Umesh Vazirani, STOC04; S. A., Elad Hazan,
Advertisements

Lower Bounds for Additive Spanners, Emulators, and More David P. Woodruff MIT and Tsinghua University To appear in FOCS, 2006.
Inapproximability of Hypergraph Vertex-Cover. A k-uniform hypergraph H= : V – a set of vertices E - a collection of k-element subsets of V Example: k=3.
Boyce/DiPrima 9th ed, Ch 2.8: The Existence and Uniqueness Theorem Elementary Differential Equations and Boundary Value Problems, 9th edition, by William.
Inapproximability of MAX-CUT Khot,Kindler,Mossel and O ’ Donnell Moshe Ben Nehemia June 05.
1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
On the Unique Games Conjecture Subhash Khot Georgia Inst. Of Technology. At FOCS 2005.
6.896: Topics in Algorithmic Game Theory Lecture 11 Constantinos Daskalakis.
Trees and Markov convexity James R. Lee Institute for Advanced Study [ with Assaf Naor and Yuval Peres ] RdRd x y.
What have we learnt about graph expansion in the new millenium? Sanjeev Arora Princeton University & Center for Computational Intractability.
Metric embeddings, graph expansion, and high-dimensional convex geometry James R. Lee Institute for Advanced Study.
Geometric embeddings and graph expansion James R. Lee Institute for Advanced Study (Princeton) University of Washington (Seattle)
Interchanging distance and capacity in probabilistic mappings Uriel Feige Weizmann Institute.
1 Numerical geometry of non-rigid shapes Consistent approximation of geodesics in graphs Consistent approximation of geodesics in graphs Tutorial 3 © Alexander.
Approximation Algoirthms: Semidefinite Programming Lecture 19: Mar 22.
A Linear Round Lower Bound for Lovasz-Schrijver SDP relaxations of Vertex Cover Grant Schoenebeck Luca Trevisan Madhur Tulsiani UC Berkeley.
Sparsest Cut S S  G) = min |E(S, S)| |S| S µ V G = (V, E) c- balanced separator  G) = min |E(S, S)| |S| S µ V c |S| ¸ c ¢ |V| Both NP-hard.
CPSC 689: Discrete Algorithms for Mobile and Wireless Systems Spring 2009 Prof. Jennifer Welch.
Geometry and Expansion: A survey of recent results Sanjeev Arora Princeton ( touches upon: S. A., Satish Rao, Umesh Vazirani, STOC’04; S. A., Elad Hazan,
Approximation Algorithm: Iterative Rounding Lecture 15: March 9.
Expander flows, geometric embeddings, and graph partitioning Sanjeev Arora Princeton Satish Rao UC Berkeley Umesh Vazirani UC Berkeley ( + survey of other.
Expander flows, geometric embeddings, and graph partitioning Sanjeev Arora Princeton Satish Rao UC Berkeley Umesh Vazirani UC Berkeley.
Geometric Embeddings, Graph Partitioning, and Expander flows: A survey of recent results Sanjeev Arora Princeton ( touches upon: S. A., Satish Rao, Umesh.
INTEGRALS The Fundamental Theorem of Calculus INTEGRALS In this section, we will learn about: The Fundamental Theorem of Calculus and its significance.
Geometric Embeddings, Graph Partitioning, and Expander flows: A survey of recent results Sanjeev Arora Princeton ( touches upon: S. A., Satish Rao, Umesh.
Geometric Embeddings, Graph Partitioning, and Expander flows: A survey of recent results Sanjeev Arora Princeton ( touches upon: S. A., Satish Rao, Umesh.
Lower Bounds on the Distortion of Embedding Finite Metric Spaces in Graphs Y. Rabinovich R. Raz DCG 19 (1998) Iris Reinbacher COMP 670P
SDP Based Approach for Graph Partitioning and Embedding Negative Type Metrics into L 1 Subhash Khot (Georgia Tech) Nisheeth K. Vishnoi (IBM Research and.
Sketching and Embedding are Equivalent for Norms Alexandr Andoni (Simons Inst. / Columbia) Robert Krauthgamer (Weizmann Inst.) Ilya Razenshteyn (MIT, now.
Finding Almost-Perfect
Distance scales, embeddings, and efficient relaxations of the cut cone James R. Lee University of California, Berkeley.
Dana Moshkovitz, MIT Joint work with Subhash Khot, NYU.
Embedding and Sketching Non-normed spaces Alexandr Andoni (MSR)
Chapter 2. One of the basic axioms of Euclidean geometry says that two points determine a unique line. EXISTENCE AND UNIQUENESS.
Volume distortion for subsets of R n James R. Lee Institute for Advanced Study & University of Washington Symposium on Computational Geometry, 2006; Sedona,
Integrality Gaps for Sparsest Cut and Minimum Linear Arrangement Problems Nikhil R. Devanur Subhash A. Khot Rishi Saket Nisheeth K. Vishnoi.
Algorithms Design and Analysis: PTAS for Euclidean TSP Prof. Dr. Jinxing Xie Dept. of Mathematical Sciences Tsinghua University, Beijing , China.
Subhash Khot’s work and its impact Sanjeev Arora Computer Science Dept, Princeton University ICM 2014 Nevanlinna Prize Laudatio.
Expander Flows, Graph Spectra and Graph Separators Umesh Vazirani U.C. Berkeley Based on joint work with Khandekar and Rao and with Orrechia, Schulman.
The Integers. The Division Algorithms A high-school question: Compute 58/17. We can write 58 as 58 = 3 (17) + 7 This forms illustrates the answer: “3.
Chapter 6: Geometric Analysis: The Gap Property By azam sadeghian 1.
the Antiderivative date: 1/30 hw: p225 #1-41 EOO.
1 The number of orientations having no fixed tournament Noga Alon Raphael Yuster.
Geometry and Expansion: A survey of recent results Sanjeev Arora Princeton ( touches upon: S. A., Satish Rao, Umesh Vazirani, STOC’04; S. A., Elad Hazan,
Embeddings, flow, and cuts: an introduction University of Washington James R. Lee.
Chapter 13 (Prototype Methods and Nearest-Neighbors )
Doubling Dimension: a short survey Anupam Gupta Carnegie Mellon University Barriers in Computational Complexity II, CCI, Princeton.
Unique Games Approximation Amit Weinstein Complexity Seminar, Fall 2006 Based on: “Near Optimal Algorithms for Unique Games" by M. Charikar, K. Makarychev,
Graph Partitioning using Single Commodity Flows
Lower Bounds for Embedding Edit Distance into Normed Spaces A. Andoni, M. Deza, A. Gupta, P. Indyk, S. Raskhodnikova.
Multi-way spectral partitioning and higher-order Cheeger inequalities University of Washington James R. Lee Stanford University Luca Trevisan Shayan Oveis.
The Fundamental Theorem of Calculus Area and The Definite Integral OBJECTIVES  Evaluate a definite integral.  Find the area under a curve over a given.
Coarse Differentiation and Planar Multiflows
Direct Proof and Counterexample IV: Division into Cases and the Quotient-Remainder Theorem For each of the following values of n and d, find integers q.
Chapter 5 Limits and Continuity.
Generalized Sparsest Cut and Embeddings of Negative-Type Metrics
Objectives Write indirect proofs. Apply inequalities in one triangle.
Spectral Clustering.
Chapter 5. Optimal Matchings
Structural Properties of Low Threshold Rank Graphs
Sketching and Embedding are Equivalent for Norms
James B. Orlin Presented by Tal Kaminker
Lecture 16: Earth-Mover Distance
Indirect Argument: Contradiction and Contraposition
Miniconference on the Mathematics of Computation
Dimension versus Distortion a.k.a. Euclidean Dimension Reduction
Embedding Metrics into Geometric Spaces
Section 8.1 – 8.2 Geometric Mean Pythagorean Theorem
Presentation transcript:

Distance Scales, Embeddings, and Metrics of Negative Type By James R. Lee Presented by Andy Drucker Mar. 8, 2007 CSE 254: Metric Embeddings

Negative Type Metrics

Also, L_1 is NEG… Finally, NEG metrics arise in SDP instances for important problems like Sparsest Cut.

Embedding NEG metrics NEG metrics are restrictive. It was conjectured that they embed with O(1) distortion into L1, but this was disproved by Khot and Vishnoi [KV].

Embedding NEG metrics NEG metrics are restrictive. It was conjectured that they embed with O(1) distortion into L1, but this was disproved by Khot and Vishnoi [KV].

Lee’s Methodology (bird’s-eye view)

The Gluing Lemma

Proof Methodology (2) Now let's see how to deal with one particular scale [tau, 2 tau].

Proof Methodology (2) Now let's see how to deal with one particular scale [tau, 2 tau].

Proof Methodology (2) Now let's see how to deal with one particular scale [tau, 2 tau]

Here is a sketch outline of how we find well-separated sets (A, B) in the image f(X) of a NEG metric X. Given a direction vector u, define L_u, R_u as the points which lie (very) ‘approximately’ in the direction of u, -u respectively. (with fair probability, both sets are ‘big’.)

Here is a sketch outline of how we find well-separated sets in the image f(X) of a NEG metric X. Given a direction vector u, define L_u, R_u as the points which lie (very) ‘approximately’ in the direction of u, -u respectively. (with fair probability, both sets are ‘big’.) If L_u, R_u aren’t well-separated, match off nearby points from the two sets until the remainder is well separated.

Here is a sketch outline of how we find well-separated sets in the image f(X) of a NEG metric X. Given a direction vector u, define L_u, R_u as the points which lie (very) ‘approximately’ in the direction of u, -u respectively. (with fair probability, both sets are ‘big’.) If L_u, R_u aren’t well-separated, match off nearby points from the two sets until the remainder is well-separated. If what’s left are big sets, we’ve succeeded.

But suppose that for most u, we don’t succeed.

This means that for most u, we find a sizeable matching in X, such that the matched points x, y are close and have (x – y) pointing approximately in the direction of u.

But suppose that for most u, we don’t succeed. This means that for most u, we find a sizeable matching in X, such that the matched points x, y are close and have (x – y) pointing approximately in the direction of u. By carefully studying the geometry of obtuse-angle-free point sets, we show that this property cannot happen strongly--a contradiction.

Specifically, we derive a subset C of X called a `matching core’, which for a substantial fraction of directions u can find a sizeable matching within itself, such that matched points are close and point in the approximate direction of u.

Specifically, we derive a subset C of X called a `matching core’, which for a substantial fraction of directions u can find a sizeable matching within itself, such that matched points are are close and point in the approximate direction of u. We develop a lower bound on the size of (obtuse angle-free) matching cores, which in this case allows us to conclude that C must be impossibly large—larger than X itself!

Specifically, we derive a subset C of X called a `matching core’, which for a substantial fraction of directions u can find a sizeable matching within itself, such that matched points are close and point in the approximate direction of u. We develop a lower bound on the size of (obtuse angle-free) matching cores, which in this case allows us to conclude that C must be impossibly large—larger than X itself! This contradiction tells us that for a certain fraction of u, we must succeed.

Some fundamental notions

Example of Parameter Tradeoffs

Cover Size Lower Bounds Why? Each point in C can only ‘cover’ x in a small fraction of directions.

Cover Size Lower Bounds Why? Each point in C can only ‘cover’ x in a small fraction of directions. Here’s where we’re going: in an obtuse angle-free matching core C, we can exhibit a point x that’s very well-covered by C; hence, C is very large.

Transferring a Cover

Boosting cover probability (delta)

([ARV]) Proof uses Levy’s Spherical Isoperimetric Inequality (concentration of measure for Lipschitz functions).

‘Matching Covers’

‘Matching Covers’ (cont’d)

NEG metrics and Big Cores

Proof starts with the set C and alternately whittles it down and builds it up (to an S within C that is covered by C), boosting the sigma parameter of S while maintaining delta and slowly degrading l.

Where does the obtuse angle-free property of f(X) get used? Suppose point y of C helps to cover x, and point x’ is at most k hops in X away from x, where each hop is of length at most 1. The NEG angle…

y helps to cover x’, somewhat, but the parameters (in Lemma 4.3) are weakened to the extent that x’ is far away from x. How far apart are x, x’?

x, x’ are separated by k hops in X of length 1… could that put them at a distance k? Not without obtuse angles!

By the triangle inequality on X’s own metric, ||x – x’||^2 <= k, so ||x – x’|| <= sqrt(k).

This phenomenon is crucial in bounding the degradation of our parameters during each phase in the inductive procedure.

And that’s all I’m going to say…

Bibliography [ALN] Sanjeev Arora, James R. Lee, Assaf Naor. Euclidean distortion and the Sparsest Cut, STOC ’05. [ARV] Sanjeev Arora, Satish Rao, Umesh Vazirani. Expander Flows, Geometric Embeddings and Graph Partitioning, STOC ’04. Expander Flows, Geometric Embeddings and Graph Partitioning [KV] Subhash Khot, Nisheeth Vishnoi. The unique games conjecture, integrality gap for cut problems and embeddability of negative type metrics into L1 FOCS ‘05.The unique games conjecture, integrality gap for cut problems and embeddability of negative type metrics into L1

NEG Metrics Posse—L2, not L7

The Fuller Story… There is one unmentioned ingredient, Prop. 4.6, in the proof of the Big Core Theorem. First, we need to be familiar with the ‘set neighborhood operator’ Tau and its iterates…

Boosting Sigma

Strength relies on set neighborhood not being too large! (beta)

Boosting Sigma (cont’d)

NEG metrics and Big Cores

Proof of BCT by Claim 4.8

Sketch: Proof by Induction

Proof by Induction

Induction—Step 1

Induction—Step 1 (boosting sigma)

Induction—Step 2

Analysis

What’s Next?

Finding Separated Sets

Finding A Matching Core

Parameters of the Core

Exploiting the Core