Lower Bounds on Extended Formulations Noah Fleming University of Toronto Supervised by Toniann Pitassi.

Slides:



Advertisements
Similar presentations
Introduction to Algorithms 6.046J/18.401J/SMA5503
Advertisements

To solve a system means to find the ordered pairs that satisfy both inequalities. Graph and find the intersection of the two inequalities. If they do.
3.4 Linear Programming 10/31/2008. Optimization: finding the solution that is either a minimum or maximum.
The Primal-Dual Method: Steiner Forest TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A AA A A A AA A A.
1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
Approximation Algorithms Chapter 14: Rounding Applied to Set Cover.
Introduction to Algorithms
Copyright (c) 2003 Brooks/Cole, a division of Thomson Learning, Inc
Ch 2. 6 – Solving Systems of Linear Inequalities & Ch 2
A Randomized Polynomial-Time Simplex Algorithm for Linear Programming Daniel A. Spielman, Yale Joint work with Jonathan Kelner, M.I.T.
The Simplex Method: Standard Maximization Problems
Computability and Complexity 23-1 Computability and Complexity Andrei Bulatov Search and Optimization.
Complexity 15-1 Complexity Andrei Bulatov Hierarchy Theorem.
Linear Programming Unit 2, Lesson 4 10/13.
Instructor Neelima Gupta Table of Contents Lp –rounding Dual Fitting LP-Duality.
1 Polynomial Church-Turing thesis A decision problem can be solved in polynomial time by using a reasonable sequential model of computation if and only.
Linear Programming and Approximation
Computability and Complexity 24-1 Computability and Complexity Andrei Bulatov Approximation.
Job Scheduling Lecture 19: March 19. Job Scheduling: Unrelated Multiple Machines There are n jobs, each job has: a processing time p(i,j) (the time to.
CSE 421 Algorithms Richard Anderson Lecture 27 NP Completeness.
Math – Getting Information from the Graph of a Function 1.
Approximating Minimum Bounded Degree Spanning Tree (MBDST) Mohit Singh and Lap Chi Lau “Approximating Minimum Bounded DegreeApproximating Minimum Bounded.
The Complexity of Optimization Problems. Summary -Complexity of algorithms and problems -Complexity classes: P and NP -Reducibility -Karp reducibility.
3.4 Linear Programming p Optimization - Finding the minimum or maximum value of some quantity. Linear programming is a form of optimization where.
Theory of Computing Lecture 13 MAS 714 Hartmut Klauck.
Linear Programming: A Geometric Approach3 Graphing Systems of Linear Inequalities in Two Variables Linear Programming Problems Graphical Solution of Linear.
Linear Equations in Two Variables A Linear Equation in Two Variables is any equation that can be written in the form where A and B are not both zero.
Notes 7.5 – Systems of Inequalities. I. Half-Planes A.) Given the inequality, the line is the boundary, and the half- plane “below” the boundary is the.
Linear Programming Problem. Definition A linear programming problem is the problem of optimizing (maximizing or minimizing) a linear function (a function.
Linear Programming Advanced Math Topics Mrs. Mongold.
NP-Complete Problems. Running Time v.s. Input Size Concern with problems whose complexity may be described by exponential functions. Tractable problems.
Linear Program Set Cover. Given a universe U of n elements, a collection of subsets of U, S = {S 1,…, S k }, and a cost function c: S → Q +. Find a minimum.
3.4 – Linear Programming. Ex. 1 Graph the system of inequalities. Name the coordinates of the vertices of the feasible region. Find the max & min values.
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
Class Opener: Solve each equation for Y: 1.3x + y = y = 2x 3.x + 2y = 5 4. x – y = x + 3y = x – 5y = -3.
Lecture.6. Table of Contents Lp –rounding Dual Fitting LP-Duality.
Constraints Feasible region Bounded/ unbound Vertices
LINEAR PROGRAMMING 3.4 Learning goals represent constraints by equations or inequalities, and by systems of equations and/or inequalities, and interpret.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
Common Intersection of Half-Planes in R 2 2 PROBLEM (Common Intersection of half- planes in R 2 ) Given n half-planes H 1, H 2,..., H n in R 2 compute.
Sullivan Algebra and Trigonometry: Section 12.9 Objectives of this Section Set Up a Linear Programming Problem Solve a Linear Programming Problem.
Linear Programming Chap 2. The Geometry of LP  In the text, polyhedron is defined as P = { x  R n : Ax  b }. So some of our earlier results should.
Linear Programming: A Geometric Approach3 Graphing Systems of Linear Inequalities in Two Variables Linear Programming Problems Graphical Solution of Linear.
Linear Programming Piyush Kumar Welcome to CIS5930.
3.4 Linear Programming p Optimization - Finding the minimum or maximum value of some quantity. Linear programming is a form of optimization where.
Computational Geometry
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
Lap Chi Lau we will only use slides 4 to 19
2.6 Solving Systems of Linear Inequalities
Richard Anderson Lecture 26 NP-Completeness
Topics in Algorithms Lap Chi Lau.
Richard Anderson Lecture 26 NP-Completeness
Polyhedron Here, we derive a representation of polyhedron and see the properties of the generators. We also see how to identify the generators. The results.
3.2 Linear Programming 3 Credits AS
3-3 Optimization with Linear Programming
Linear Programming.
Linear Programming Objectives: Set up a Linear Programming Problem
3.4 – Linear Programming.
Polyhedron Here, we derive a representation of polyhedron and see the properties of the generators. We also see how to identify the generators. The results.
Richard Anderson Lecture 28 NP-Completeness
Linear Programming and Approximation
8.4 Linear Programming p
Graphing Systems of Linear Inequalities
Problem Solving 4.
Copyright © 2014, 2010, 2007 Pearson Education, Inc.
1. The quadratic function is a second-order polynomial function
Umans Complexity Theory Lectures
1.6 Linear Programming Pg. 30.
Instructor: Aaron Roth
Presentation transcript:

Lower Bounds on Extended Formulations Noah Fleming University of Toronto Supervised by Toniann Pitassi

Linear Programming Max/Min w T x← Objective Function Subject To: Ax ≤ b← Linear Constraints x ≥ 0← Nonnegativity Constraints Size: The number of constraints in the linear program

Approximate Vertex Cover Input: A graph G= (V,E) Output: The minimum set of vertices such that each e ∈ E is adjacent to at least one v ∈ V Min [1,...,1] T x Subject To: x i + x j ≥ 1 ∀ (i, j) ∈ E x i ≥ 0 ∀ i ∈ V

Geometric Representation Max w T x Polytope: n-dimensional shape with flat sides Facets of polytope defined by inequalities in Ax ≤ b Feasible solution: Any point satisfying all the constraints of the linear program

Extended Formulation Add extra variables and constraints to decrease the size of the polytope An extended formulation Ex + Fy = b expresses Ax ≤ b if for every x that satisfies Ax ≤ b, there exists a y such that (x,y) satisfies Ex + Fy = b Extended Formulation Original polytope

Approximate Vertex Cover Input: A graph G= (V,E) Output: The minimum set of vertices such that each e ∈ E is adjacent to at least one v ∈ V Min [1,...,1] T x Subject To: x i + x j ≥ 1 ∀ (i, j) ∈ E x i ≥ 0 ∀ i ∈ V

Extended Formulation Add extra variables and constraints to decrease the size of the polytope An extended formulation Ex + Fy = b expresses Ax ≤ b if for every x that satisfies Ax ≤ b, there exists a y such that (x,y) satisfies Ex + Fy = b Extended Formulation Original polytope

Lower Bounds on Polytopes Slack variable: let x be a vertex, and a i x ≤ b i be a constraint in the system, y is the slack for this constraint if a i x + y = b i Slack matrix SM[i,j] = b i - a i x j

Lower Bounds on Polytopes Factorization Theorem (Yannakakis): Let r be the smallest number such that S M can be written as the product of two nonnegative matrices F and V of dimension f x r and r x v. The minimum size of any linear program expressing the polytope is θ(n + r). Rank + (S M ):= r

Communication Complexity Alice P(x,y) = ? Nondeterministic Communication Complexity N(P): Number of bits needed to represent the proof plus the minimum Number of bits of communication needed to compute P(x,y). Bob Communication Matrix P(x,y)

Lower bounds on polytopes by communication FV(x,y) = 1 if vertex x does not lie on facet y FV(x,y) = 0 otherwise F(x,y) 0/1 S M SMSM Lemma: N(FV) ≤ log 2 (rank + (S M ))

Proof Complexity Propositional Proof System: A polynomial time algorithm P such that for all x, x ∈ TAUT iff there exists a string π such that P(x,π) = 1 Complexity: the smallest function f:→ such that x ∈ TAUT iff there exists a proof π of size |π|  f(|x|) such that P(x, π)=1 Theorem: There exists a propositional proof system with complexity bounded above by a polynomial iff NP=coNP