Pablo A. Parrilo ETH Zürich Semialgebraic Relaxations and Semidefinite Programs Pablo A. Parrilo ETH Zürich control.ee.ethz.ch/~parrilo.

Slides:



Advertisements
Similar presentations
1 A Convex Polynomial that is not SOS-Convex Amir Ali Ahmadi Pablo A. Parrilo Laboratory for Information and Decision Systems Massachusetts Institute of.
Advertisements

Primal Dual Combinatorial Algorithms Qihui Zhu May 11, 2009.
C&O 355 Lecture 9 N. Harvey TexPoint fonts used in EMF.
Satyen Kale (Yahoo! Research) Joint work with Sanjeev Arora (Princeton)
C&O 355 Lecture 23 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
Geometry and Theory of LP Standard (Inequality) Primal Problem: Dual Problem:
1 Matching Polytope x1 x2 x3 Lecture 12: Feb 22 x1 x2 x3.
C&O 355 Mathematical Programming Fall 2010 Lecture 22 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A.
Globally Optimal Estimates for Geometric Reconstruction Problems Tom Gilat, Adi Lakritz Advanced Topics in Computer Vision Seminar Faculty of Mathematics.
Games, Proofs, Norms, and Algorithms Boaz Barak – Microsoft Research Based (mostly) on joint works with Jonathan Kelner and David Steurer.
1 Computational Complexity (Ctnd.) ORF 523 Lecture 15 Instructor: Amir Ali Ahmadi TA: G. Hall Spring 2015.
by Rianto Adhy Sasongko Supervisor: Dr.J.C.Allwright
Semi-Definite Algorithm for Max-CUT Ran Berenfeld May 10,2005.
Approximation Algoirthms: Semidefinite Programming Lecture 19: Mar 22.
Computational problems, algorithms, runtime, hardness
Totally Unimodular Matrices Lecture 11: Feb 23 Simplex Algorithm Elliposid Algorithm.
Semidefinite Programming
1 Introduction to Linear and Integer Programming Lecture 9: Feb 14.
Introduction to Linear and Integer Programming Lecture 7: Feb 1.
Duality Lecture 10: Feb 9. Min-Max theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum Cut Both.
Dual Problem of Linear Program subject to Primal LP Dual LP subject to ※ All duality theorems hold and work perfectly!
1 Introduction to Kernels Max Welling October (chapters 1,2,3,4)
Approximation Algorithms
Pablo A. Parrilo ETH Zürich SOS Relaxations for System Analysis: Possibilities and Perspectives Pablo A. Parrilo ETH Zürich control.ee.ethz.ch/~parrilo.
Classification Problem 2-Category Linearly Separable Case A- A+ Malignant Benign.
Analysis of Algorithms CS 477/677
Lift-and-Project cuts: an efficient solution method for mixed-integer programs Sebastian Ceria Graduate School of Business and Computational Optimization.
T he Separability Problem and its Variants in Quantum Entanglement Theory Nathaniel Johnston Institute for Quantum Computing University of Waterloo.
Integrality Gaps for Sparsest Cut and Minimum Linear Arrangement Problems Nikhil R. Devanur Subhash A. Khot Rishi Saket Nisheeth K. Vishnoi.
C&O 355 Mathematical Programming Fall 2010 Lecture 17 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A.
The Polynomial Time Algorithm for Testing Primality George T. Gilbert.
The method of moments in dynamic optimization
TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A A A A A A A Image:
Machine Learning Weak 4 Lecture 2. Hand in Data It is online Only around 6000 images!!! Deadline is one week. Next Thursday lecture will be only one hour.
Graph algebras and extremal graph theory László Lovász April
Stability Region Analysis using composite Lyapunov functions and bilinear SOS programming Support from AFOSR FA , April 05-November 06 Authors.
Introduction to Semidefinite Programs Masakazu Kojima Semidefinite Programming and Its Applications Institute for Mathematical Sciences National University.
C&O 355 Mathematical Programming Fall 2010 Lecture 5 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A.
Embedding Formulations, Complexity and Representability for Unions of Convex Sets Juan Pablo Vielma Massachusetts Institute of Technology CMO-BIRS Workshop:
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
CPSC 536N Sparse Approximations Winter 2013 Lecture 1 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAAAAAAA.
SDP hierarchies and quantum states Aram Harrow (MIT)Simons Institute
Yuan Zhou, Ryan O’Donnell Carnegie Mellon University.
Boaz Barak (MSR New England) Fernando G.S.L. Brandão (Universidade Federal de Minas Gerais) Aram W. Harrow (University of Washington) Jonathan Kelner (MIT)
C&O 355 Lecture 19 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
Dense graph limit theory: Extremal graph theory László Lovász Eötvös Loránd University, Budapest May
Linear Programming Piyush Kumar Welcome to CIS5930.
Approximation Algorithms based on linear programming.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
Yuan Zhou Carnegie Mellon University Joint works with Boaz Barak, Fernando G.S.L. Brandão, Aram W. Harrow, Jonathan Kelner, Ryan O'Donnell and David Steurer.
Primbs, MS&E345 1 Measure Theory in a Lecture. Primbs, MS&E345 2 Perspective  -Algebras Measurable Functions Measure and Integration Radon-Nikodym Theorem.
Sebastian Ceria Graduate School of Business and
Detecting nonlocality in many-body quantum states
Lap Chi Lau we will only use slides 4 to 19
Topics in Algorithms Lap Chi Lau.
Polynomial Norms Amir Ali Ahmadi (Princeton University) Georgina Hall
Amir Ali Ahmadi (Princeton University)
Georgina Hall Princeton, ORFE Joint work with Amir Ali Ahmadi
Algorithmic Game Theory and Internet Computing
Nonnegative polynomials and applications to learning
Sum of Squares, Planted Clique, and Pseudo-Calibration
Propositional Calculus: Boolean Algebra and Simplification
Local Gain Analysis of Nonlinear Systems
Chapter 6. Large Scale Optimization
Mathematical Programming (towards programming with math)
A particular discrete dynamical program used as a model for one specific situation in chess involving knights and rooks 22nd EUROPEAN CONFERENCE ON OPERATIONS.
Chapter 6. Large Scale Optimization
1.2 Guidelines for strong formulations
Presentation transcript:

Pablo A. Parrilo ETH Zürich Semialgebraic Relaxations and Semidefinite Programs Pablo A. Parrilo ETH Zürich control.ee.ethz.ch/~parrilo

Semialgebraic modeling  Many problems in different domains can be modeled by polynomial inequalities  Continuous, discrete, hybrid  NP-hard in general  Tons of examples: spin glasses, max-cut, nonlinear stability, robustness analysis, entanglement, etc. How to prove things about them, in an algorithmic, certified and efficient way?

Proving vs. disproving  Really, it’s automatic theorem proving  Big difference: finding counterexamples vs. producing proofs (NP vs. co-NP)  A good decision theory exists (Tarski- Seidenberg, etc), but practical performance is generally poor  Want unconditionally valid proofs, but may fail to get them sometimes  We use a particular proof system from real algebra: the Positivstellensatz

An example Is empty, since with Reason: consider signs on candidate feasible points

 Generalizes Hilbert’s Nullstellensatz, LP duality.  Infeasibility certificates for polynomial systems over the reals.  Sums of squares (SOS) are essential  Conditions are convex in f,g  Bounded degree solutions can be computed!  A convex optimization problem.  Furthermore, it’s a semidefinite program Positivstellensatz (Real Nullstellensatz) if and only if

P-satz proofs (P., Caltech thesis 2000, Math Prog 2003)  Proofs are given by algebraic identities  Extremely easy to verify  Use convex optimization to search for them  Convexity, hence a duality structure:  On the primal, simple proofs.  On the dual, weaker models (liftings, etc)  General algorithmic construction  Techniques for exploiting problem structure

P-satz relaxations Exploit structure Symmetry reduction Ideal structure Sparsity Graph structure Semidefinite programs Polynomial descriptions

Exploiting structure Isolate algebraic properties!  Symmetry reduction: invariance under a group  Sparsity: Few nonzeros, Newton polytopes  Ideal structure: Equalities, quotient ring  Graph structure: use the dependency graph to simplify the SDPs Methods (mostly) commute, can mix and match

A few applications  Continuous and combinatorial optimization  Optimization of polynomials  Graphs: stability numbers, cuts, …  Dynamical systems: Lyapunov and Bendixson- Dulac functions  Robustness analysis  Reachability analysis: set mappings, …  Geometric theorem proving  Today: deciding quantum entanglement

AB QM state described by PSD Hermitian matrices ρ (density matrix, mixed states)  States of multipartite systems are described by operators on the tensor product of vector spaces

Separable states: convex combination of product states. Entangled states: all the rest Interpretation: statistical ensemble of locally prepared states. Separable states Z ρ Q: How to determine whether or not a given quantum state is entangled ? Decision problem is NP-hard (Gurvits)

Entangled not-PPT Separable Entangled PPT New relaxations Use the techniques to find certified “entanglement witnesses,” generalizations of Bell’s inequalities. The witnesses are self-certified, e.g. Obtain a hierarchy of SDP-testable conditions. For all entangled states tried, the second level of the hierarchy is enough!

Future challenges  Structure: we know a lot, can we do more?  A good algorithmic use of abstractions, and randomization.  Infinite # of variables? Possible, but not too nice computationally. PSD integral operators, discretizations, etc.  Other kinds of structure to exploit?  Algorithmics: alternatives to interior point?

Summary  Algorithmic construction of SDP relaxations  Generalization of many earlier schemes  Very powerful in practice  Done properly, can fully exploit structure  Lots of applications: bounds for combinatorial problems, control & dynamical systems, entanglement, …