1 Ellipsoid-type Confidential Bounds on Semi-algebraic Sets via SDP Relaxation Makoto Yamashita Masakazu Kojima Tokyo Institute of Technology.

Slides:



Advertisements
Similar presentations
3.4 Linear Programming 10/31/2008. Optimization: finding the solution that is either a minimum or maximum.
Advertisements

Optimization of thermal processes2007/2008 Optimization of thermal processes Maciej Marek Czestochowa University of Technology Institute of Thermal Machinery.
Linear Programming Problem
Solving IPs – Cutting Plane Algorithm General Idea: Begin by solving the LP relaxation of the IP problem. If the LP relaxation results in an integer solution,
Integer linear programming Optimization problems where design variables have to be integers are more difficult than ones with continuous variables. The.
MS&E 211 Quadratic Programming Ashish Goel. A simple quadratic program Minimize (x 1 ) 2 Subject to: -x 1 + x 2 ≥ 3 -x 1 – x 2 ≥ -2.
1 OR II GSLM Outline  some terminology  differences between LP and NLP  basic questions in NLP  gradient and Hessian  quadratic form  contour,
Sum of Squares and SemiDefinite Programmming Relaxations of Polynomial Optimization Problems The 2006 IEICE Society Conference Kanazawa, September 21,
C&O 355 Mathematical Programming Fall 2010 Lecture 15 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A.
Ch 2. 6 – Solving Systems of Linear Inequalities & Ch 2
Convex Position Estimation in Wireless Sensor Networks
Lecture 8 – Nonlinear Programming Models Topics General formulations Local vs. global solutions Solution characteristics Convexity and convex programming.
by Rianto Adhy Sasongko Supervisor: Dr.J.C.Allwright
L12 LaGrange Multiplier Method Homework Review Summary Test 1.
SE- 521: Nonlinear Programming and Applications S. O. Duffuaa.
Easy Optimization Problems, Relaxation, Local Processing for a small subset of variables.
Classification and Prediction: Regression Via Gradient Descent Optimization Bamshad Mobasher DePaul University.
Silhouettes in Multiview Stereo Ian Simon. Multiview Stereo Problem Input: – a collection of images of a rigid object (or scene) – camera parameters for.
1 Introduction to Linear and Integer Programming Lecture 9: Feb 14.
Support Vector Machines Formulation  Solve the quadratic program for some : min s. t.,, denotes where or membership.  Different error functions and measures.
Unconstrained Optimization Problem
Branch and Bound Algorithm for Solving Integer Linear Programming
Approximation Algorithms: Bristol Summer School 2008 Seffi Naor Computer Science Dept. Technion Haifa, Israel TexPoint fonts used in EMF. Read the TexPoint.
Linear Programming Operations Research – Engineering and Math Management Sciences – Business Goals for this section  Modeling situations in a linear environment.
How are we computing? Invalidation Certificates Consider invalidating the constraints (prior info, and N dataset units) The invalidation certificate is.
High Performance Solvers for Semidefinite Programs
Computational Geometry Piyush Kumar (Lecture 5: Linear Programming) Welcome to CIS5930.
Finding a Hausdorff Core of a Polygon: On Convex Polygon Containment with Bounded Hausdorff Distance Reza Dorrigiv, Stephane Durocher, Arash Farzan, Robert.
Sparsity in Polynomial Optimization IMA Annual Program Year Workshop "Optimization and Control" Minneapolis, January 16-20, 2007 Masakazu Kojima Tokyo.
Nonlinear Programming.  A nonlinear program (NLP) is similar to a linear program in that it is composed of an objective function, general constraints,
3.4 Linear Programming p Optimization - Finding the minimum or maximum value of some quantity. Linear programming is a form of optimization where.
Linear Programming: Data Fitting Steve Gu Mar 21, 2008.
Opener. Notes: 3.4 Linear Programming Optimization  Many real-life problems involve a process called optimization.  This means finding a maximum or.
Warm-Up 3.4 1) Solve the system. 2) Graph the solution.
Linear Programming Advanced Math Topics Mrs. Mongold.
D. M. J. Tax and R. P. W. Duin. Presented by Mihajlo Grbovic Support Vector Data Description.
Class Schedule: Class Announcements Homework Questions 3.4 Notes Begin Homework.
1 Efficient Parallel Software for Large-Scale Semidefinite Programs Makoto Tokyo-Tech Katsuki Chuo University MSC Yokohama.
Introduction to Semidefinite Programs Masakazu Kojima Semidefinite Programming and Its Applications Institute for Mathematical Sciences National University.
1 Enclosing Ellipsoids of Semi-algebraic Sets and Error Bounds in Polynomial Optimization Makoto Yamashita Masakazu Kojima Tokyo Institute of Technology.
Nonsmooth Optimization for Optimal Power Flow over Transmission Networks GlobalSIP 2015 Authors: Y. Shi, H. D. Tuan, S. W. Su and H. H. M. Tam.
Linear Programming Short-run decision making model –Optimizing technique –Purely mathematical Product prices and input prices fixed Multi-product production.
Managerial Economics Linear Programming Aalto University School of Science Department of Industrial Engineering and Management January 12 – 28, 2016 Dr.
LINEAR PROGRAMMING 3.4 Learning goals represent constraints by equations or inequalities, and by systems of equations and/or inequalities, and interpret.
3-5: Linear Programming. Learning Target I can solve linear programing problem.
Instructional Design Document Simplex Method - Optimization STAM Interactive Solutions.
Linear Programming Piyush Kumar Welcome to CIS5930.
1 Chapter 5 Branch-and-bound Framework and Its Applications.
1 An approach based on shortest path and connectivity consistency for sensor network localization problems Makoto Yamashita (Tokyo Institute of Technology)
Core-Sets and Geometric Optimization problems.
EMGT 6412/MATH 6665 Mathematical Programming Spring 2016
Nonnegative polynomials and applications to learning
SOS is not obviously automatizable,
3.2 Linear Programming 3 Credits AS
3-3 Optimization with Linear Programming
Linear Programming.
Mathematical Programming (towards programming with math)
8.4 Linear Programming p
Compute convex lower bounding function and optimize it instead!
Warm Up Solve for x:
Linear Programming Example: Maximize x + y x and y are called
Linear Programming Problem
1.6 Linear Programming Pg. 30.
MATH TALK POWER NUMBER 64 Set 1.
MATH TALK POWER NUMBER 27.
MATH TALK POWER NUMBER 36.
MATH TALK POWER NUMBER 25.
MATH TALK POWER NUMBER 64 Set 2.
MATH TALK POWER NUMBER 16.
Presentation transcript:

1 Ellipsoid-type Confidential Bounds on Semi-algebraic Sets via SDP Relaxation Makoto Yamashita Masakazu Kojima Tokyo Institute of Technology

2 Confidential Bounds in Polynomial Optimization Problem min Optimal SDP relaxation (convex region) SDP solution Local adjustment for feasible region We compute this ellipsoid by SDP. Optimal solutions exist in this ellipsoid. Feasible region Semi-algebraic Sets (Polynomials)

3 Ellipsoid research ..  MVEE (the minimum volume enclosing ellipsoid)  Our approach based on SDP relaxation Solvable by SDP Small computation cost ⇒ We can execute multiple times changing

Outline 1.Math Form of Ellipsoids 2.SDP relaxation 3.Examples of POP 4.Tightness of Ellipsoids 4

5 Mathematical Formulation ..  Ellipsoid We define .. By some steps, we consider SDP relaxation

.. ..  Note that  Furthermore 6 Lifting ⇒ quadratic linear (easier) Still difficult (convex hull)

7 SDP relaxation .. .. relaxation

8 .. ..  Gradient  Optimal attained at ..  Cover Inner minimization

9 Relations of SDP

10 Example from POP  ex9_1_2 from GLOBAL library (  We use SparsePOP to solve this by SDP relaxation SparsePOP

11 Region of the Solution

12 Reduced POP Optimal Solutions:

13 Ellipsoids for Reduced SDP Optimal Solutions: Very tight bound

14 Results on POP  Very good objective values  ex_9_1_2 & ex_9_1_8 have multiple optimal solutions ⇒ large radius

Tightness of Ellipsoids  Target set  6 Shape Matricies  We draw 2D picture, 15

The case p=2 (2 constraints)  The ellipsoids are tight. 16 Target set 6 ellipsoids by SDP

More constraints 17 Ellipsoids shrink. But its speed is slower than the target set. p=2 p=32 p=128

18 Conclusion & Future works  An enclosing ellipsoid by SDP relaxation Improve the SDP solution of POP Very low computation cost  Successive ellipsoid for POP sometimes stops before bounding the region appropriately  Ellipsoids may become loose in the case of many constraints

19  Thank you very much for your attention. This talk is based on the following technical paper Masakazu Kojima and Makoto Yamashita, “ Enclosing Ellipsoids and Elliptic Cylinders of Semialgebraic Sets and Their Application to Error Boundsin Polynomial Optimization ”, Research Report B-459, Dept. of Math. and Comp. Sciences,Tokyo Institute of Technology, Oh-Okayama, Meguro, Tokyo ,January 2010.