Solving MPEC’s via Automatic Reformulation as NLP’s S. P. Dirkse, M.C. Ferris, and A. Meeraus GAMS Development Corporation & UW-Madison ISMP-2003 Copenhagen.

Slides:



Advertisements
Similar presentations
Bayesian Belief Propagation
Advertisements

5.4 Functions and Their Inverses CC.9-12.F.BF.1c (+) Compose functions. CC.9-12.A.CED.2 Create equations in two or more variables to represent relationships.
Hadi Goudarzi and Massoud Pedram
Operation Research Chapter 3 Simplex Method.
LECTURE 14 Minimization Two Phase method by Dr. Arshad zaheer
Solving Linear Programming Problems: The Simplex Method

Second order cone programming approaches for handing missing and uncertain data P. K. Shivaswamy, C. Bhattacharyya and A. J. Smola Discussion led by Qi.
Chapter 3 Linear Programming: Sensitivity Analysis and Interpretation of Solution MT 235.
Lecture 5: Learning models using EM
SAT-Based Decision Procedures for Subsets of First-Order Logic
Lecture 24: Thurs. Dec. 4 Extra sum of squares F-tests (10.3) R-squared statistic (10.4.1) Residual plots (11.2) Influential observations (11.3,
Efficient Estimation of Emission Probabilities in profile HMM By Virpi Ahola et al Reviewed By Alok Datar.
Code and Decoder Design of LDPC Codes for Gbps Systems Jeremy Thorpe Presented to: Microsoft Research
U NIVERSITY OF M ASSACHUSETTS, A MHERST Department of Computer Science Optimal Fixed-Size Controllers for Decentralized POMDPs Christopher Amato Daniel.
4-1 Statistical Inference The field of statistical inference consists of those methods used to make decisions or draw conclusions about a population.
1 Wavelet synopses with Error Guarantees Minos Garofalakis Phillip B. Gibbons Information Sciences Research Center Bell Labs, Lucent Technologies Murray.
Inferences About Process Quality
Simultaneous Rate and Power Control in Multirate Multimedia CDMA Systems By: Sunil Kandukuri and Stephen Boyd.
Problem Background Motivation Design a task and bus scheduling tool that works with the automotive design process and captures the constraints that the.
Spreadsheet Modeling & Decision Analysis:
Statistical Methods in Computer Science Hypothesis Testing II: Single-Factor Experiments Ido Dagan.
Unit Organizers feel free to expand, edit, or transform any of these for your own use.
Regression and Correlation Methods Judy Zhong Ph.D.
Introduction to Mathematical Programming OR/MA 504 Chapter 3.
One-Factor Experiments Andy Wang CIS 5930 Computer Systems Performance Analysis.
S519: Evaluation of Information Systems Week 14: April 7, 2008.
Special Conditions in LP Models (sambungan BAB 1)
+ Chapter 9 Summary. + Section 9.1 Significance Tests: The Basics After this section, you should be able to… STATE correct hypotheses for a significance.
Fourer et al., The NEOS Benchmarking Service INFORMS International, Puerto Rico, July 8-11, INFORMS International Session MC07, July 9, 2007 The.
8. Linear Programming (Simplex Method) Objectives: 1.Simplex Method- Standard Maximum problem 2. (i) Greedy Rule (ii) Ratio Test (iii) Pivot Operation.
© 2009 IBM Corporation 1 Improving Consolidation of Virtual Machines with Risk-aware Bandwidth Oversubscription in Compute Clouds Amir Epstein Joint work.
Research Tools and Techniques The Research Process: Step 7 (Data Analysis Part C) Lecture 30.
Notes Over 2.6 Checking Solutions of Inequalities Check whether the given ordered pairs are solutions of the inequality.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Deterministic vs. Random Maximum A Posteriori Maximum Likelihood Minimum.
Benk Erika Kelemen Zsolt
Tarek A. El-Moselhy and Luca Daniel
Mathematical Models & Optimization?
Low-Rank Kernel Learning with Bregman Matrix Divergences Brian Kulis, Matyas A. Sustik and Inderjit S. Dhillon Journal of Machine Learning Research 10.
Statistical Analysis of Inlining Heuristics in Jikes RVM Jing Yang Department of Computer Science, University of Virginia.
Detecting Group Differences: Mining Contrast Sets Author: Stephen D. Bay Advisor: Dr. Hsu Graduate: Yan-Cheng Lin.
Pei-Chuan Tsai Chih-Ming Chen Ying-ping Chen WCCI 2012 IEEE World Congress on Computational Intelligence Sparse Degrees Analysis for LT Codes Optimization.
Copyright © Cengage Learning. All rights reserved. 12 Analysis of Variance.
Point Pattern Analysis
Spreadsheet Modeling & Decision Analysis A Practical Introduction to Management Science 5 th edition Cliff T. Ragsdale.
10-1 An Introduction to Systems A _______ is a set of sentences joined by the word ____ or by a ________________. Together these sentences describe a ______.
Net Criticality Revisited: An Effective Method to Improve Timing in Physical Design H. Chang 1, E. Shragowitz 1, J. Liu 1, H. Youssef 2, B. Lu 3, S. Sutanthavibul.
Monte Carlo Linear Algebra Techniques and Their Parallelization Ashok Srinivasan Computer Science Florida State University
Application Development in Engineering Optimization with Matlab and External Solvers Aalto University School of Engineering.
Appendix A.6 Solving Inequalities. Introduction Solve an inequality  Finding all values of x for which the inequality is true. The set of all real numbers.
Independent Samples ANOVA. Outline of Today’s Discussion 1.Independent Samples ANOVA: A Conceptual Introduction 2.The Equal Variance Assumption 3.Cumulative.
Notes Over 1.6 Solving an Inequality with a Variable on One Side Solve the inequality. Then graph your solution. l l l
Approximation Algorithms based on linear programming.
Lecturer: Ing. Martina Hanová, PhD.. Regression analysis Regression analysis is a tool for analyzing relationships between financial variables:  Identify.
A Collapsed Variational Bayesian Inference Algorithm for Latent Dirichlet Allocation Yee W. Teh, David Newman and Max Welling Published on NIPS 2006 Discussion.
Unconstrained Submodular Maximization Moran Feldman The Open University of Israel Based On Maximizing Non-monotone Submodular Functions. Uriel Feige, Vahab.
Unified Adaptivity Optimization of Clock and Logic Signals Shiyan Hu and Jiang Hu Dept of Electrical and Computer Engineering Texas A&M University.
C. Kiekintveld et al., AAMAS 2009 (USC) Presented by Neal Gupta
Updating SF-Tree Speaker: Ho Wai Shing.
Lecture 3.
Learning Target I can solve and graph multi-step, one-variable inequalities using algebraic properties.
Statistical Process Control
Lecture Slides Elementary Statistics Thirteenth Edition
Effective Social Network Quarantine with Minimal Isolation Costs
The Simplex Method: Nonstandard Problems
Ch11 Curve Fitting II.
Product moment correlation
Objective Solve inequalities that contain variable terms on both sides.
Inequalities in One Variable
Chap. 1: Introduction to Statistics
Presentation transcript:

Solving MPEC’s via Automatic Reformulation as NLP’s S. P. Dirkse, M.C. Ferris, and A. Meeraus GAMS Development Corporation & UW-Madison ISMP-2003 Copenhagen August 17-22, 2003

2 Background & Motivation GAMS/Convert – scalar model tools –GAMS -> other formats/languages –Why not MPEC -> NLP? Function libraries Solid suite of NLP solvers Existing reformulation work –Tin-Loi, Que –Scholtes, Billups, C-M, F-B, Anitescu –Hamish Mac-MPEC

3 Introduction Background and motivation MPEC reformulation –Strategies & variations –Function libraries NLPEC & testing environment Computational experiments

4 MPEC Definition The NLP constraints are left alone Force a solution y of MCP(h,B) via reformulation

5 MCP Definition

6 Alternative MCP

7 Inner Product Reformulation Assume y in B Summation vs. componentwise –Sum {i=1..M, } = 0 – = 0, i=1..M Equality vs. inequality Parameter on RHS Double-bounded pairs are a special case

8 Slack Variables We can use slack variables for h(x,y) –Bounded or not –One or two slacks per h i Computationally, slacks are significant

9 Scholtes Reformulation

10 Smoothed NCP-functions An NCP-function has the following property: Various smoothed NCP-functions proposed

11 Billups Reformulation NCP-functions assume the single-bounded case Can be adapted to handle the double-bounded case

12 Special Functions Functions are well-defined in spite of the overflow Smoothed NCP-functions implemented in GAMS Code shared between GAMS and solvers

13 GAMS/NLPEC Based on scalar-mode GAMS format Rewrite model based on reformulation rules Call NLP solver Recover MPEC solution from NLP solution

14 GAMS/NLPEC MPEC model NLP Model NLP Solver Reformulate, set initial pointRecover MPEC solution Read NLP solutionCall NLP solver

15 NLPEC Options Set the reformulation type! Set parameters for penalization, smoothing Drive penalties down in loop Set initial values for slack variables Control parameters for automated tests

16 MPEC Lib

17 Performance World

18 PTools: Performance Profiles Performance Profiles (Dolan and Moré, 2002): Cumulative distribution function for a performance metric Performance metric: ratio of current solver time over best time of all solvers for “success” Intuitively: probability of success if allowed  multiples of the best time (  =ratio)

19 PTools: Performance Profiles Interpretation (for  =ratio, P=profile): Efficiency: Probability of success: Compact graphs summarize all information

20 Example Profile

21 GAMS/Examiner Independent check of solution accuracy Check feasibility and optimality –Can check a subset of these –User can set tolerances used, etc. Runs in between GAMS and a solver –Acts as a silent observer

22 Sample Experiment II 92 models from MPECLIB Run “all” NLPEC reformulations - 52 –NLP solvers: CONOPT, MINOS, SNOPT. –Use Examiner to verify Compare performance using: –GAMS –PTools.

23 ConoptMINOSSNOPTanysolv er er er er er er er er er er er er er Feasibility %

24 Notable Reforms Reforms –1: i = µ, bnd slacks for L,U,B –2: i <= µ, bnd slacks for L,U,B –3: i = µ, bnd slacks for L,U + Scholtes,slack –5: L+U+B = µ, no slacks for L,U, bnd slack for B –21: L+U+B <= µ, bnd slacks for L,U,B –22: F-B i = 0, bdd slacks for L,U,B Option files –1: initmu =.01, numsolves = 5, finalmu = 0 –2: initmu = 1, numsolves = 5, finalmu = 0

25 Summary statistics II 94% of models solved by some means “Best” technique for feasibility: – reform % –6 reforms >= 90%, 28 reforms >= 80% “Best” technique for optimality: – reform 21.5 or % –5 reforms >= 70%, 15 reforms >= 60%

26 Success = Feasibility

27 Success = Feasibility

28 Success = BestFound

29 Success = BestFound

30 Conclusions Reformulation a viable MPEC solution strategy. Special functions required for some reforms. Very different strategies competitive: –Component-wise inner products –Fischer-Burmeister –Scholtes, Billups Presentation with code to reproduce results: