CSE291 Convex Optimization: Problem Statement

Slides:



Advertisements
Similar presentations
C&O 355 Mathematical Programming Fall 2010 Lecture 9
Advertisements

CS 140 Lecture 16 System Designs Professor CK Cheng CSE Dept. UC San Diego 1.
1 CS 140L Lecture 8 System Design Professor CK Cheng CSE Dept. UC San Diego.
CS 140 Lecture 10 Sequential Networks: Implementation Professor CK Cheng CSE Dept. UC San Diego 1.
+ Convex Functions, Convex Sets and Quadratic Programs Sivaraman Balakrishnan.
by Rianto Adhy Sasongko Supervisor: Dr.J.C.Allwright
N.U.S. - January 13, 2006 Gert Lanckriet U.C. San Diego Classification problems with heterogeneous information sources.
Computational Geometry The art of finding algorithms for solving geometrical problems Literature: –M. De Berg et al: Computational Geometry, Springer,
1 CS 140 Lecture 3 Combinational Logic Professor CK Cheng CSE Dept. UC San Diego.
Support Vector Classification (Linearly Separable Case, Primal) The hyperplanethat solves the minimization problem: realizes the maximal margin hyperplane.
The Widrow-Hoff Algorithm (Primal Form) Repeat: Until convergence criterion satisfied return: Given a training set and learning rate Initial:  Minimize.
Classification Problem 2-Category Linearly Separable Case A- A+ Malignant Benign.
Convex Sets (chapter 2 of Convex programming) Keyur Desai Advanced Machine Learning Seminar Michigan State University.
Support Vector Machines and Kernel Methods
CS 140 Lecture 4 Combinational Logic: K-Map Professor CK Cheng CSE Dept. UC San Diego 1.
The Implicit Mapping into Feature Space. In order to learn non-linear relations with a linear machine, we need to select a set of non- linear features.
1 CS 140 Lecture 3 Combinational Logic Professor CK Cheng CSE Dept. UC San Diego.
Lecture 10: Support Vector Machines
CS 140 Lecture 5 Professor CK Cheng CSE Dept. UC San Diego.
CS 140 Lecture 5 Professor CK Cheng CSE Dept. UC San Diego 1.
Lecture 3: Incompletely Specified Functions and K Maps CSE 140: Components and Design Techniques for Digital Systems Fall 2014 CK Cheng Dept. of Computer.
Linear Programming System of Linear Inequalities  The solution set of LP is described by Ax  b. Gauss showed how to solve a system of linear.
Efficient Integration of Large Stiff Systems of ODEs Using Exponential Integrators M. Tokman, M. Tokman, University of California, Merced 2 hrs 1.5 hrs.
Artificial Intelligence: Introduction Department of Computer Science & Engineering Indian Institute of Technology Kharagpur.
Machine Learning Weak 4 Lecture 2. Hand in Data It is online Only around 6000 images!!! Deadline is one week. Next Thursday lecture will be only one hour.
I.4 Polyhedral Theory 1. Integer Programming  Objective of Study: want to know how to describe the convex hull of the solution set to the IP problem.
CSE4334/5334 DATA MINING CSE4334/5334 Data Mining, Fall 2014 Department of Computer Science and Engineering, University of Texas at Arlington Chengkai.
1.2 Guidelines for strong formulations  Running time for LP usually depends on m and n ( number of iterations O(m), O(log n)). Not critically depend on.
Proving that a Valid Inequality is Facet-defining  Ref: W, p  X  Z + n. For simplicity, assume conv(X) bounded and full-dimensional. Consider.
CSE 140: Components and Design Techniques for Digital Systems Lecture 3: Incompletely Specified Functions and K Maps CK Cheng Dept. of Computer Science.
Lecture 4: Four Input K-Maps CSE 140: Components and Design Techniques for Digital Systems CK Cheng Dept. of Computer Science and Engineering University.
CSE 140: Components and Design Techniques for Digital Systems Lecture 6: Universal Gates CK Cheng Dept. of Computer Science and Engineering University.
Linear Programming Chapter 9. Interior Point Methods  Three major variants  Affine scaling algorithm - easy concept, good performance  Potential.
Lecture 5: K-Map minimization in larger input dimensions and K-map minimization using max terms CSE 140: Components and Design Techniques for Digital Systems.
OR II GSLM
Nonlinear Adaptive Kernel Methods Dec. 1, 2009 Anthony Kuh Chaopin Zhu Nate Kowahl.
Lecture 3: Incompletely Specified Functions and K Maps
ML estimation in Gaussian graphical models
Lecture 6: Universal Gates
Curve & Surface.
CSE 140: Components and Design Techniques for Digital Systems
CSE291 Convex Optimization (CSE203B Pending)
EMGT 6412/MATH 6665 Mathematical Programming Spring 2016
Proving that a Valid Inequality is Facet-defining
Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization Presenter: Xia Li.
Lecture 3: Incompletely Specified Functions and K Maps
Chap 9. General LP problems: Duality and Infeasibility
Polyhedron Here, we derive a representation of polyhedron and see the properties of the generators. We also see how to identify the generators. The results.
Lecture 6: Universal Gates
1.4 The Extreme Point Theorem : Geometry of a linear programming problem The set of feasible solutions to a general linear programming problem is a convex.
CSE 140: Components and Design Techniques for Digital Systems
Michael Overton Scientific Computing Group Broad Interests
Polyhedron Here, we derive a representation of polyhedron and see the properties of the generators. We also see how to identify the generators. The results.
Quadratic Forms and Objective functions with two or more variables
Lecture 6: Universal Gates
Ray Tracing Polyhedra ©Anthony Steed
Sensitivity Analysis by Adjoint Network
CS480/680: Intro to ML Lecture 09: Kernels 23/02/2019 Yao-Liang Yu.
Outline Unconstrained Optimization Functions of One Variable
System of Linear Inequalities
CSE 140 Lecture 3 Combinational Logic: Implementation
Professor CK Cheng CSE Dept. UC San Diego
I.4 Polyhedral Theory (NW)
Quantum Foundations Lecture 3
Qi-Ming He, Mark Fackrell, and Peter Taylor
I.4 Polyhedral Theory.
Proving that a Valid Inequality is Facet-defining
Checking the Consistency of Local Density Matrices
CSE203B Convex Optimization
Lecture 3: Incompletely Specified Functions and K Maps
Presentation transcript:

CSE291 Convex Optimization: Problem Statement CK Cheng Dept. of Computer Science and Engineering University of California, San Diego

Outlines General Convex Problem Formats Convex Sets Convex Functions Specification Sets and Definitions Convex Functions Convex Optimization Problems

General Formats min f0(x) subject to fi(x)≤bi, i=1, …, m, where functions f0,…,fm: Rn→R are convex, i.e. fi(αx+βy) ≤αfi(x)+βfi(y) for all x, y ϵ Rn and all α, β ϵ R with α+β=1, α≥0, β≥0. Examples:

General Formats min f0(x) subject to fi(x)≤bi, i=1, …, m, f0 is a convex function {x| fi(x) ≤bi} is a convex set for all i=1, …,m Convex set C: for all x, yϵ C αx+βy ϵ C, for all α+β=1, and α, β≥0. Examples:

Outlines General Convex Problem Formats Convex Sets Specification Sets and Definitions Affine Sets, Cones, Convex Hulls Hyperplanes and Half Spaces Polyhedra Matrix Positive Semidefinite Cones Dual Cones

Convex Set Specification We can describe the convex sets using Implicit Expression (equations) Explicit Expression (enumerations) Examples:

Explicit Expression: Examples {θ1u1+θ2u2+…+θkuk | θ1+θ2+…+θk=1, θi≥0, for all i}

Sets and Definitions Affine Sets, Cones, Convex Hulls Hyperplanes and Half Spaces Polyhedra (poly + hedron) Matrix Positive Semidefinite Cones Dual Cones Examples