Classification Analytical methods classical methods

Slides:



Advertisements
Similar presentations
Engineering Optimization
Advertisements

Optimization. f(x) = 0 g i (x) = 0 h i (x)
Optimization methods Review
1 TTK4135 Optimization and control B.Foss Spring semester 2005 TTK4135 Optimization and control Spring semester 2005 Scope - this you shall learn Optimization.
SE- 521: Nonlinear Programming and Applications S. O. Duffuaa.
Empirical Maximum Likelihood and Stochastic Process Lecture VIII.
Optimization of thermal processes2007/2008 Optimization of thermal processes Maciej Marek Czestochowa University of Technology Institute of Thermal Machinery.
Optimization of a FEA Beam Element Model for Computational Speed and Accuracy Brent Weight and Ryan Weight.
D Nagesh Kumar, IIScOptimization Methods: M1L1 1 Introduction and Basic Concepts (i) Historical Development and Model Building.
Numerical Optimization
Function Optimization Newton’s Method. Conjugate Gradients
1 Simulation Modeling and Analysis Session 13 Simulation Optimization.
Design Optimization School of Engineering University of Bradford 1 Numerical optimization techniques Unconstrained multi-parameter optimization techniques.
MAE 552 – Heuristic Optimization Lecture 3 January 28, 2002.
Supply Chain Design Problem Tuukka Puranen Postgraduate Seminar in Information Technology Wednesday, March 26, 2009.
Iteration Technique toward SOC EDA Lab, Department of Computer Science and Technology, Tsinghua University
Optimization Methods One-Dimensional Unconstrained Optimization
What is Learning All about ?  Get knowledge of by study, experience, or being taught  Become aware by information or from observation  Commit to memory.
Function Optimization. Newton’s Method Conjugate Gradients Method
Advanced Topics in Optimization
D Nagesh Kumar, IIScOptimization Methods: M2L3 1 Optimization using Calculus Optimization of Functions of Multiple Variables: Unconstrained Optimization.
Optimization Methods One-Dimensional Unconstrained Optimization
LINEAR PROGRAMMING PROBLEM Definition and Examples.
Introduction to Optimization (Part 1)
9 1 Performance Optimization. 9 2 Basic Optimization Algorithm p k - Search Direction  k - Learning Rate or.
UNCONSTRAINED MULTIVARIABLE
C&O 355 Mathematical Programming Fall 2010 Lecture 1 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A.
AUTOMATIC CONTROL THEORY II Slovak University of Technology Faculty of Material Science and Technology in Trnava.
1 Chapter 8 Nonlinear Programming with Constraints.
ENCI 303 Lecture PS-19 Optimization 2
Application of Differential Applied Optimization Problems.
Business Analytics with Nonlinear Programming
1 汽车优化设计 王琥 湖南大学 机械与运载工程学院 汽车车身先进设计制造国家重点实验室.
Computer Animation Rick Parent Computer Animation Algorithms and Techniques Optimization & Constraints Add mention of global techiques Add mention of calculus.
Mathematical Models & Optimization?
559 Fish 559; Lecture 5 Non-linear Minimization. 559 Introduction Non-linear minimization (or optimization) is the numerical technique that is used by.
ZEIT4700 – S1, 2015 Mathematical Modeling and Optimization School of Engineering and Information Technology.
Analytic Placement Algorithms Chung-Kuan Cheng CSE Department, UC San Diego, CA Contact: 1.
Operations Research The OR Process. What is OR? It is a Process It assists Decision Makers It has a set of Tools It is applicable in many Situations.
1 Chapter 6 General Strategy for Gradient methods (1) Calculate a search direction (2) Select a step length in that direction to reduce f(x) Steepest Descent.
Chapter 2-OPTIMIZATION G.Anuradha. Contents Derivative-based Optimization –Descent Methods –The Method of Steepest Descent –Classical Newton’s Method.
Nonlinear Programming In this handout Gradient Search for Multivariable Unconstrained Optimization KKT Conditions for Optimality of Constrained Optimization.
Optimization in Engineering Design 1 Introduction to Non-Linear Optimization.
INTRO TO OPTIMIZATION MATH-415 Numerical Analysis 1.
DEPARTMENT/SEMESTER ME VII Sem COURSE NAME Operation Research Manav Rachna College of Engg.
Operations Research Models and Methods Advanced Operations Research Reference: Operations Research Models and Methods, Operations Research Models and Methods,
Ch. Eick: Num. Optimization with GAs Numerical Optimization General Framework: objective function f(x 1,...,x n ) to be minimized or maximized constraints:
Searching a Linear Subspace Lecture VI. Deriving Subspaces There are several ways to derive the nullspace matrix (or kernel matrix). ◦ The methodology.
D Nagesh Kumar, IISc Water Resources Systems Planning and Management: M2L2 Introduction to Optimization (ii) Constrained and Unconstrained Optimization.
OPTIMIZATION PROBLEMS OF ELECTRIC POWER SUPPLY Томский политехнический университет.
Water resources planning and management by use of generalized Benders decomposition method to solve large-scale MINLP problems By Prof. André A. Keller.
Lecture 20 Review of ISM 206 Optimization Theory and Applications.
On the Computation of All Global Minimizers Through Particle Swarm Optimization IEEE Transactions On Evolutionary Computation, Vol. 8, No.3, June 2004.
Optimal Control.
Bounded Nonlinear Optimization to Fit a Model of Acoustic Foams
deterministic operations research
Non-linear relationships
Non-linear Minimization
SIMULATION SIMULAND PURPOSE TECHNIQUE CREDIBILITY PROGRAMMATICS
Mathematical Programming
Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization Presenter: Xia Li.
Nuclear Norm Heuristic for Rank Minimization
CS5321 Numerical Optimization
L12. Network optimization
Optimization Part II G.Anuradha.
Part 4 Nonlinear Programming
Fundamentals of Software Engineering Economics (III)
Performance Optimization
What are optimization methods?
Solution methods for NP-hard Discrete Optimization Problems
Presentation transcript:

Numerical optimization methods Gintarė Viščiūtė Department of Applied Mathematics

Classification Analytical methods classical methods mathematical programming liner programing nonliner programing game theory Heuristic methods

Optimization problem Generic minimization problem where X is the search space f(x) objective function the value f(x*) is the minimum

Local vs. global minimum , , Local minimum Global minimum Local minimum Global minimum

Optimality conditions Necessary conditions for optimality Sufficient conditions for optimality Gradient of the function is zero Hessian matrix - positive definite

Optimization methods without limitations Gradient method Newton method Reliable field methods Variable metric methods Conjugate direction methods

Nonlinear programming Fines and barrier methods Methods of allowable directions Gradient projection and reduction methods Lagrange function method

Linear programming Geometric interpretation Simplex method Ellipsoid method Interior-point methods

Mathematical programming applications Production Planning Agriculture Distribution of resources Transport Planning Schedules Economic, Finance Human behavior modeling Chemical Technology

Conclusion There is no universal optimization method for resolving any task effectively. Initial value selection has a significant influence for the minimum value of the found function. Optimization techniques and its software is being actively developed branch of science. Recently, the genetic algorithms are especially popular in optimization problems.

Thank you for your attention Define local and global minimum. Necessary and sufficient conditions for a minimum. Differences between linear and nonlinear programming. Formulate the optimization problem of your own practice. Philosophical task. Who is better for optimization: a computer or a human?