Numerical Methods Newton’s Method for One - Dimensional Optimization - Theory

Slides:



Advertisements
Similar presentations
Numerical Methods Fourier Transform Pair Part: Frequency and Time Domain
Advertisements

Line Search.
CSE 330: Numerical Methods
Optimization Introduction & 1-D Unconstrained Optimization
5/20/ Multidimensional Gradient Methods in Optimization Major: All Engineering Majors Authors: Autar Kaw, Ali.
A second order ordinary differential equation has the general form
ESE Einführung in Software Engineering N. XXX Prof. O. Nierstrasz Fall Semester 2009.
ESE Einführung in Software Engineering X. CHAPTER Prof. O. Nierstrasz Wintersemester 2005 / 2006.
Metamodeling Seminar X. CHAPTER Prof. O. Nierstrasz Spring Semester 2008.
ESE Einführung in Software Engineering X. CHAPTER Prof. O. Nierstrasz Wintersemester 2005 / 2006.
N. XXX Prof. O. Nierstrasz Thanks to Jens Palsberg and Tony Hosking for their kind permission to reuse and adapt the CS132 and CS502 lecture notes.
OORPT Object-Oriented Reengineering Patterns and Techniques X. CHAPTER Prof. O. Nierstrasz.
CP — Concurrent Programming X. CHAPTER Prof. O. Nierstrasz Wintersemester 2005 / 2006.
12. eToys. © O. Nierstrasz PS — eToys 12.2 Denotational Semantics Overview:  … References:  …
SWOT Analysis Strengths Weaknesses SWOT Opportunities Threats.
Numerical Methods Golden Section Search Method - Theory
Unit 11 – Derivative Graphs Section 11.1 – First Derivative Graphs First Derivative Slope of the Tangent Line.
Numerical Methods Discrete Fourier Transform Part: Discrete Fourier Transform
8/30/ Secant Method Major: All Engineering Majors Authors: Autar Kaw, Jai Paul
Newton-Raphson Method Electrical Engineering Majors Authors: Autar Kaw, Jai Paul Transforming Numerical Methods Education.
Elliptic Partial Differential Equations - Introduction
Newton-Raphson Method
9/20/ Secant Method Civil Engineering Majors Authors: Autar Kaw, Jai Paul
Introduction This chapter gives you several methods which can be used to solve complicated equations to given levels of accuracy These are similar to.
Numerical Methods Part: Cholesky and Decomposition
Numerical Methods Part: Simpson Rule For Integration.
Numerical Methods Fast Fourier Transform Part: Informal Development of Fast Fourier Transform
Newton-Raphson Method Chemical Engineering Majors Authors: Autar Kaw, Jai Paul Transforming Numerical Methods Education.
5/31/ Multi Dimensional Direct Search Methods Major: All Engineering Majors Authors: Autar Kaw, Ali Yalcin
Numerical Methods Multi Dimensional Direct Search Methods - Theory
© 2015 Core Knowledge Foundation. This work is licensed under a Creative Commons Attribution- NonCommercial-ShareAlike 3.0 Unported License.
Numerical Methods Fast Fourier Transform Part: Theoretical Development of Fast Fourier Transform
Numerical Methods Continuous Fourier Series Part: Continuous Fourier Series
11/17/ Introduction to Partial Differential Equations Transforming Numerical.
Numerical Methods Part: False-Position Method of Solving a Nonlinear Equation
11/30/ Secant Method Industrial Engineering Majors Authors: Autar Kaw, Jai Paul
Numerical Methods Newton’s Method for One - Dimensional Optimization - Theory
Newton-Raphson Method. Figure 1 Geometrical illustration of the Newton-Raphson method. 2.
Design of Everyday Things Part 2: Useful Designs? Lecture /slide deck produced by Saul Greenberg, University of Calgary, Canada Images from:
Numerical Methods Multidimensional Gradient Methods in Optimization- Theory
1/30/ Elliptic Partial Differential Equations – Lieberman Method – Part 1 of 2 Elliptic Partial Differential.
Newton-Raphson Method Computer Engineering Majors Authors: Autar Kaw, Jai Paul Transforming Numerical Methods Education.
2/13/ Elliptic Partial Differential Equations - Introduction Transforming.
Images of pesticides By: Leslie London, University of Cape Town This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 2.5.
2/24/ Golden Section Search Method Major: All Engineering Majors Authors: Autar Kaw, Ali Yalcin
Exam 1 Oct 3, closed book Place ITE 119, Time:12:30-1:45pm One double-sided cheat sheet (8.5in x 11in) allowed Bring your calculator to the exam Chapters.
Numerical Methods Part: False-Position Method of Solving a Nonlinear Equation
Insert the title of your presentation here Insert the subtitle of your presentation here.
Numerical Methods Multidimensional Gradient Methods in Optimization- Example
EngageNY.org ©2012 Core Knowledge Foundation. This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License.
6/13/ Secant Method Computer Engineering Majors Authors: Autar Kaw, Jai Paul
© 2015 Core Knowledge Foundation. This work is licensed under a Creative Commons Attribution- NonCommercial-ShareAlike 3.0 Unported License.
CSE 330: Numerical Methods. Introduction The bisection and false position method require bracketing of the root by two guesses Such methods are called.
Newton-Raphson Method
Newton-Raphson Method
Morning Reflections / Today’s objectives
Numerical Methods Multi Dimensional Direct Search Methods - Example
Numerical Methods Part: Cholesky and Decomposition
Pre and post workshop assessments
FOTW Worksheet Slides Christopher Penn, Financial Aid Podcast Student Loan Network.
Elliptic Partial Differential Equations – Direct Method
Chapter 1: False-Position Method of Solving a Nonlinear Equation
Newton-Raphson Method
Newton-Raphson Method
Elliptic Partial Differential Equations – Gauss-Seidel Method
Numerical Methods Golden Section Search Method - Example
Numerical Methods Newton’s Method for One -Dimensional Optimization - Example
Part 4 - Chapter 13.
This material is based upon work supported by the National Science Foundation under Grant #XXXXXX. Any opinions, findings, and conclusions or recommendations.
Electronic resources in Rongo University college
Presentation transcript:

Numerical Methods Newton’s Method for One - Dimensional Optimization - Theory

For more details on this topic  Go to  Click on Keyword  Click on Newton’s Method for One- Dimensional Optimization

You are free to Share – to copy, distribute, display and perform the work to Remix – to make derivative works

Under the following conditions Attribution — You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work). Noncommercial — You may not use this work for commercial purposes. Share Alike — If you alter, transform, or build upon this work, you may distribute the resulting work only under the same or similar license to this one.

Newton’s Method-Overview Open search method A good initial estimate of the solution is required The objective function must be twice differentiable Unlike Golden Section Search method Lower and upper search boundaries are not required (open vs. bracketing) May not converge to the optimal solution 5

6 Newton’s Method-How it works The derivative of the function,Nonlinear root finding equation, at the function’s maximum and minimum. The minima and the maxima can be found by applying the Newton-Raphson method to the derivative, essentially obtaining Next slide will explain how to get/derive the above formula.

7 pt. C ≈ We “wish” that in the next iteration x i+1 will be the root, or. Thus: pt. C = F(x) xixi x i+1 x i – x i+1 A B E F C D F(x i ) - 0 F(x i+1 ) F(x i ) x Or Hence: N-R Equation Newton’s Method-To find root of a nonlinear equation

 If,then.  For Multi-variable case,then N-R method becomes 8 Newton’s Method-To find root of a nonlineat equation

Newton’s Method-Algorithm Initialization: Determine a reasonably good estimate for the maxima or the minima of the function. Step 1. Determine and. Step 2. Substitute (initial estimate for the first iteration) and into to determine and the function value in iteration i. Step 3.If the value of the first derivative of the function is zero then you have reached the optimum (maxima or minima). Otherwise, repeat Step 2 with the new value of 9

THE END

This instructional power point brought to you by Numerical Methods for STEM undergraduate Committed to bringing numerical methods to the undergraduate Acknowledgement

For instructional videos on other topics, go to This material is based upon work supported by the National Science Foundation under Grant # Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.

The End - Really

Numerical Methods Newton’s Method for One - Dimensional Optimization - Example

For more details on this topic  Go to  Click on Keyword  Click on Newton’s Method for One- Dimensional Optimization

You are free to Share – to copy, distribute, display and perform the work to Remix – to make derivative works

Under the following conditions Attribution — You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work). Noncommercial — You may not use this work for commercial purposes. Share Alike — If you alter, transform, or build upon this work, you may distribute the resulting work only under the same or similar license to this one.

18 Example The cross-sectional area A of a gutter with equal base and edge length of 2 is given by. Find the angle  which maximizes the cross-sectional area of the gutter  

19 Solution The function to be maximized is Iteration 1: Use as the initial estimate of the solution

20 Solution Cont. Iteration 2: Iteration  E E E Summary of iterations Remember that the actual solution to the problem is at 60 degrees or radians.

THE END

This instructional power point brought to you by Numerical Methods for STEM undergraduate Committed to bringing numerical methods to the undergraduate Acknowledgement

For instructional videos on other topics, go to This material is based upon work supported by the National Science Foundation under Grant # Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.

The End - Really