P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – 86331 Solving Inverse ODE using Bezier Functions 29.

Slides:



Advertisements
Similar presentations
M. Dumbser 1 / 23 Analisi Numerica Università degli Studi di Trento Dipartimento dIngegneria Civile ed Ambientale Dr.-Ing. Michael Dumbser Lecture on Numerical.
Advertisements

Chapter 0 Review of Algebra.
Chapter 11 Differentiation.
Chapter 6 Matrix Algebra.
Chapter 17 Multivariable Calculus.
3.6 Support Vector Machines
The Maximum Likelihood Method
Yi Heng Second Order Differentiation Bommerholz – Summer School 2006.
Mathematics for Economics Beatrice Venturi 1 Economics Faculty CONTINUOUS TIME: LINEAR DIFFERENTIAL EQUATIONS Economic Applications LESSON 2 prof. Beatrice.
Mathematics for Economics Beatrice Venturi 1 Economics Faculty CONTINUOUS TIME: LINEAR DIFFERENTIAL EQUATIONS Economic Applications LESSON 2 prof. Beatrice.
Copyright © Cengage Learning. All rights reserved.
3/2003 Rev 1 I – slide 1 of 33 Session I Part I Review of Fundamentals Module 2Basic Physics and Mathematics Used in Radiation Protection.
P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2012 – 70343: A Robust Technique for Lumped Parameter Inverse.
1 Challenge the future Subtitless On Lightweight Design of Submarine Pressure Hulls.
Discrete Controller Design
Lecture 32 APPLICATIONS OF BIVARIATE OPTIMIZATION.
1 Analysis of Random Mobility Models with PDE's Michele Garetto Emilio Leonardi Politecnico di Torino Italy MobiHoc Firenze.
N.E. Leonard – U. Pisa – April 2007 Slide 1 Cooperative Control and Mobile Sensor Networks Application to Mobile Sensor Networks, Part II Naomi Ehrich.
Splines I – Curves and Properties
P. Venkataraman Mechanical Engineering Rochester Institute of TechnologyCEIS University Technology Showcase, February 12, 2009 Reduce and Super Smooth.
Chemical Reaction Engineering (CRE) is the field that studies the rates and mechanisms of chemical reactions and the design of the reactors in which they.
Lecture 20 Continuous Problems Linear Operators and Their Adjoints.
DETC ASME Computers and Information in Engineering Conference ONE AND TWO DIMENSIONAL DATA ANALYSIS USING BEZIER FUNCTIONS P.Venkataraman Rochester.
Sampling plans for linear regression
State Variables.
Chapter 5 The Mathematics of Diversification
A Discrete Adjoint-Based Approach for Optimization Problems on 3D Unstructured Meshes Dimitri J. Mavriplis Department of Mechanical Engineering University.
P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2013 – 12269: Continuous Solution for Boundary Value Problems.
P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2014 – 35148: Continuous Solution for Boundary Value Problems.
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
Data Modeling and Parameter Estimation Nov 9, 2005 PSCI 702.
P. Venkataraman Rochester Institute of TechnologyGraduate Seminar, January, 7, 2010 Bezier Functions : From Airfoils to the Inverse Problem Mechanical.
Chapter 10 Curve Fitting and Regression Analysis
P M V Subbarao Professor Mechanical Engineering Department
P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2011 –47658 Determining ODE from Noisy Data 31 th CIE, Washington.
Data mining and statistical learning - lecture 6
On Constrained Optimization Approach To Object Segmentation Chia Han, Xun Wang, Feng Gao, Zhigang Peng, Xiaokun Li, Lei He, William Wee Artificial Intelligence.
By Hrishikesh Gadre Session II Department of Mechanical Engineering Louisiana State University Engineering Equation Solver Tutorials.
Curve-Fitting Regression
ECIV 301 Programming & Graphics Numerical Methods for Engineers Lecture 26 Regression Analysis-Chapter 17.
General Linear Least-Squares and Nonlinear Regression
Development of Empirical Models From Process Data
Approximation on Finite Elements Bruce A. Finlayson Rehnberg Professor of Chemical Engineering.
Ch 2.1: Linear Equations; Method of Integrating Factors
Ordinary Differential Equations Final Review Shurong Sun University of Jinan Semester 1,
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
Interval-based Inverse Problems with Uncertainties Francesco Fedele 1,2 and Rafi L. Muhanna 1 1 School of Civil and Environmental Engineering 2 School.
Basic Mechanical Engineering Courses
1 Chapter 2 Matrices Matrices provide an orderly way of arranging values or functions to enhance the analysis of systems in a systematic manner. Their.
Least-Squares Regression
Today’s class Boundary Value Problems Eigenvalue Problems
Machine Learning CUNY Graduate Center Lecture 3: Linear Regression.
Analytical vs. Numerical Minimization Each experimental data point, l, has an error, ε l, associated with it ‣ Difference between the experimentally measured.
V. Space Curves Types of curves Explicit Implicit Parametric.
Extrapolation Models for Convergence Acceleration and Function ’ s Extension David Levin Tel-Aviv University MAIA Erice 2013.
MECN 3500 Inter - Bayamon Lecture 9 Numerical Methods for Engineering MECN 3500 Professor: Dr. Omar E. Meza Castillo
Curve-Fitting Regression
Bashkir State Univerity The Chair of Mathematical Modeling , Ufa, Zaki Validi str. 32 Phone: ,
Introduction 1. Similarity 1.1. Mechanism and mathematical description 1.2. Generalized variables 1.3. Qualitative analysis 1.4. Generalized individual.
THE LAPLACE TRANSFORM LEARNING GOALS Definition
MECN 3500 Inter - Bayamon Lecture 9 Numerical Methods for Engineering MECN 3500 Professor: Dr. Omar E. Meza Castillo
Lecture 16 - Approximation Methods CVEN 302 July 15, 2002.
MODEL FITTING jiangyushan. Introduction The goal of model fitting is to choose values for the parameters in a function to best describe a set of data.
Ch 2.1: Linear Equations; Method of Integrating Factors A linear first order ODE has the general form where f is linear in y. Examples include equations.
Differential Equations
Chapter 7. Classification and Prediction
CHAPTER 3 NUMERICAL METHODS.
Collaborative Filtering Matrix Factorization Approach
Discrete Least Squares Approximation
Presentation transcript:

P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – Solving Inverse ODE using Bezier Functions 29 th CIE, San Diego, California

P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – Solving Inverse ODE using Bezier Functions 29 th CIE, San Diego, California 2 The Inverse ODE Problem The inverse problem in this paper is very primitive: find the differential equation and the boundary conditions if the discrete solution is known everywhere If [ x i, y i ], i = 1,2,.. p is known as the solution to Then find f(D) and y 0 OR f(D) may be a linear or a nonlinear operator The ODE is homogenous the forward or the direct boundary value problem is the determination of the solution everywhere if the differential equation is known and the boundary conditions are given after all

P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – Solving Inverse ODE using Bezier Functions 29 th CIE, San Diego, California 3 Current Types of Inverse Problems Inverse problems investigated today belong to one of three types (i) Identifying parameters in a known form of the differential equation based on the particular knowledge domain (ii) Identifying boundary conditions at points that are not easily accessible using excess data at other points (iii) establishing some functions on the domain that are tied to the known form of the differential equations Most of the investigations today use some form of element discretization in two dimensional domain

P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – Solving Inverse ODE using Bezier Functions 29 th CIE, San Diego, California 4 The Solution Process The procedure involves two steps: 1.A “best” Bezier function is fitted to the data This function, which is also the solution to the ODE, will satisfy the differential equation and identify the boundary condition 2.The specific form of the differential equation is determined This form is established from a generic representation of the ODE using a set of exponent and coefficient values

P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – Solving Inverse ODE using Bezier Functions 29 th CIE, San Diego, California 5 Why a Bezier Function? Bezier functions can provide explicit solutions to the forward boundary value problem very effectively The author’s papers in previous CIE conferences have shown Bezier functions can solve linear or nonlinear, single or multi variable, ordinary or partial differential equations, with initial and/or boundary values Bezier functions are parametric curves based on Bernstein polynomial basis functions “the Bernstein polynomial approximation to a continuous function mimics the gross features of the function remarkably well” - Gordon and Riesenfeld As the order of the polynomial is increased, this approximation converges uniformly to the function and its derivatives where they exist The Bezier curve delivers, at the minimum, the same smoothness as the primitive function it is trying to emulate

P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – Solving Inverse ODE using Bezier Functions 29 th CIE, San Diego, California 6 What is a Bezier Function ? p : parameter Bernstein basis Number of vertices: 5 Order of the function : 4 A Bezier function is a Bezier curve that behaves like a function The Bezier curve is defined using a parameter Instead of y=f(x); both x and y depend on the same parameter value; x = x(p) and y = y(p)

P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – Solving Inverse ODE using Bezier Functions 29 th CIE, San Diego, California 7 Matrix Description of Bezier Function (2D) This allows the use of Array Processing for shorter computer time

P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – Solving Inverse ODE using Bezier Functions 29 th CIE, San Diego, California 8 For a selected order of the Bezier function (n) Given a set of (m) vector data y a,i, or [Y], find the coefficient matrix, [B] so that the corresponding data set y b,i, [Y B ] produces the least sum of the squared error Minimize FOC: Step 1:The Best Bezier Function to fit the Data Once the coefficient matrix is known, all other information, including the derivatives can be generated using array processing This is Step 1 of the solution process The best m is determined by the lowest value of E

P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – Solving Inverse ODE using Bezier Functions 29 th CIE, San Diego, California 9 Step 2:The Generic Form of ODE Many 3 rd order ODE generic forms are used in the paper. For example There are two types of unknowns: the exponents of the derivatives the coefficients multiplying the terms The exponents are expected to be integers The coefficients are unrestricted The function and its derivatives are known quantities after Step 1 Linear Generic Form Nonlinear Generic Form

P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – Solving Inverse ODE using Bezier Functions 29 th CIE, San Diego, California 10 Establishing the Unknowns A Least Squared Error Technique is used to determine the unknowns N: the number of data points This is the objective for linear constant coefficient form A similar one can be used for the generic nonlinear form A continuous application of standard optimization technique was unsuccessful because the exponents were not integers A mixed integer (exponents) – continuous (coefficients) approach was also unsuccessful because the solution will determine trivial values Solution was only possible through discrete programming

P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – Solving Inverse ODE using Bezier Functions 29 th CIE, San Diego, California 11 Discrete Programming Used in The Paper Two procedures are considered in this paper 1. Exhaustive Enumeration all of the values for the unknowns are considered in combination before the optimum is determined 2.Simple Heuristic Programming simple heuristic exhaustive enumeration over predetermined number of cycles (1 billion) Discrete Programming is incredibly time extensive For the linear constant coefficient form, allowing 3 values for each unknown required 1.0*10 5 cpu seconds on a Linux Opteron running MATLAB 2007a

P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – Solving Inverse ODE using Bezier Functions 29 th CIE, San Diego, California 12 Example 1 (Step 1) Best order of Fit (based on y-data) : 14 Number of data points: 200 Sum of Absolute Error (y): e-005 Sum of Squared Error (y): e-011 Average Error (y): e-007 Sum of Absolute Error (x): e-007 Sum of Squared Error (x): e-015 Average Error (x): e-009 Typeoriginal dataBezier data x (initial)11 x (final)55 y (initial)11 y (final)22 dy/dx (initial)not given dy/dx (final)not given d 2 y/dx 2 (initial) not given The original data is discrete x-y data The derivatives are those predicted for the data

P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – Solving Inverse ODE using Bezier Functions 29 th CIE, San Diego, California 13 Example 1 (Step 2) The exponents and coefficients are drawn from the set of three except for h 1 that will belong to a set of 9 values Solution : Exhaustive Enumeration a 1 = 0, a 2 = 1, a 3 = 1, a 4 = 1, b 1 = 1, b 2 = 0, b 3 = 0, c 1 = 1, c 2 = 0, d 1 = 1. The solution for the exponents: The solution for the coefficients: e 1 = 1, e 2 = 1, e 3 = 1, f 1 = 0, f 2 = 0, f 3 = 1, g 1 = 0, g 2 = 1, g 3 = 0, h 1 = h 2 = 0, h 3 = 1. The differential equation This was the same differential equation used to generate the discrete data

P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – Solving Inverse ODE using Bezier Functions 29 th CIE, San Diego, California 14 Example 2 (Step 1) Best order of Fit (based on y-data): 12 No. of data points: 101 Sum of Absolute Error (y): e-005 Sum of Squared Error (y): e-010 Average Error (y): e-007 Sum of Absolute Error (x): e-008 Sum of Squared Error (x): e-018 Average Error (x): e-010 Typeoriginal dataBezier data x (initial) e-013 x (final) y (initial) e-007 dy/dx (initial) e-005 dy/dx (final) d 2 y/dx 2 (initial) The discrete data is created by numerical integration using derivative information The Bezier data approximates the derivative nicely

P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – Solving Inverse ODE using Bezier Functions 29 th CIE, San Diego, California 15 Example 2 (Step 2) Solution : Exhaustive Enumeration The solution for the exponents: The solution for the coefficients: The differential equation A constant nonlinear generic form is used (to reduce time of computation) a 1 = 1, a 2 = 1, a 3 = 2, a 4 = 0, b 1 = 2, b 2 = 2, b 3 = 1, c 1 = 0, c 2 = 0, d 1 = 0 e 1 = 1, e 2 = 0.5, e 3 = 0.5, e 4 = 0.5 This is the Blasius equation used to generate data

P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – Solving Inverse ODE using Bezier Functions 29 th CIE, San Diego, California 16 Conclusions and Future Work A two-phased approach is used to identify the ODE from discrete solution data through discrete programming using LSQ criterion 1. Identify the best Bezier function that fits the data This will provide information on the boundary conditions 2. Find the exponents and coefficients of appropriate generic ODE This will identify the particular ODE The computation time is a serious issue for a broader range of values. Global optimization techniques may provide a relief Extension to coupled ODE single and coupled PDE non smooth data are planned for the future

P. Venkataraman Mechanical Engineering P. Venkataraman Rochester Institute of Technology DETC2009 – Solving Inverse ODE using Bezier Functions 29 th CIE, San Diego, California 17 Questions ?