Polynomial Chaos For Dynamical Systems Anatoly Zlotnik, Case Western Reserve University Mohamed Jardak, Florida State University.

Slides:



Advertisements
Similar presentations
Chapter 6 Differential Equations
Advertisements

Differential Equations
Numerical Methods for Partial Differential Equations CAAM 452 Spring 2005 Lecture 9 Instructor: Tim Warburton.
PLOTTING PHASE PORTRAITS WITH MATLAB:
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 ~ Curve Fitting ~ Least Squares Regression Chapter.
Probabilistic Modeling, Multiscale and Validation Roger Ghanem University of Southern California Los Angeles, California.
Point-wise Discretization Errors in Boundary Element Method for Elasticity Problem Bart F. Zalewski Case Western Reserve University Robert L. Mullen Case.
Sensitivity Analysis In deterministic analysis, single fixed values (typically, mean values) of representative samples or strength parameters or slope.
TNO orbit computation: analysing the observed population Jenni Virtanen Observatory, University of Helsinki Workshop on Transneptunian objects - Dynamical.
Dynamics of Learning VQ and Neural Gas Aree Witoelar, Michael Biehl Mathematics and Computing Science University of Groningen, Netherlands in collaboration.
SES 2007 A Multiresolution Approach for Statistical Mobility Prediction of Unmanned Ground Vehicles 44 th Annual Technical Meeting of the Society of Engineering.
Approximations and Errors
Radiative Transfer with Predictor-Corrector Methods ABSTRACT TITLE : Radiative Transfer with Predictor-Corrector Methods OBJECTIVE: To increase efficiency,
Chapter 1 Introduction The solutions of engineering problems can be obtained using analytical methods or numerical methods. Analytical differentiation.
Dr. Jie Zou PHY Chapter 9 Ordinary Differential Equations: Initial-Value Problems Lecture (II) 1 1 Besides the main textbook, also see Ref.: “Applied.
Efficient Simulation of Physical System Models Using Inlined Implicit Runge-Kutta Algorithms Vicha Treeaporn Department of Electrical & Computer Engineering.
Ordinary Differential Equations (ODEs) 1Daniel Baur / Numerical Methods for Chemical Engineers / Implicit ODE Solvers Daniel Baur ETH Zurich, Institut.
CISE-301: Numerical Methods Topic 1: Introduction to Numerical Methods and Taylor Series Lectures 1-4: KFUPM.
Statistical Methods for long-range forecast By Syunji Takahashi Climate Prediction Division JMA.
Ordinary Differential Equations (ODEs) 1Daniel Baur / Numerical Methods for Chemical Engineers / Implicit ODE Solvers Daniel Baur ETH Zurich, Institut.
Ordinary Differential Equations (ODEs) 1Daniel Baur / Numerical Methods for Chemical Engineers / Explicit ODE Solvers Daniel Baur ETH Zurich, Institut.
Chapter 9 Numerical Integration Numerical Integration Application: Normal Distributions Copyright © The McGraw-Hill Companies, Inc. Permission required.
Lecture 11 Implementation Issues – Part 2. Monte Carlo Simulation An alternative approach to valuing embedded options is simulation Underlying model “simulates”
Ch 8.1 Numerical Methods: The Euler or Tangent Line Method
Chapter 17 Boundary Value Problems. Standard Form of Two-Point Boundary Value Problem In total, there are n 1 +n 2 =N boundary conditions.
EE3561_Unit 8Al-Dhaifallah14351 EE 3561 : Computational Methods Unit 8 Solution of Ordinary Differential Equations Lesson 3: Midpoint and Heun’s Predictor.
CISE-301: Numerical Methods Topic 1: Introduction to Numerical Methods and Taylor Series Lectures 1-4: KFUPM CISE301_Topic1.
CISE301_Topic11 CISE-301: Numerical Methods Topic 1: Introduction to Numerical Methods and Taylor Series Lectures 1-4:
Equation-Free (EF) Uncertainty Quantification (UQ): Techniques and Applications Ioannis Kevrekidis and Yu Zou Princeton University September 2005.
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 Part 4 Curve Fitting.
Computational Physics Introduction 3/30/11. Goals  Calculate solutions to physics problems  All physics problems can be formulated mathematically. 
Stochastic Linear Programming by Series of Monte-Carlo Estimators Leonidas SAKALAUSKAS Institute of Mathematics&Informatics Vilnius, Lithuania
Computational Method in Chemical Engineering (TKK-2109)
Workshop on Stochastic Differential Equations and Statistical Inference for Markov Processes Day 3: Numerical Methods for Stochastic Differential.
Tarek A. El-Moselhy and Luca Daniel
An Analysis of Phase Noise and Fokker-Planck Equations Hao-Min Zhou School of Mathematics Georgia Institute of Technology Partially Supported by NSF Joint.
6. Introduction to Spectral method. Finite difference method – approximate a function locally using lower order interpolating polynomials. Spectral method.
Uncertainty quantification in multiscale deformation processes Babak Kouchmeshky Nicholas Zabaras Materials Process Design and Control Laboratory Sibley.
S17: Introduction to Numerical Methods TT 2008 Lecture 1 Numerical aspects of computing.
Monté Carlo Simulation  Understand the concept of Monté Carlo Simulation  Learn how to use Monté Carlo Simulation to make good decisions  Learn how.
1 Complex Images k’k’ k”k” k0k0 -k0-k0 branch cut   k 0 pole C1C1 C0C0 from the Sommerfeld identity, the complex exponentials must be a function.
Accuracy of the Relativistic Distorted-Wave Approximation (RDW) A. D. Stauffer York University Toronto, Canada.
Sensitivity derivatives Can obtain sensitivity derivatives of structural response at several levels Finite difference sensitivity (section 7.1) Analytical.
Engineering Analysis – Computational Fluid Dynamics –
Analysis of Lagrangian Coherent Structures of the Chesapeake Bay Stephanie Young, Kayo Ide,
Content: 1) Dynamics of beta-cells. Polynomial model and gate noise. 2) The influence of noise. Phenomenological. 3) The Gaussian method. 4) Wave block.
Stephanie Young, Kayo Ide, Atmospheric and Oceanic Science Department
OPERATING SYSTEMS CS 3530 Summer 2014 Systems and Models Chapter 03.
Dr. Mujahed AlDhaifallah ( Term 342)
Chapter 20 Statistical Considerations Lecture Slides The McGraw-Hill Companies © 2012.
Materials Process Design and Control Laboratory Sibley School of Mechanical and Aerospace Engineering 169 Frank H. T. Rhodes Hall Cornell University Ithaca,
CHAPTER 2.3 PROBABILITY DISTRIBUTIONS. 2.3 GAUSSIAN OR NORMAL ERROR DISTRIBUTION  The Gaussian distribution is an approximation to the binomial distribution.
NUMERICAL DIFFERENTIATION or DIFFERENCE APPROXIMATION Used to evaluate derivatives of a function using the functional values at grid points. They are.
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 Part 6 - Chapters 22 and 23.
Sensitivity Analysis for the Purposes of Parameter Identification of a S. cerevisiae Fed-batch Cultivation Sensitivity Analysis for the Purposes of Parameter.
Ordinary Differential Equations (ODEs). Objectives of Topic  Solve Ordinary Differential Equations (ODEs).  Appreciate the importance of numerical methods.
DYNAMIC BEHAVIOR OF PROCESSES :
CALCULUS REVIEW BME 3510 C PO-WEI CHEN 8/19/2014.
Analyzing Stability in Dynamical Systems
Boundary Element Analysis of Systems Using Interval Methods
NUMERICAL INVESTIGATIONS OF FINITE DIFFERENCE SCHEMES
Mechanical Engineering at Virginia Tech
SE301: Numerical Methods Topic 8 Ordinary Differential Equations (ODEs) Lecture KFUPM (Term 101) Section 04 Read , 26-2, 27-1 CISE301_Topic8L4&5.
Filtering and State Estimation: Basic Concepts
Efficient Quantification of Uncertainties Associated with Reservoir Performance Simulations Dongxiao Zhang, The University of Oklahoma . The efficiency.
Lecture 4 - Monte Carlo improvements via variance reduction techniques: antithetic sampling Antithetic variates: for any one path obtained by a gaussian.
D. Kim, B.J. Debusschere, H.N. Najm  Biophysical Journal 
Introduction CSE 541.
CISE-301: Numerical Methods Topic 1: Introduction to Numerical Methods and Taylor Series Lectures 1-4: KFUPM CISE301_Topic1.
Uncertainty Propagation
Presentation transcript:

Polynomial Chaos For Dynamical Systems Anatoly Zlotnik, Case Western Reserve University Mohamed Jardak, Florida State University

The goal of this project is to implement a polynomial chaos representation to characterize the behavior of random dynamical systems. Polynomial chaos, or PC, can provide information about the probability density of the solution to a system of ordinary differential equations with random components as an alternative to costly Monte Carlo methods. The project includes examination of numerical aspects of PC implementation. A fast unified algorithm has been developed for calculating the necessary coefficients using an analytic technique. Rapid computation of the necessary data now allows for direct calculation for systems with higher order nonlinear terms, leading to a re-evaluation of accuracy in pseudo-spectral, or PS, approximations. This will also lead to higher numerical stability for applications to highly nonlinear systems. Abstract

Stochastic Differential Equations and Spectral Collocation Method

Stochastic Differential Equations and Spectral Collocation Method (cont.)

Solutions are obtained using an 8th degree PC expansion and the ode45 routine in MATLAB with relative integration tolerance at 1e-6. P+1 ODEs are solved, giving a stochastic series expansion at all grid points. The series is used at each point to simulate a data set by Monte Carlo, and to estimate a PDF. Color plots are used to illustrate the variation of the solution PDF with time. Blue and red indicate low and high probability density, respectively. Applications To Dynamical Systems

Applications To Dynamical Systems (cont.)

Lorenz System Initial conditions in x, y, and z are normal random with mean=0.01 and std= The coefficients sigma, rho, and beta are the standard 10, 28, and 8/3, respectively. The spatial variables are expanded in PC. As the system moves around the first attractor, the solution PDF has a small range and high probability density. At T=23, The position of the oscillator becomes highly uncertain. The PDF has a much broader range, and lower density. The profiles of the PDF at various times also display this behavior. The solution undergoes a sort of “bifurcation” at certain times, where it is likely to be near one attractor or the other, but less likely to be in the middle. In this situation, the PDF has two “peaks”, and the mean and variance alone mean little.

Applications To Dynamical Systems (cont.)

Calculation of Polynomial Chaos Coefficients by Fast Unified Algorithms

Tools For Analysis of Dynamical Systems: Bifurcation Map of 4th order Runge Kutta ODE solver and a Basin Attractor Map for the Damped Forced Pendulum ODE via Interpolated Cell Mapping

In the case of Van Der Pol’s equation, pseudo-spectral routines performed poorly in calculating the 3rd order nonlinear term compared to the full-spectrum method. 8th degree PC was used solve in both variations. The plot at left shows that there is significant error in pseudo-spectral calculation with error in the 0th, 3rd, and 8th solution given. The plot at right shows that pseudo-spectral methods work poorly when all chaos coefficients are of similar magnitude. Even if magnitude decreases exponentially with chaos order, errors still appear.

Conclusions Polynomial Chaos is a promising tool for analysis of stochastic processes. More research into the stability of the Stochastic Collocation Method and related numerical aspects is necessary. A number of numerical and analytical challenges remain to be overcome before reliable application to complex dynamical systems.

References Xiu, D and Karniadakis, G. The Wiener-Askey Polynomial Chaos for Stochastic Differential Equations, SIAM, 2002 Debusschere et. al, Numerical Challenges in the Use of Polynomial Chaos Representations for Stochastic Processes, AMS, 2001 Heath, M.T. Scientific Computing, McGraw Hill, New York 2002 Abramowitz, M. and Stegun, I. A. (Eds.). "Orthogonal Polynomials." Ch. 22, Handbook of Mathematical Functions. New York: Dover, pp , 1972.