Linear dynamic systems

Slides:



Advertisements
Similar presentations
Ch 7.6: Complex Eigenvalues
Advertisements

Differential Equations
Section 2.1 MODELING VIA SYSTEMS. A tale of rabbits and foxes Suppose you have two populations: rabbits and foxes. R(t) represents the population of rabbits.
Ch 9.4: Competing Species In this section we explore the application of phase plane analysis to some problems in population dynamics. These problems involve.
Ch 9.1: The Phase Plane: Linear Systems
ENGG2013 Unit 25 Second-order Linear DE
Visual Recognition Tutorial
Kalman’s Beautiful Filter (an introduction) George Kantor presented to Sensor Based Planning Lab Carnegie Mellon University December 8, 2000.
Course Outline 1.MATLAB tutorial 2.Motion of systems that can be idealized as particles Description of motion; Newton’s laws; Calculating forces required.
A second order ordinary differential equation has the general form
Maximum likelihood (ML) and likelihood ratio (LR) test
Maximum likelihood Conditional distribution and likelihood Maximum likelihood estimations Information in the data and likelihood Observed and Fisher’s.
Ch 7.9: Nonhomogeneous Linear Systems
Maximum likelihood (ML) and likelihood ratio (LR) test
Dynamical Systems Analysis II: Evaluating Stability, Eigenvalues By Peter Woolf University of Michigan Michigan Chemical Process Dynamics.
Ch 7.5: Homogeneous Linear Systems with Constant Coefficients
Copyright © Cengage Learning. All rights reserved. 17 Second-Order Differential Equations.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 7: Linearization and the State.
Tracking with Linear Dynamic Models. Introduction Tracking is the problem of generating an inference about the motion of an object given a sequence of.
Ordinary Differential Equations Final Review Shurong Sun University of Jinan Semester 1,
1 Lavi Shpigelman, Dynamic Systems and control – – Linear Time Invariant systems  definitions,  Laplace transform,  solutions,  stability.
Maximum likelihood (ML)
1 Chapter 9 Differential Equations: Classical Methods A differential equation (DE) may be defined as an equation involving one or more derivatives of an.
Lecture 2 Differential equations
Overview and Mathematics Bjoern Griesbach
Boyce/DiPrima 9 th ed, Ch 3.1: 2 nd Order Linear Homogeneous Equations-Constant Coefficients Elementary Differential Equations and Boundary Value Problems,
MA/CS 375 Fall MA/CS 375 Fall 2002 Lecture 13.
Complex eigenvalues SECTION 3.4
Autumn 2008 EEE8013 Revision lecture 1 Ordinary Differential Equations.
Ch. 6 Single Variable Control
1 Chapter 8 Ordinary differential equation Mathematical methods in the physical sciences 3rd edition Mary L. Boas Lecture 5 Introduction of ODE.
1 On Free Mechanical Vibrations As derived in section 4.1( following Newton’s 2nd law of motion and the Hooke’s law), the D.E. for the mass-spring oscillator.
CS559: Computer Graphics Lecture 38: Animation Li Zhang Spring 2008 Slides from Brian Curless at U of Washington.
Lecture 14: Stability and Control II Reprise of stability from last time The idea of feedback control Remember that our analysis is limited to linear systems.
Math 3120 Differential Equations with Boundary Value Problems
Sheng-Fang Huang. 4.0 Basics of Matrices and Vectors Most of our linear systems will consist of two ODEs in two unknown functions y 1 (t), y 2 (t),
Math 3120 Differential Equations with Boundary Value Problems
LURE 2009 SUMMER PROGRAM John Alford Sam Houston State University.
Lecture Fall 2001 Physically Based Animation Ordinary Differential Equations Particle Dynamics Rigid-Body Dynamics Collisions.
Progress in identification of damping: Energy-based method with incomplete and noisy data Marco Prandina University of Liverpool.
Population Dynamics Application of Eigenvalues & Eigenvectors.
CEE162/262c Lecture 2: Nonlinear ODEs and phase diagrams1 CEE162 Lecture 2: Nonlinear ODEs and phase diagrams; predator-prey Overview Nonlinear chaotic.
Physics 430: Lecture 25 Coupled Oscillations
Advanced Computer Graphics Rigid Body Simulation Spring 2002 Professor Brogan.
Advanced EM - Master in Physics We have now calculated all the intermediate derivatives which we need for calculating the fields E and B. We.
SECOND-ORDER DIFFERENTIAL EQUATIONS
Section 5.1 First-Order Systems & Applications
University of Texas at Austin CS 378 – Game Technology Don Fussell CS 378: Computer Game Technology Physics for Games Spring 2012.
Feedback Control Systems (FCS) Dr. Imtiaz Hussain URL :
Lecture 5: Basic Dynamical Systems CS 344R: Robotics Benjamin Kuipers.
An Introduction to Kalman Filtering by Arthur Pece
ECE 576 – Power System Dynamics and Stability Prof. Tom Overbye Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
Ch11: Normal Modes 1. Review diagonalization and eigenvalue problem 2. Normal modes of Coupled oscillators (3 springs, 2 masses) 3. Case of Weakly coupled.
Boyce/DiPrima 9 th ed, Ch 7.6: Complex Eigenvalues Elementary Differential Equations and Boundary Value Problems, 9 th edition, by William E. Boyce and.
Cameron Rowe.  Introduction  Purpose  Implementation  Simple Example Problem  Extended Kalman Filters  Conclusion  Real World Examples.
Boyce/DiPrima 9 th ed, Ch 11.3: Non- Homogeneous Boundary Value Problems Elementary Differential Equations and Boundary Value Problems, 9 th edition, by.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Kalman Filter with Process Noise Gauss- Markov.
Differential Equations MTH 242 Lecture # 16 Dr. Manshoor Ahmed.
Differential Equations Second-Order Linear DEs Variation of Parameters Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB.
Boyce/DiPrima 9th ed, Ch 9.4: Competing Species Elementary Differential Equations and Boundary Value Problems, 9th edition, by William E. Boyce and.
Systems of Ordinary Differential Equations Case I: real eigenvalues of multiplicity 1 MAT 275.
A second order ordinary differential equation has the general form
Kalman’s Beautiful Filter (an introduction)
One- and Two-Dimensional Flows
Autonomous Cyber-Physical Systems: Dynamical Systems
Digital Control Systems (DCS)
Filtering and State Estimation: Basic Concepts
Boyce/DiPrima 10th ed, Ch 7.6: Complex Eigenvalues Elementary Differential Equations and Boundary Value Problems, 10th edition, by William E. Boyce and.
Kalman Filter: Bayes Interpretation
Ch 7.5: Homogeneous Linear Systems with Constant Coefficients
Presentation transcript:

Linear dynamic systems

Introduction Example of a complex dynamic system

Example of a complex dynamical system

Example of a complex dynamical system (cnt’d)

Example of a complex dynamical system (cnt’d) ? ?

Oregon interaction data 69 normal and 72 depressed adolescents in laboratory Several 9 minute interaction tasks: two positive tasks (e.g., discuss nice time together), two reminiscence tasks (e.g., discuss salient aspects of adolescenthood and parenthood) and two conflict tasks (e.g., discuss familial conflicts)

Second-to-second physiological data collected (heart rate, blood pressure, skin conductance, etc.) and observational data (i.e., behavior coding: neutral, happy, angry, dysphoric)

Oregon interaction data set

Problem: cardiovascular system is nonlinear  If we look at heart rate, it contains 1/f noise and is self-similar (--> fractals)

Question: Why study a linear dynamical system if the world is nonlinear?

Question: Why study a linear dynamical system if the world is nonlinear? you need to understand a linear system first linear methods are often basis of nonlinear ones they often work well as approximations often easier to apply in a noisy context measurement error unidentified influences computational efficient methods are developed  Feynman: linear systems are important because we can solve them! (Lect on Physics)

Other examples

Overview of dynamical systems

What will we study today?

Simple dynamic system Falling ball: distance  time2 t = time x(t) = position at time t = velocity at time t = acceleration at time t

x=0 x(t)

using Newton’s second law (no friction, small heigths)

thus, it follows that  this is a linear second-order ordinary differential equation (ODE)

solution can be found analytically by integration first, consider it to be a first-order ODE in v(t) : if we know v(0), then C = v(0)

solution now, we have a first-order ODE in x(t) if we know x(0), then K = x(0) solution

this system is very simple analytically, but somewhat more complex to study in general because it is non-homogeneous Again, we can go from a second-order ODE to a system of first-order ODEs How? By defining the state variables x(t) = position v(t) = x’(t) = velocity

if we know the state variables, then we know the system in general, we can write this is a system of first order ODEs (replacing the single second-order ODE)

or also (using vector notation)

Another (more interesting) dynamic system mass-spring system x=0 x(t)

Newton’s second law combine this with Hooke’s law where k is the spring constant (large for stiff springs)

the ODE becomes or again a second-order ODE assume

How to study this dynamic system? Again, we can go from a second-order ODE to a system of first-order ODEs How? By defining the state variables x(t) = position v(t) = x’(t) = velocity if we know the state variables, then we know the system

dynamic system now becomes we can plot again a vector field in the state space or phase plane (i.e., the plane with x and v as coordinate axes) each point (x,v) is associated with (x’,v’) = (v, -2 x)

Exercise Plot the vector field.

imagine a flow of an imaginary fluid and place an imaginary particle in it watch how it is carried away if (x’(t),v’(t)) = (0,0), then this is the fixed point (for the mass-spring system this happens at (x,v)=(0,0) starting anywhere else leads to circulation in a closed orbit  phase portrait of this system

Questions Based on this information, graph schematically the solution of the second-order ODE for x(t). How does the solution for v(t) look like? (also schematically)

for the general homogeneous system or several different kinds of phase portraits

to show that our the mass-spring system is an example hence

center star (unstable) saddle point stable spiral stable node degenerate node

we need to check the eigenvalues of A solve the characteristic equation: det(A-I)=0

p =(1-2)2 q

for 2 = 1 eigenvalues are pure imaginary complex numbers: 1=+i and 2=-i

Another more interesting dynamic system mass-spring system with damping

Now the dynamics are a little bit more complex where ODE:

Exercise Rewrite the ODE as a two-dimensional linear system What is the fixed point? Explore the possible phase portraits? Take in all cases m=1 and let c and k vary such that c2 > 4k c2 < 4k optional: c2 = 4k Relate this to “overdamped”, “critically damped”, and “underdamped”

Discrete time Almost all our measurements are in discrete time t0 < t1 < t2 < … < tk-1 < tk < tk+1 < … Possibly equally spaced t = tk – tk-1, for all k In such a case, the differential equation becomes a difference equation

As said earlier, this transition is not trivial instead of we (hope to) get

t t +t Let us do the exercise for the falling ball What happens when going from t to t+t ? initial position = x(t) initial velocity = v(t) t t +t new position = x(t+t) new velocity = v(t+t)

the transition equations for the state variables become: or in matrix notation

So in general

For the mass-spring system, the calculations are a little bit more complex, but not impossible In that case with where v1 and v2 are the eigenvectors of A and 1 and 2 are the corresponding eigenvalues

to conclude: we may use a discrete dynamical model for the linear system if we observe it at discrete times the systems we have talked about now can be represented schematically as follows u1(t) x1(t) xi(t) uj(t) xI(t) uJ(t)

the systems we have talked about now can be represented schematically as follows x1(t+t) xi(t +t) uj(t) xI(t +t) uJ(t)

Tom will make it a little bit more complicated: adding an observation equation adding error to both equations

Kalman filter for the local level model

Remember the local level model with

define Can we find (recursive) expressions for t and Vt? The solution will be the celebrated Kalman filter

The problem is we have observations and a current estimate of t-1, now yt becomes available how should we update our estimate of t

Let us first remark that since all distributions we start from are normal, all derived distributions will be normal as well Then using Bayes’ theorem

Let us focus on (*)

Inserting this result then gives You may recognize the traditional Bayesian structure here: a normal observation yt with mean t and a normal prior on t

This gives for the posterior

Using some elementary algebra, this can be formulated as follows: these are the Kalman recursive formulas with Kt being called the Kalman gain

Exercise: Simulate data from the local level model and try to apply the Kalman filter. Plot the data and draw the filtered states through it. Plot the filtered state variance Pt. Plot the errors.