CY3A2 System identification Modelling Elvis Impersonators Fresh evidence that pop stars are more popular dead than alive. The University of Missouri’s.

Slides:



Advertisements
Similar presentations
Dates for term tests Friday, February 07 Friday, March 07
Advertisements

ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: The Linear Prediction Model The Autocorrelation Method Levinson and Durbin.
Use of Kalman filters in time and frequency analysis John Davis 1st May 2011.
AGC DSP AGC DSP Professor A G Constantinides©1 Modern Spectral Estimation Modern Spectral Estimation is based on a priori assumptions on the manner, the.
OPTIMUM FILTERING.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: The FIR Adaptive Filter The LMS Adaptive Filter Stability and Convergence.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Newton’s Method Application to LMS Recursive Least Squares Exponentially-Weighted.
Lectures 5 & 6: Least Squares Parameter Estimation
Lecture 11: Recursive Parameter Estimation
Chapter 8: The Discrete Fourier Transform
280 SYSTEM IDENTIFICATION The System Identification Problem is to estimate a model of a system based on input-output data. Basic Configuration continuous.
Lecture Notes for CMPUT 466/551 Nilanjan Ray
Curve-Fitting Regression
Transfer Functions Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: The following terminology.
SYSTEMS Identification
SYSTEMS Identification
Development of Empirical Models From Process Data
Transfer Functions Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: The following terminology.
Estimation and the Kalman Filter David Johnson. The Mean of a Discrete Distribution “I have more legs than average”
Analysis of Individual Variables Descriptive – –Measures of Central Tendency Mean – Average score of distribution (1 st moment) Median – Middle score (50.
President UniversityErwin SitompulSMI 9/1 Dr.-Ing. Erwin Sitompul President University Lecture 9 System Modeling and Identification
CSCI 347 / CS 4206: Data Mining Module 04: Algorithms Topic 06: Regression.
Adaptive Signal Processing
Module 2: Representing Process and Disturbance Dynamics Using Discrete Time Transfer Functions.
Algorithm Taxonomy Thus far we have focused on:
SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory For The User” Lennart.
CJT 765: Structural Equation Modeling Class 7: fitting a model, fit indices, comparingmodels, statistical power.
1 Linear Prediction. 2 Linear Prediction (Introduction) : The object of linear prediction is to estimate the output sequence from a linear combination.
Various topics Petter Mostad Overview Epidemiology Study types / data types Econometrics Time series data More about sampling –Estimation.
1 Linear Prediction. Outline Windowing LPC Introduction to Vocoders Excitation modeling  Pitch Detection.
1 Chapter 2 1. Parametric Models. 2 Parametric Models The first step in the design of online parameter identification (PI) algorithms is to lump the unknown.
CHAPTER 4 Adaptive Tapped-delay-line Filters Using the Least Squares Adaptive Filtering.
CS 782 – Machine Learning Lecture 4 Linear Models for Classification  Probabilistic generative models  Probabilistic discriminative models.
CY3A2 System identification Assignment: The assignment has three parts, all relating.
Applications of Neural Networks in Time-Series Analysis Adam Maus Computer Science Department Mentor: Doctor Sprott Physics Department.
1 Lecture 1: February 20, 2007 Topic: 1. Discrete-Time Signals and Systems.
CY3A2 System identification
Robotics Research Laboratory 1 Chapter 7 Multivariable and Optimal Control.
ECE-7000: Nonlinear Dynamical Systems Overfitting and model costs Overfitting  The more free parameters a model has, the better it can be adapted.
Chapter 20 1 Overall Objectives of Model Predictive Control 1.Prevent violations of input and output constraints. 2.Drive some output variables to their.
Estimation Method of Moments (MM) Methods of Moment estimation is a general method where equations for estimating parameters are found by equating population.
Dept. E.E./ESAT-STADIUS, KU Leuven
An Introduction To The Kalman Filter By, Santhosh Kumar.
CHAPTER 10 Widrow-Hoff Learning Ming-Feng Yeh.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Normal Equations The Orthogonality Principle Solution of the Normal Equations.
CY3A2 System identification Input signals Signals need to be realisable, and excite the typical modes of the system. Ideally the signal should be persistent.
Professor A G Constantinides 1 Discrete Fourier Transforms Consider finite duration signal Its z-tranform is Evaluate at points on z-plane as We can evaluate.
Section 1.7 Linear Independence and Nonsingular Matrices
Model Structures 1. Objective Recognize some discrete-time model structures which are commonly used in system identification such as ARX, FIR, ARMAX,
CHEE825 Fall 2005J. McLellan1 Nonlinear Empirical Models.
1 Development of Empirical Models From Process Data In some situations it is not feasible to develop a theoretical (physically-based model) due to: 1.
ChE 433 DPCL Model Based Control Smith Predictors.
State-Space Recursive Least Squares with Adaptive Memory College of Electrical & Mechanical Engineering National University of Sciences & Technology (NUST)
Geology 6600/7600 Signal Analysis 26 Oct 2015 © A.R. Lowry 2015 Last time: Wiener Filtering Digital Wiener Filtering seeks to design a filter h for a linear.
What is filter ? A filter is a circuit that passes certain frequencies and rejects all others. The passband is the range of frequencies allowed through.
Analysis of Linear Time Invariant (LTI) Systems
DSP-CIS Part-III : Optimal & Adaptive Filters Chapter-9 : Kalman Filters Marc Moonen Dept. E.E./ESAT-STADIUS, KU Leuven
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
Finite Impuse Response Filters. Filters A filter is a system that processes a signal in some desired fashion. –A continuous-time signal or continuous.
1 Chapter 8 The Discrete Fourier Transform (cont.)
Transfer Functions Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: The following terminology.
STATISTICAL ORBIT DETERMINATION Kalman (sequential) filter
Transfer Functions Chapter 4
Ch8 Time Series Modeling
CJT 765: Structural Equation Modeling
PSG College of Technology
Assoc. Prof. Dr. Peerapol Yuvapoositanon
Linear Prediction.
Instructor :Dr. Aamer Iqbal Bhatti
Kalman Filter: Bayes Interpretation
Presentation transcript:

CY3A2 System identification Modelling Elvis Impersonators Fresh evidence that pop stars are more popular dead than alive. The University of Missouri’s Jean Gaddy Wilson told a recent press conference in Dallas that, in 1977 when Elvis Died there where 48 professional Elvis impersonators. Today there are If that growth is projected, by the year 2012 one person in four on the face of the globe will be an Elvis Impersonator Royal Statistical Society News, 1996 Assume Elvis’s first hit was in 1955 and that the first impersonator started in that year. Assume that there is an exponential growth in elvis impersonators i.e. that the model is of the form EI = exp(b1*year +b0)

CY3A2 System identification y=Log(EI)=b1*year + b0 We can form a matrix of independent variables We can also form a vector of dependent output variables The Least squares fit to this is The prediction for 2012 is then If Jean Gaddy Wilson is right, either there will be a dramatic drop in world population or growth of Elvis Impersonators is more dramatic than an exponential model will allow.

CY3A2 System identification

Time series models (ARMAX) General form of the discrete time model used for system identification is the ARMAX model. Autoregressive, Moving Average, Exogeneous inputs. Autoregressive refers to the fact that the output is a linear combination of previous values of the output. Moving Average refers to the noise model. Exogeneous implies that there is an input to the system along with knowledge of its previous values. Thus the model is

CY3A2 System identification The picture is : Use a delay block

CY3A2 System identification

Variants are Autoregressive Moving Average (ARMA) - No access to knowledge of the input Autoregressive exogeneous (ARX) - Assume that only disturbance is white noise Finite Impulse response (FIR) - Output is a linear combination of only past input values. The output will drop to zero in finite time if the input becomes zero. Note on z transform We can use the z transform on the ARMAX model and its variants to specify the z domain transfer function as

CY3A2 System identification L.S. parameter calculation of ARMAX models We can put the general ARMAX model into a vector form for instant i as For all data values, taken over a range of data i=1, …n, form a vector y, and a matrix Φ values thus all the data can be collected together to form the following

CY3A2 System identification As you’ve guessed it, at time n the least squares solution to this is But now add a new input value u and a new output value y and we need to recalculate the entire thing. Recursive identification methods Would like a way of efficiently recalculating the model each time we have new data. Ideal form would be Thus if the model is correct at time n-1 and the new data at time n is indicative of the model then the correction factor would be zero.

CY3A2 System identification Advantages of recursive model estimation Gives an estimate of the model (all be it poor) from the first time step Can be computationally more efficient and less memory intensive, especially if we can avoid doing large matrix inverse calculations Can be made to adapt to a changing system, eg online system identification allows telephone systems to do echo cancellation on long distance lines. Can be used for fault detection, model estimates start to differ radically from a norm Forms the core of adaptive control strategies and adaptive signal processing Ideal for real-time implementations

CY3A2 System identification Example: Estimation of a constant (scalar) model: y i i This is the mean level of the signal, derived by LS method.

CY3A2 System identification If we introduce a subscript n to represent the fact that n data points are used in deriving the mean, such that The above equation is the least squares in recursive form.

CY3A2 System identification General form of Recursive algorithms where is a vector of model parameters estimate is the difference between the measured output and the estimated output at time n is the scaling - sometimes known as the Kalman Gain