SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory For The User” Lennart.

Slides:



Advertisements
Similar presentations
Design of Experiments Lecture I
Advertisements


Polynomial Curve Fitting BITS C464/BITS F464 Navneet Goyal Department of Computer Science, BITS-Pilani, Pilani Campus, India.
Pattern Recognition and Machine Learning: Kernel Methods.
Regression Analysis Module 3. Regression Regression is the attempt to explain the variation in a dependent variable using the variation in independent.
Pattern Recognition and Machine Learning
280 SYSTEM IDENTIFICATION The System Identification Problem is to estimate a model of a system based on input-output data. Basic Configuration continuous.
SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory For The User” Lennart.
Maximum likelihood Conditional distribution and likelihood Maximum likelihood estimations Information in the data and likelihood Observed and Fisher’s.
SYSTEMS Identification
SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory For The User” Lennart.
SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory For The User” Lennart.
Multivariable Control Systems Ali Karimpour Assistant Professor Ferdowsi University of Mashhad.
SYSTEMS Identification
SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory For The User” Lennart.
SYSTEMS Identification
SYSTEMS Identification
Development of Empirical Models From Process Data
SYSTEMS Identification
SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory For The User” Lennart.
SYSTEMS Identification
Multivariable Control Systems Ali Karimpour Assistant Professor Ferdowsi University of Mashhad.
Feedback Control Systems (FCS)
Radial Basis Function Networks
Radial Basis Function Networks
SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory For The User” Lennart.
Using Neural Networks to Predict Claim Duration in the Presence of Right Censoring and Covariates David Speights Senior Research Statistician HNC Insurance.
Computacion Inteligente Least-Square Methods for System Identification.
1 Chapter 2 1. Parametric Models. 2 Parametric Models The first step in the design of online parameter identification (PI) algorithms is to lump the unknown.
Intro. ANN & Fuzzy Systems Lecture 26 Modeling (1): Time Series Prediction.
Neuro-Fyzzy Methods for Modeling and Identification Part 2 : Examples Presented by: Ali Maleki.
PROCESS MODELLING AND MODEL ANALYSIS © CAPE Centre, The University of Queensland Hungarian Academy of Sciences Statistical Model Calibration and Validation.
Lecture 14 Summary of previous Lecture Regression through the origin Scale and measurement units.
U NIVERSITY of V AASA Communications and Systems Engineering Group U NIVERSITY of V AASA Communications and Systems Engineering Group TLTE.3120 Computer.
Feedback Control Systems (FCS) Dr. Imtiaz Hussain URL :
SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory For The User” Lennart.
V Bandi and R Lahdelma 1 Forecasting. V Bandi and R Lahdelma 2 Forecasting? Decision-making deals with future problems -Thus data describing future must.
SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory For The User” Lennart.
Lecture 7: State-Space Modeling 1.Introduction to state-space modeling Definitions How it relates to other modeling formalisms 2.State-space examples 3.Transforming.
Chapter 2-OPTIMIZATION G.Anuradha. Contents Derivative-based Optimization –Descent Methods –The Method of Steepest Descent –Classical Newton’s Method.
Modeling & Simulation of Dynamic Systems (MSDS)
SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory.
SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad.
State Equations BIOE Processes A process transforms input to output States are variables internal to the process that determine how this transformation.
Environmental Remote Sensing GEOG 2021 Lecture 6 Mathematical Modelling in Geography I.
LINEAR CONTROL SYSTEMS Ali Karimpour Assistant Professor Ferdowsi University of Mashhad.
Chapter 14 Introduction to Regression Analysis. Objectives Regression Analysis Uses of Regression Analysis Method of Least Squares Difference between.
Computacion Inteligente Least-Square Methods for System Identification.
Tijl De Bie John Shawe-Taylor ECS, ISIS, University of Southampton
Piecewise Polynomials and Splines
MESB374 System Modeling and Analysis
State Space Representation
Linear Regression Using Excel
Lecture 3: Linear Regression (with One Variable)
Recursive Identification of Switched ARX Hybrid Models: Exponential Convergence and Persistence of Excitation René Vidal National ICT Australia Brian D.O.Anderson.
Neural Networks for Machine Learning Lecture 1e Three types of learning Geoffrey Hinton with Nitish Srivastava Kevin Swersky.
Overview of Supervised Learning
Lecture 26 Modeling (1): Time Series Prediction
LINEAR CONTROL SYSTEMS
Lecture Slides Elementary Statistics Twelfth Edition
Digital Control Systems (DCS)
LINEAR CONTROL SYSTEMS
Ali Karimpour Associate Professor Ferdowsi University of Mashhad
Digital Control Systems (DCS)
State Space Analysis UNIT-V.
SYSTEMS Identification
Identification of Wiener models using support vector regression
Lecture Slides Elementary Statistics Twelfth Edition
Hydrology Modeling in Alaska: Modeling Overview
Introduction to Regression
Presentation transcript:

SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory For The User” Lennart Ljung(1999)

lecture 5 Ali Karimpour Nov Lecture 5 Models for Non-Linear Systems Topics to be covered include: v General Aspects v Black-box models Choice of regressors and nonlinear function Functions for a scalar regressor Expansion into multiple regressors Examples of “named” structures v Grey-box Models Physical modeling Semi-physical modeling Block oriented models Local linear models

lecture 5 Ali Karimpour Nov Models for Non-Linear Systems Topics to be covered include: v General Aspects v Black-box models Choice of regressors and nonlinear function Functions for a scalar regressor Expansion into multiple regressors Examples of “named” structures v Grey-box Models Physical modeling Semi-physical modeling Block oriented models Local linear models

lecture 5 Ali Karimpour Nov General Aspects A mathematical model for the system is a function from these data to the output at time t, y(t), in general Let Z t as input-output data. A parametric model structure is a parameterized family of such models: The difficulty is the enormous richness in possibilities of parameterizations. There are two main cases: Black-box models: General models of great flexibility Grey-box models: Some knowledge of the character of the actual system.

lecture 5 Ali Karimpour Nov Models for Non-Linear Systems Topics to be covered include: v General Aspects v Black-box models Choice of regressors and nonlinear function Functions for a scalar regressor Expansion into multiple regressors Examples of “named” structures v Grey-box Models Physical modeling Semi-physical modeling Block oriented models Local linear models

lecture 5 Ali Karimpour Nov Black-box models Let the output is scalar so: There are two main problems: 1.Choose the regression vector φ(t) A parametric model structure is a parameterized family of such models: 2. Choose the mapping g(φ,θ) Regression vector φ(t)ARX, ARMAX, OE, … For non-linear model it is common to use only measured (not predicted) ????? Choice of regressors and nonlinear function

lecture 5 Ali Karimpour Nov Black-box models There are two main problems: 1.Choose the regression vector φ(t) 2. Choose the mapping g(φ,θ) Basis functions Coordinates Scale or dilation Location parameter Global Basis Functions: Significant variation over the whole real axis. Local Basis Functions: Significant variation take place in local environment. Functions for a scalar regressor

lecture 5 Ali Karimpour Nov Several Regressors In the multi dimensional case (d>1), g k is a function of several variables: Expansion into multiple regressors

lecture 5 Ali Karimpour Nov Some non-linear model Examples of “named” structures

lecture 5 Ali Karimpour Nov Simulation and prediction Let The (one-step-ahead) predicted output is: A tougher test is to check how the model would behave in simulation i.e. only the input sequence u is used. The simulated output is: There are some important notations:

lecture 5 Ali Karimpour Nov Choose of regressors There are some important notations: Regressors in NFIR-models use past inputs Regressors in NARX-models use past inputs and outputs Regressors in NOE-models use past inputs and simulated outputs Regressors in NARMAX-models use past inputs and predicted outputs Regressors in NBJ-models use all four types.

lecture 5 Ali Karimpour Nov Network of non-linear systems

lecture 5 Ali Karimpour Nov Recurrent networks

lecture 5 Ali Karimpour Nov Models for Non-Linear Systems Topics to be covered include: v General Aspects v Black-box models Choice of regressors and nonlinear function Functions for a scalar regressor Expansion into multiple regressors Examples of “named” structures v Grey-box Models Physical modeling Semi-physical modeling Block oriented models Local linear models

lecture 5 Ali Karimpour Nov Grey-box Models Physical modeling Perform physical modeling and denote unknown physical parameters by θ So simulated (predicted) output is: The approach is conceptually simple, but could be very demanding in practice.

lecture 5 Ali Karimpour Nov 2010 Grey-box Models Physical modeling

lecture 5 Ali Karimpour Nov Grey-box Models Semi physical modeling First of all consider a linear model for system The model can not fit the system so: So we have: And also So we have Let x(t): Storage temperature Exercise1: Derive (I) Solar heated house

lecture 5 Ali Karimpour Nov Grey-box Models Block oriented models It is common situation that while the dynamics itself can be well described by a linear system, there are static nonlinearities at the input and/or output. Hammerstein Model: Wiener Model : Hammerstein Wiener Model : Other combination

lecture 5 Ali Karimpour Nov Grey-box Models Linear regression Linear regression means that the prediction is linear in parameters The key is how to choose the function φ i (u t,y t-1 ) GMDH-approach considers the regressors as typical polynomial combination of past inputs and outputs. For Hammerstein model we may choose For Wiener model we may choose Exercise2: Derive a linear regression form for equation (I) in solar heated house.

lecture 5 Ali Karimpour Nov Grey-box Models Local linear models Non-linear systems are often handled by linearization around a working point. Local linear models is to deal with the nonlinearities by selecting or averaging over some linearized model. Example: Tank with inflow u and outflow y and level h: Operating point at h * is: Linearized model around h * is:

lecture 5 Ali Karimpour Nov Grey-box Models Local linear models Sampled data around level h * leads to: Total model Let the measured working point variable be denoted by. If working point partitioned into d values, the predicted output will be:

lecture 5 Ali Karimpour Nov Grey-box Models Local linear models To built the model, we need: If the predicted corresponding to is linear in the parameters, the whole model will be a linear regression. It is also an example of a hybrid model. Sometimes the partition is to be estimated too, so the problem is considerably more difficult. Linear parameter varying (LPV) are also closely related.