SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory For The User” Lennart Ljung

lecture 1 Ali Karimpour Nov Lecture 1 Introduction Topics to be covered include: v Dynamic systems. v Models. v An Archetypical problem-ARX models and LSM. v The system identification procedure.

lecture 1 Ali Karimpour Nov Dynamic systems System: An object in which variables of different kinds interact and produce observable signals. Stimuli: External signals that affects system. Dynamic System: A system that the current output value depends not only on the current external stimuli but also on their earlier value. Time series: A dynamic system whose external stimuli are not observed.

lecture 1 Ali Karimpour Nov Dynamic systems Stimuli It can be manipulated by the observer. Input Disturbance It can not be manipulated by the observer. Measured Unmeasured Dynamic system Input u Measured disturbance w Unmeasured disturbance v Output y

lecture 1 Ali Karimpour Nov A solar heated house Dynamic system Pump velocity u Solar radiation w Wind, outdoor temperature v Storage temperature y

lecture 1 Ali Karimpour Nov Speech generation Dynamic system chord, vibaration airflow v Sound y Time series: A dynamic system whose external stimuli are not observed.

lecture 1 Ali Karimpour Nov Models Model: Relationship among observed signals. Model types 1- Mental models 2- Graphical models 3- Mathematical (analytical) models 4- Software models Split up system into subsystems, Joined subsystems mathematically, 1- Modeling 2- System identification Does not necessarily involve any experimentation on the actual system. Building models It is directly based on experimentation. Input and output signals from the system are recorded. 3- Combined

lecture 1 Ali Karimpour Nov The fiction of a true model

lecture 1 Ali Karimpour Nov A Basic problem and the linear least squares method Perhaps the most basic relationship between the input and output is the linear difference equation Where

lecture 1 Ali Karimpour Nov Least Square Method Suppose that we don’t know the value of parameters θ, but the recorded input and output over a time interval 1 ≤ t ≤ N is: Now define:

lecture 1 Ali Karimpour Nov First order difference equation Consider the simple model Now we have Then

lecture 1 Ali Karimpour Nov First order difference equation Consider the simple model Exercise: Suppose for t=1 to 6 the value of u and y are: Derive

lecture 1 Ali Karimpour Nov Where An Archetypical problem of system identification

lecture 1 Ali Karimpour Nov Linear Regression Model structures such as That are linear in θ are known in statistics as linear regressions. The vector φ(t) is called the regression vector and its components are the regressors. In this models y(t) explained with the regression vector φ(t) –which contains older value of y(t)- so it is called Auto-Regression with eXtera inputs. ARX-models Auto Extra

lecture 1 Ali Karimpour Nov Model quality and experimental design Consider a finite impulse response (FIR) Observed data generate by e(t) is a white noise sequence with variance λ

lecture 1 Ali Karimpour Nov Model quality and experimental design deterministic stochastic The estimate is consequently unbiased. The covariance matrix of the parameter error is: Exercise1 : Derive P N. Exercise2 : Let show that

lecture 1 Ali Karimpour Nov Model quality and experimental design

lecture 1 Ali Karimpour Nov The system identification procedure The construction of a model from data involves three basic identities 2- The set of candidate models; a model structure. 3- A rule by which candidate models can be assessed using the data, like the least square selection rule. 1- A data set, like Z N. The data must be maximally informative, subject to constraints. The most important and at the same time, the most difficult choice. Model sets with adjustable parameters with physical interpretation may be called gray boxes. Models whose parameters do not reflect physical consideration may be called black boxes.

lecture 1 Ali Karimpour Nov A model structure. 3- Set the parameters. 1- A data set, like Z N. Model validation We arrived at a particular model. Whether the model is good enough? Whether it is valid for its purpose? Model validation Note: A model can never be accepted as a final and true description of the system. Rather, it can at best be regarded as a good enough description of certain aspects that are particular interest to us.

lecture 1 Ali Karimpour Nov Experimental Design Data Choose Model set Choose Criteria to fit Calculate Model Validate Model Prior Knowledge Ok : use it Not Ok : Revise The system identification loop The model may be deficient for variety of reasons: The numerical procedure failed to find the best model according to our criterion. The criterion was not well chosen. The model set was not appropriate. The data set was not informative enough.