The catchment: empirical model NRML10 Lena - Delta Andrea Castelletti Politecnico di Milano.

Slides:



Advertisements
Similar presentations
Hydrology Rainfall - Runoff Modeling (I)
Advertisements

Integrability, neural networks, and the empirical modelling of dynamical systems Oscar Garcia forestgrowth.unbc.ca.
Self tuning regulators
Overview... Consumption: Basics The setting
Testing Theories: Three Reasons Why Data Might not Match the Theory.
Modeling & Simulation. System Models and Simulation Framework for Modeling and Simulation The framework defines the entities and their Relationships that.
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
Dynamic Bayesian Networks (DBNs)
Use of regression analysis Regression analysis: –relation between dependent variable Y and one or more independent variables Xi Use of regression model.
CY3A2 System identification Modelling Elvis Impersonators Fresh evidence that pop stars are more popular dead than alive. The University of Missouri’s.
1 Detection and Analysis of Impulse Point Sequences on Correlated Disturbance Phone G. Filaretov, A. Avshalumov Moscow Power Engineering Institute, Moscow.
Validating uncertain predictions Tony O’Hagan, Leo Bastos, Jeremy Oakley, University of Sheffield.
Corporate Banking and Investment Mathematical issues with volatility modelling Marek Musiela BNP Paribas 25th May 2005.
1 Alberto Montanari University of Bologna Simulation of synthetic rainfall series.
Uncertainty Representation. Gaussian Distribution variance Standard deviation.
FIN 685: Risk Management Topic 5: Simulation Larry Schrenk, Instructor.
280 SYSTEM IDENTIFICATION The System Identification Problem is to estimate a model of a system based on input-output data. Basic Configuration continuous.
PROVIDING DISTRIBUTED FORECASTS OF PRECIPITATION USING A STATISTICAL NOWCAST SCHEME Neil I. Fox and Chris K. Wikle University of Missouri- Columbia.
Curve-Fitting Regression
Development of Empirical Models From Process Data
ARIMA Forecasting Lecture 7 and 8 - March 14-16, 2011
1 Simple Linear Regression Chapter Introduction In this chapter we examine the relationship among interval variables via a mathematical equation.
Linear and generalised linear models
CS 188: Artificial Intelligence Fall 2009 Lecture 19: Hidden Markov Models 11/3/2009 Dan Klein – UC Berkeley.
Radial Basis Function Networks
Rule-Based Fuzzy Model. In rule-based fuzzy systems, the relationships between variables are represented by means of fuzzy if–then rules of the following.
October 8, 2013Computer Vision Lecture 11: The Hough Transform 1 Fitting Curve Models to Edges Most contours can be well described by combining several.
Random Process The concept of random variable was defined previously as mapping from the Sample Space S to the real line as shown below.
Chapter 2 – Business Forecasting Takesh Luckho. What is Business Forecasting?  Forecasting is about predicting the future as accurately as possible,
Theory testing Part of what differentiates science from non-science is the process of theory testing. When a theory has been articulated carefully, it.
1 Validation & Verification Chapter VALIDATION & VERIFICATION Very Difficult Very Important Conceptually distinct, but performed simultaneously.
1 Performance Evaluation of Computer Networks: Part II Objectives r Simulation Modeling r Classification of Simulation Modeling r Discrete-Event Simulation.
Standardizing catch per unit effort data
BsysE595 Lecture Basic modeling approaches for engineering systems – Summary and Review Shulin Chen January 10, 2013.
Frequency Analysis and Data Reading: Applied Hydrology Sections
The catchment: mechanistic model Andrea Castelletti Politecnico di Milano NRML09.
Designing the alternatives NRMLec16 Andrea Castelletti Politecnico di Milano Gange Delta.
Curve-Fitting Regression
Ordinary Least Squares Estimation: A Primer Projectseminar Migration and the Labour Market, Meeting May 24, 2012 The linear regression model 1. A brief.
CY3A2 System identification Assignment: The assignment has three parts, all relating.
Algorithms & Flowchart
2005MEE Software Engineering Lecture 11 – Optimisation Techniques.
Chapter 1 Introduction n Introduction: Problem Solving and Decision Making n Quantitative Analysis and Decision Making n Quantitative Analysis n Model.
Robotics Research Laboratory 1 Chapter 7 Multivariable and Optimal Control.
ECE-7000: Nonlinear Dynamical Systems Overfitting and model costs Overfitting  The more free parameters a model has, the better it can be adapted.
Introduction to the TOPMODEL
V Bandi and R Lahdelma 1 Forecasting. V Bandi and R Lahdelma 2 Forecasting? Decision-making deals with future problems -Thus data describing future must.
Estimation Method of Moments (MM) Methods of Moment estimation is a general method where equations for estimating parameters are found by equating population.
Sampling and estimation Petter Mostad
OPERATING SYSTEMS CS 3530 Summer 2014 Systems and Models Chapter 03.
Surface Water Surface runoff - Precipitation or snowmelt which moves across the land surface ultimately channelizing into streams or rivers or discharging.
Synthetic UH Definition: Synthetic Hydrograph is a plot of flow versus time and generated based on a minimal use of streamflow data. Example: A pending.
Chapter 2-OPTIMIZATION G.Anuradha. Contents Derivative-based Optimization –Descent Methods –The Method of Steepest Descent –Classical Newton’s Method.
Model Structures 1. Objective Recognize some discrete-time model structures which are commonly used in system identification such as ARX, FIR, ARMAX,
CHEE825 Fall 2005J. McLellan1 Nonlinear Empirical Models.
ERT 210/4 Process Control & Dynamics DYNAMIC BEHAVIOR OF PROCESSES :
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 29: Observability and Introduction.
Hydrological Forecasting. Introduction: How to use knowledge to predict from existing data, what will happen in future?. This is a fundamental problem.
Lecture 2: Mathematical Modeling Copyright © Thomas Marlin 2013 The copyright holder provides a royalty-free license for use of this material at non-profit.
Team  Spatially distributed deterministic models  Many hydrological phenomena vary spatially and temporally in accordance with the conservation.
Chapter 2. Signals and Linear Systems
Modelling & Simulation of Semiconductor Devices Lecture 1 & 2 Introduction to Modelling & Simulation.
Traffic Simulation L2 – Introduction to simulation Ing. Ondřej Přibyl, Ph.D.
Mathematical Descriptions of Systems
Regression Models - Introduction
Overview of Models & Modeling Concepts
Filtering and State Estimation: Basic Concepts
Markov Decision Problems
Linear Time Invariant systems
Dr. Arslan Ornek MATHEMATICAL MODELS
Presentation transcript:

The catchment: empirical model NRML10 Lena - Delta Andrea Castelletti Politecnico di Milano

2 The catchment control section

3 Traditional models Rational method (Mulvany, 1850) Unit hydrograph Sherman (1932) Nash model (1957)

4 pioggia d(t)d(t) t P impulsive unit rainfall Rational method (Mulvany, 1850) P t stepwise unit rainfall t A d tctc t tctc A(t)A(t) t dA t+dt

5 Unit hydrograph (Sherman, 1932) Postulates For a given catchment: 1.Runoff duration is equal for rainfall events of equal duration, regardless of their total volume. 2.At time t from the beginning of the event, rainfall events having the same temporal distribution generate runoff volumes in the same relation as the total volumes of rainfall. 3.Runoff temporal distribution does not depend on the previous history of the catchment

6 Convolution integral Unit hydrograph (Sherman, 1932) t P d t tctc Cumulative hydrograph curve unit hydrograph rainfall The catchment is a linear system

7 Nash model (Nash 1957) PtPt dtdt The catchment is modelled as a cascade of n (e.g. n=4) reservoirs State transition h1Pth1Pt k1xt1k1xt1 x1x1 h2Pth2Pt k2xt2k2xt2 x2x2 h3Pth3Pt k3xt3k3xt3 x3x3 x4x4 h4Pth4Pt k4xt4 =k4xt4 = dtdt Output transformation

8 Modello di Nash, 1957 The catchment is modelled as a cascade of n (e.g. n=4) reservoirs State transition Output transformation Linear system

9 ARX models (‘ 70) d t+1 = d t persistent runoff d t+1 = 2d t - d t-1 AR(2) d t+1 = a 1 d t +….+a n d t-n+1 AR(n) ARX d t+1 = P t-n+1 n = time of concentration d t+1 = b 1 P t + …+b n P t-n+1 3) Complete model: 1) Runoff prediction using rainfall data: 2) Runoff prediction using runoff data: t d t-2 t-1 t t+1 measure comput.

10 Some remarks ARX ≡ Sherman : a linear model described through the impulse response. ARX ≡ Mulvany : the catchment is a linear system (the impulse response is the derivative of the step response) These 4 models are identical by a mathematical point of view. They can be traced back to the same linear equation. ARX is the I/O relation of a linear discrete model ARX ≡ Nash

11 Some remarks The main difference in the 4 approaches is the way the parameters are estimated Mulvany: performs a qualitative estimate based on the topographic characteristic of the cacthment. Sherman: either assumes a given a priori shape for the unit hydrograph or estimates it starting from observed impulsive rainfall events. Nash: uses a trial-and-error approach for estimating the parameters ARX: uses the least square algorithm

12 but then …  the functions of the models could be identified directly, without caring about the cause-effect relationships in the real physical process  more precisely, we could directly identify the relationship between inputs and outputs For instance, we could describe the dynamics of the output with an expression of the following form usually called either input/output form or external representation empirical models

13 Mechanistic models Reality Empirical models Mechanistic and empirical models How to find it? SPACE OF THE MODELS

14 Empirical models They simply reproduce the relationship between the system inputs and outputs Rainfall time series Empirical model Flow rate time series structural changes in the water system can not be modelled. Drawback

15 Empirical models Does the external representation always exist? In practice.... empirically assume that it exists fix the order (p,r’,r’’,q) of the model a priori and perform the parameter estimation using the appropriate algorithm; if the model outputs fit the reality well, the external representation have been found; otherwise, go back to the previous step and increase the model order... go on until the external representation has been found or the model order is “too high”. internal representation of the reservoir external representation Examples

16 Empirical models Empirical models do not aim at increasing our knowledge of the physical process (scientific purpose), but only at predicting as accurately as possible the system ouputs given some inputs (engineering purpose). black-box models The external form is sought for into an a priori given class of functions When all the variables are scalar the linear form is often used PARMAX

17 Empirical models The linear form is a very simple one and it is supported by powerful calibration algorithms, however not always is it the more suitable … but... not-linear! NOT! A non-linear class of functions would be by far a better choice, e.g. ARTIFICIAL NEURAL NETWORKS

18 Stochastic empirical models Moreover, it is worth while considering the stochastic form … some time using a “coloured noise” (non-white noise) In general process noise

19 Remarks  The external representation can be properly identified only when the available input/ouput historical time series are long enough  Empirical models can never be used when the alternatives considered do include structural changes to the system, as no data are available that describe their effects.  The prediction potential of a model highly depends on the class of functions adopted for it.

20 In conclusion …  Mechanistic models tend to be too much complicated and often describe details that are useless if they are used for management purposes only, i.e. details with no effect on the I/O relationship.  Identifying empirical models does require the class of function they belong to be specified a priori. This migth strongly affect the quality of the model. IDEA (relatively new 1994) Use a mechanistic model, but infer the shape of its characteristic functions directly from data, ignoring any a priori information available.

21 An example Cunning River – Australia ? The soil is too dry and the rainfall completely absorbed

22 measured runoff estimated runoff A tentative model of the Cunning river Let’s try with a PARMAX rainfall NO

23 Data Based Mechanistic (DBM) models Let’s try with a DBM model The value of  depends on the runoff rate, which in turn depends on the soil moisture.

24 Data Based Mechanistic (DBM) models Let’s try with a DBM model The value of  depends on the runoff rate, which in turn depends on the soil moisture. measured runoff estimated runoff the prediction is now accurate

25 Disturbances Ultimately, models are to be used to simulate the system behaviour under a given alternative Input trajectories are required to run simulations. provided by the policy deterministically know at time t, but at the time of the project? random: who will provide it? N.B. The disturbances we are dealing with here are the disturbances of the GLOBAL MODEL

26 Who does provide it? Two options: 1.Using the historical trajectory but it could be too short. 2.Identifying a model of the disturbance however without inputs otherwise... we fall into a vicious circle that sometime could be useful. Sooner or later the disturbance must be described without introducing further models, thus using its previous values only and, at the most, some state or control variables of the systems.

27 The model must be an empirical one and suitably changing the notation … NOT! vicious circle unless...  is a white noise process noise How to model the disturbances

28 White noise A time series for which a model can be formulated is said algorithmically compressible An algorithmically un-compressible time series is a white noise With stochastic disturbances this means a self-correlogramm equal to zero. In conclusion: distubances must be modeled as white noise

29 Reading IPWRM.Theory Ch. 4/Ap.6-7 IPWRM.Practice Sec. 6.5