Kalman Filter in the Real Time URBIS model Richard Kranenburg Master scriptie June 11, 2010.

Slides:



Advertisements
Similar presentations
State Space Models. Let { x t :t T} and { y t :t T} denote two vector valued time series that satisfy the system of equations: y t = A t x t + v t (The.
Advertisements

The Normal Distribution
Forecasting Using the Simple Linear Regression Model and Correlation
A.M. Alonso, C. García-Martos, J. Rodríguez, M. J. Sánchez Seasonal dynamic factor model and bootstrap inference: Application to electricity market forecasting.
Kriging.
Use of Kalman filters in time and frequency analysis John Davis 1st May 2011.
P M V Subbarao Professor Mechanical Engineering Department
A Short Introduction to Curve Fitting and Regression by Brad Morantz
Observers and Kalman Filters
State space model of precipitation rate (Tamre Cardoso, PhD UW 2004) Updating wave height forecasts using satellite data (Anders Malmberg, PhD U. Lund.
ECMWF CO 2 Data Assimilation at ECMWF Richard Engelen European Centre for Medium-Range Weather Forecasts Reading, United Kingdom Many thanks to Phil Watts,
Background Estimation with Gaussian Distribution for Image Segmentation, a fast approach Gianluca Bailo, Massimo Bariani, Paivi Ijas, Marco Raggio IEEE.
Chapter 13 Introduction to Linear Regression and Correlation Analysis
Petter Mostad Linear regression Petter Mostad
Visual Recognition Tutorial1 Random variables, distributions, and probability density functions Discrete Random Variables Continuous Random Variables.
Jana van Greunen - 228a1 Analysis of Localization Algorithms for Sensor Networks Jana van Greunen.
Estimation and the Kalman Filter David Johnson. The Mean of a Discrete Distribution “I have more legs than average”
1 Confidence Intervals for Means. 2 When the sample size n< 30 case1-1. the underlying distribution is normal with known variance case1-2. the underlying.
Lecture II-2: Probability Review
Introduction to Regression Analysis, Chapter 13,
Slam is a State Estimation Problem. Predicted belief corrected belief.
Correlation and Linear Regression
Colorado Center for Astrodynamics Research The University of Colorado STATISTICAL ORBIT DETERMINATION Project Report Unscented kalman Filter Information.
Introduction to Linear Regression and Correlation Analysis
Alignment and classification of time series gene expression in clinical studies Tien-ho Lin, Naftali Kaminski and Ziv Bar-Joseph.
Computer vision: models, learning and inference Chapter 19 Temporal models.
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 Part 4 Curve Fitting.
A P STATISTICS LESSON 2 – 2 STANDARD NORMAL CALCULATIONS.
Introduction to Linear Regression
Chap 12-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 12 Introduction to Linear.
V Gorin and M Tsyrulnikov Can model error be perceived from routine observations?
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High-resolution data assimilation in COSMO: Status and.
Potential benefits from data assimilation of carbon observations for modellers and observers - prerequisites and current state J. Segschneider, Max-Planck-Institute.
Chapter 8 Curve Fitting.
Summary of introduced statistical terms and concepts mean Variance & standard deviation covariance & correlation Describes/measures average conditions.
Quality control of daily data on example of Central European series of air temperature, relative humidity and precipitation P. Štěpánek (1), P. Zahradníček.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 26: Singular Value Decomposition.
The “ ” Paige in Kalman Filtering K. E. Schubert.
The climate and climate variability of the wind power resource in the Great Lakes region of the United States Sharon Zhong 1 *, Xiuping Li 1, Xindi Bian.
Maximum Likelihood Estimation and Simplified Kalman Filter tecniques for real time Data Assimilation.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Local Probabilistic Weather Predictions for Switzerland.
Uncertainty assessment in European air quality mapping and exposure studies Bruce Rolstad Denby, Jan Horálek 2, Frank de Leeuw 3, Peter de Smet 3 1 Norwegian.
Local Predictability of the Performance of an Ensemble Forecast System Liz Satterfield and Istvan Szunyogh Texas A&M University, College Station, TX Third.
Simulation Study for Longitudinal Data with Nonignorable Missing Data Rong Liu, PhD Candidate Dr. Ramakrishnan, Advisor Department of Biostatistics Virginia.
Kalman Filter in Real Time URBIS Richard Kranenburg
Short Introduction to Particle Filtering by Arthur Pece [ follows my Introduction to Kalman filtering ]
Introducing Error Co-variances in the ARM Variational Analysis Minghua Zhang (Stony Brook University/SUNY) and Shaocheng Xie (Lawrence Livermore National.
Cameron Rowe.  Introduction  Purpose  Implementation  Simple Example Problem  Extended Kalman Filters  Conclusion  Real World Examples.
FORECASTING METHODS OF NON- STATIONARY STOCHASTIC PROCESSES THAT USE EXTERNAL CRITERIA Igor V. Kononenko, Anton N. Repin National Technical University.
Stochastic Hydrology Random Field Simulation Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and  2 Now, we need procedures to calculate  and  2, themselves.
The Unscented Kalman Filter for Nonlinear Estimation Young Ki Baik.
École Doctorale des Sciences de l'Environnement d’ Î le-de-France Année Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
CHAPTER 4 ESTIMATES OF MEAN AND ERRORS. 4.1 METHOD OF LEAST SQUARES I n Chapter 2 we defined the mean  of the parent distribution and noted that the.
École Doctorale des Sciences de l'Environnement d’Île-de-France Année Universitaire Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
Zhaoxia Fu, Yan Han Measurement Volume 45, Issue 4, May 2012, Pages 650–655 Reporter: Jing-Siang, Chen.
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
Probabilistic Robotics Bayes Filter Implementations Gaussian filters.
CWR 6536 Stochastic Subsurface Hydrology Optimal Estimation of Hydrologic Parameters.
Part 5 - Chapter
Probabilistic Robotics
Precisions of Adjusted Quantities
Kalman Filtering: Control with Limited/Noisy Measurements
Lecture 10: Observers and Kalman Filters
Stefano Grassi WindEurope Summit
Stochastic Hydrology Random Field Simulation
Master Thesis Presentation
Descriptive Statistics Univariate Data
Presentation transcript:

Kalman Filter in the Real Time URBIS model Richard Kranenburg Master scriptie June 11, 2010

Kalman Filter in the Real Time URBIS model Introduction Real Time URBIS model Problems and Goals Method Kalman filter equations Results Extensions on the Kalman Filter Conclusions

Introduction Company: TNO Business Unit: ‘BenO’ Department: ‘ULO’ Accompanists: Michiel Roemer (TNO) Jan Duyzer (TNO) Arjo Segers (TNO) Kees Vuik (TUDelft)

Real Time URBIS model

Real Time URBIS Model URBIS Model, standard concentration fields 11 sources, 4 wind directions, 2 wind speeds

Real Time URBIS model Every hour interpolation between standard concentration fields Correction for background and traffic fields μ is the weight function dependent of wind direction (φ), wind speed (v), temperature (T), hour (h), day (d), month (m) : standard concentration fields

Real Time URBIS model

Linear correction used by DCMR Average concentration of three stations Schiedam Hoogvliet Maassluis

Real Time URBIS model

Problems and Goals The model simulation can become negative No information about the uncertainty of the simulation Goal: Find an uncertainty interval for the concentration NO, which does not contain negative concentrations

Method Kalman filter connects the model simulations with a series of measurements Kalman filter corrects the model in two steps Forecast step Analysis step Result is a (multivariate) Gaussian distribution of the unknown Mean Covariance matrix

Kalman filter equations Correction factor ( ) for each standard concentration field Kalman filter calculates a Gaussian distribution for the unknown variable ( ) The concentration NO can be found in a log- normal distribution

Kalman filter equations Second equation not linear in ( ), thus a linearization around H: projection matrix, A: correlation matrix represents the uncertainty of the measurements on time k

Kalman filter equations The linearization results in: with:

Kalman filter equations Forecast step represents the uncertainty of the model is the covariance matrix after the forecast step The temporal correlation matrix A is determined with information from the measurements

Kalman filter equations Analysis step Minimum variance gain

Kalman filter equations Start of the iteration process: Screening process: Before the analysis step is executed, the measurements are screened. If difference between simulation and observation is too large, that observation will be thrown away. In this application the criterion is twice the standard deviation

Results

For the whole domain on each hour an uncertainty interval for the concentration NO can be calculated Annual mean of the widths of these uncertainty intervals Population density on the whole domain Connection between population and uncertainty

Results

Connection between uncertainty and population Kalman filter reduced the uncertainty Absolute uncertainty: 14.5 % Relative uncertainty: 16.1 %

Extensions of the Kalman filter Goal: Minimize the uncertainty connected with the population Methods: Add extra monitoring stations to the system Apply Kalman filter with different time scale and add stations with other time scales Analyse the values of the correction factors