V Gorin and M Tsyrulnikov Can model error be perceived from routine observations?

Slides:



Advertisements
Similar presentations
Variational data assimilation and forecast error statistics
Advertisements

ECE 8443 – Pattern Recognition LECTURE 05: MAXIMUM LIKELIHOOD ESTIMATION Objectives: Discrete Features Maximum Likelihood Resources: D.H.S: Chapter 3 (Part.
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
Use of Kalman filters in time and frequency analysis John Davis 1st May 2011.
Sampling: Final and Initial Sample Size Determination
Budapest May 27, 2008 Unifying mixed linear models and the MASH algorithm for breakpoint detection and correction Anders Grimvall, Sackmone Sirisack, Agne.
1 What constrains spread growth in forecasts initialized from ensemble Kalman filters? Tom Hamill (& Jeff Whitaker) NOAA Earth System Research Lab Boulder,
3.11 Adaptive Data Assimilation to Include Spatially Variable Observation Error Statistics Rod Frehlich University of Colorado, Boulder and RAL/NCAR Funded.
Design and Validation of Observing System Simulation Experiments (OSSEs) Ronald Errico Goddard Earth Sciences Technology and Research Center at Morgan.
Sampling Distributions
Kalman Filter in the Real Time URBIS model Richard Kranenburg Master scriptie June 11, 2010.
ASSIMILATION of RADAR DATA at CONVECTIVE SCALES with the EnKF: PERFECT-MODEL EXPERIMENTS USING WRF / DART Altuğ Aksoy National Center for Atmospheric Research.
Some Innovative Applications and Approaches Using Nudging Four Dimensional Data Assimilation: Lili Lei and David R. Stauffer Dept. of Meteorology, Penn.
Statistics, data, and deterministic models NRCSE.
Brian Ancell, Cliff Mass, Gregory J. Hakim University of Washington
Statistics, data, and deterministic models NRCSE.
Accounting for correlated AMSU-A observation errors in an ensemble Kalman filter 18 August 2014 The World Weather Open Science Conference, Montreal, Canada.
UNBIASED ESTIAMTION OF ANALYSIS AND FORECAST ERROR VARIANCES
Two Methods of Localization  Model Covariance Matrix Localization (B Localization)  Accomplished by taking a Schur product between the model covariance.
8-1 Introduction In the previous chapter we illustrated how a parameter can be estimated from sample data. However, it is important to understand how.
Background In deriving basic understanding of atmospheric phenomena, the analysis often revolves around discovering and exploiting relationships between.
A comparison of hybrid ensemble transform Kalman filter(ETKF)-3DVAR and ensemble square root filter (EnSRF) analysis schemes Xuguang Wang NOAA/ESRL/PSD,
Maximum likelihood (ML)
Lecture II-2: Probability Review
Geo479/579: Geostatistics Ch13. Block Kriging. Block Estimate  Requirements An estimate of the average value of a variable within a prescribed local.
© Crown copyright Met Office Adaptive mesh method in the Met Office variational data assimilation system Chiara Piccolo and Mike Cullen Adaptive Multiscale.
Ensemble-variational sea ice data assimilation Anna Shlyaeva, Mark Buehner, Alain Caya, Data Assimilation and Satellite Meteorology Research Jean-Francois.
Chapter 15 Modeling of Data. Statistics of Data Mean (or average): Variance: Median: a value x j such that half of the data are bigger than it, and half.
ECE 8443 – Pattern Recognition LECTURE 06: MAXIMUM LIKELIHOOD AND BAYESIAN ESTIMATION Objectives: Bias in ML Estimates Bayesian Estimation Example Resources:
3D-Var Revisited and Quality Control of Surface Temperature Data Xiaolei Zou Department of Meteorology Florida State University June 11,
ESA DA Projects Progress Meeting 2University of Reading Advanced Data Assimilation Methods WP2.1 Perform (ensemble) experiments to quantify model errors.
Lecture 12 Statistical Inference (Estimation) Point and Interval estimation By Aziza Munir.
The Importance of Atmospheric Variability for Data Requirements, Data Assimilation, Forecast Errors, OSSEs and Verification Rod Frehlich and Robert Sharman.
WWOSC 2014, Aug 16 – 21, Montreal 1 Impact of initial ensemble perturbations provided by convective-scale ensemble data assimilation in the COSMO-DE model.
ISDA 2014, Feb 24 – 28, Munich 1 Impact of ensemble perturbations provided by convective-scale ensemble data assimilation in the COSMO-DE model Florian.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High-resolution data assimilation in COSMO: Status and.
Potential benefits from data assimilation of carbon observations for modellers and observers - prerequisites and current state J. Segschneider, Max-Planck-Institute.
METHOD OF PERTURBED OBSERVATIONS FOR BUILDING REGIONS OF POSSIBLE PARAMETERS IN ORBITAL DYNAMICS INVERSE PROBLEM Avdyushev V.
Dataset Development within the Surface Processes Group David I. Berry and Elizabeth C. Kent.
Radar in aLMo Assimilation of Radar Information in the Alpine Model of MeteoSwiss Daniel Leuenberger and Andrea Rossa MeteoSwiss.
Spatio-Temporal Surface Vector Wind Retrieval Error Models Ralph F. Milliff NWRA/CoRA Lucrezia Ricciardulli Remote Sensing Systems Deborah K. Smith Remote.
Assimilating chemical compound with a regional chemical model Chu-Chun Chang 1, Shu-Chih Yang 1, Mao-Chang Liang 2, ShuWei Hsu 1, Yu-Heng Tseng 3 and Ji-Sung.
Potential Benefits of Multiple-Doppler Radar Data to Quantitative Precipitation Forecasting: Assimilation of Simulated Data Using WRF-3DVAR System Soichiro.
Chapter 5 Parameter estimation. What is sample inference? Distinguish between managerial & financial accounting. Understand how managers can use accounting.
11 Background Error Daryl T. Kleist* National Monsoon Mission Scoping Workshop IITM, Pune, India April 2011.
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
Three Frameworks for Statistical Analysis. Sample Design Forest, N=6 Field, N=4 Count ant nests per quadrat.
Chapter 7 Point Estimation of Parameters. Learning Objectives Explain the general concepts of estimating Explain important properties of point estimators.
1 Standard error Estimated standard error,s,. 2 Example 1 While measuring the thermal conductivity of Armco iron, using a temperature of 100F and a power.
Local Predictability of the Performance of an Ensemble Forecast System Liz Satterfield and Istvan Szunyogh Texas A&M University, College Station, TX Third.
The Infrastructure, Design and Applications of Observing System Simulation Experiments at NASA's Global Modeling and Assimilation Office By Ronald M. Errico.
1 Chapter 8: Model Inference and Averaging Presented by Hui Fang.
Surveying II. Lecture 1.. Types of errors There are several types of error that can occur, with different characteristics. Mistakes Such as miscounting.
The application of ensemble Kalman filter in adaptive observation and information content estimation studies Junjie Liu and Eugenia Kalnay July 13th, 2007.
LOCAL ENSEMBLE KALMAN FILTER (LETKF) ANALYSIS OF LOOP CURRENT & EDDY IN THE GULF OF MEXICO Fanghua Xu 1, Leo Oey 1, Yasumasa Miyazawa 2, Peter Hamilton.
ENSEMBLE KALMAN FILTER IN THE PRESENCE OF MODEL ERRORS Hong Li Eugenia Kalnay.
Korea Institute of Atmospheric Prediction Systems (KIAPS) ( 재 ) 한국형수치예보모델개발사업단 Identical Twin Experiments for the Representer Method with a Spectral Element.
Bias-Variance Analysis in Regression  True function is y = f(x) +  where  is normally distributed with zero mean and standard deviation .  Given a.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Statistical Interpretation of Least Squares ASEN.
ECMWF/EUMETSAT NWP-SAF Satellite data assimilation Training Course Mar 2016.
Space and Time Mesoscale Analysis System — Theory and Application 2007
LECTURE 06: MAXIMUM LIKELIHOOD ESTIMATION
STATISTICAL ORBIT DETERMINATION Coordinate Systems and Time Kalman Filtering ASEN 5070 LECTURE 21 10/16/09.
Sampling Distributions
Basic simulation methodology
Sampling Distributions
AP Statistics: Chapter 7
Retuning the turbulent gust component in the COSMO model
Error statistics in data assimilation
Sarah Dance DARC/University of Reading
Presentation transcript:

V Gorin and M Tsyrulnikov Can model error be perceived from routine observations?

Motivation: all existing approaches in model-error modeling are largely ad-hoc. Any objective knowledge on real model errors is very welcome.

Model error: definition The forecast equation: The truth substituted into the forecast equation: Model error = forecast tendency minus true tendency:

The goal: objectively estimate a model error model Let us aim to estimate a mixed additive-multiplicative model: where epsilon_add and mu are spatio-temporal random fields, whose probability distributions are to be estimated. Even in a parametrized Gaussian case, estimating model parameters (variances and length scales) requires a proxy to model error epsilon.

Assessing model error: approximations 1)In dX/dt, replace the truth by observations. 2)Replace instantaneous tendencies with finite-time ones. 3)In F(X), replace the truth by the analysis (and subsequent forecast). The question: can we assess epsilon having the r.h.s. of this equation?

Numerical experiments: setup Methodology: OSSE. Model: COSMO (LAM, 5000*5000 km, 40 levels, 14 km mesh). Observations: T,u,v,q, all grid points observed, obs error covariance proportional to background error covariance. Analysis: simplified: with R~B, the gain matrix is diagonal. Assimilation: 6-h cycle; 1-month long, interpolated global analyses as LBC. Model error: univariate and constant in space and time for 6-h periods. Finite-time tendency lengths: 1, 3, and 6 h.

Magnitudes of imposed model errors and obs errors Obs errors std: (1) realistic (1 K and 2 m/s) (2) unrealistically low (0.1 K and 0.2 m/s) (3) zero Model errors std: (1) realistic (1 K/day and 2 m/s per day) (2) unrealistically high (5 K/day and 10 m/s per day)

Assessing model error: an approximation-error measure If model error is observable, then Both quantities are known from simulations, so we define the discrepancy (the model-error observability error ) as should be close to data

Results (1) The model-error observability. R.m.s. statistics. Realistic error magnitudes With realistic both obs error and model error, the model-error observability error r appears to be above 1 (not observable at all) for all 3 tendency lengths (not shown).

Results (2): obs error small or zero, model error normal. The model-error observability error “r”

Results (3): an example of finite-time forecast tendency error. Dashed – expected model error eps*(Delta t), colored – perceived model error d. Forecast starts from truth, model error normal. Temperature Model error is observable within 6 hours (albeit imperfectly)

Results (4): an example of finite-time forecast tendency error. Dashed – expected model error eps*(Delta t), colored – perceived model error d. Forecast starts from truth, model error normal. Zonal wind Model error is observable within 2 hours

Results (5 ): an example of finite-time forecast tendency error. Dashed – expected model error eps*(Delta t), colored – perceived model error d. Forecast starts from truth, model error normal. Meridional wind Model error is observable within just 1 hour

Conclusions = Existing routine observations are far too scarse and far too inaccurate to allow a reliable assessment of realistic-magnitude model errors. = A field experiment could, in principle, be imagined to assess model errors. = Comparisons of tendencies from operational parametrizations vs. most sophisticated ones (both tendencies start from the same state) can be used as proxies to model errors. The END

Results (6): obs error small or zero, model error large. The model-error observability error “r”