Status and perspectives of the T O P A Z system An EC FP V project, Dec 2000-Nov 2003

Slides:



Advertisements
Similar presentations
Introduction to Data Assimilation NCEO Data-assimilation training days 5-7 July 2010 Peter Jan van Leeuwen Data Assimilation Research Center (DARC) University.
Advertisements

Introduction to Data Assimilation Peter Jan van Leeuwen IMAU.
OSE meeting GODAE, Toulouse 4-5 June 2009 Interest of assimilating future Sea Surface Salinity measurements.
WP4 Task T4.2 WP4-T4.2 : Establishment of validation criteria of multidisciplinary information products
Polly Smith, Alison Fowler, Amos Lawless School of Mathematical and Physical Sciences, University of Reading Exploring coupled data assimilation using.
Ozone Assimilation in the Chemistry Transport Model CHIMERE using an Ensemble Kalman Filter (EnKF) : Preliminary tests over the Ile de France region 2.
Assimilation of Sea Surface Temperature into a Northwest Pacific Ocean Model using an Ensemble Kalman Filter B.-J. Choi Kunsan National University, Korea.
Initialization Issues of Coupled Ocean-atmosphere Prediction System Climate and Environment System Research Center Seoul National University, Korea In-Sik.
CHOICES FOR HURRICANE REGIONAL ENSEMBLE FORECAST (HREF) SYSTEM Zoltan Toth and Isidora Jankov.
WWOSC, August 16-21, 2014, Montreal Recent Advances in the Mercator-Ocean reanalysis system : Assimilation of sea-ice concentration in the Arctic sea C.-E.
Medspiration user meeting, dec 4-6 Use of Medspiration and GHRSST data in the Northern Seas Jacob L. Høyer & Søren Andersen Center for Ocean and Ice, Danish.
TOPAZ monitoring and forecasting system Laurent BERTINO, Knut Arild LISÆTER, Nina WINTHER, François COUNILLON, Hanne SAGEN, Cecilie HANSEN, Intissar KEGHOUCHE.
Ibrahim Hoteit KAUST, CSIM, May 2010 Should we be using Data Assimilation to Combine Seismic Imaging and Reservoir Modeling? Earth Sciences and Engineering.
SES 2007 A Multiresolution Approach for Statistical Mobility Prediction of Unmanned Ground Vehicles 44 th Annual Technical Meeting of the Society of Engineering.
Nonlinear and Non-Gaussian Estimation with A Focus on Particle Filters Prasanth Jeevan Mary Knox May 12, 2006.
Particle Filters for Mobile Robot Localization 11/24/2006 Aliakbar Gorji Roborics Instructor: Dr. Shiri Amirkabir University of Technology.
Experimental System for Predicting Shelf-Slope Optics (ESPreSSO): Assimilating ocean color data using an iterative ensemble smoother: skill assessment.
Particle Filtering for Non- Linear/Non-Gaussian System Bohyung Han
Page 1© Crown copyright 2005 ECOOP WP5 overview “Forecast Production and Information Systems” ECOOP Consensus and planning meeting March 2005.
Classification: Internal Status: Draft Using the EnKF for combined state and parameter estimation Geir Evensen.
TOPAZ4: development and plan Counillon Francois & Bertino Laurent.
EnKF Overview and Theory
JERICO KICK OFF MEETINGPARIS – Maison de la recherche - 24 & 25 May 2011 WP9: New Methods to Assess the Impact of Coastal Observing Systems Presented by.
Computer Vision Group Prof. Daniel Cremers Autonomous Navigation for Flying Robots Lecture 6.2: Kalman Filter Jürgen Sturm Technische Universität München.
CSDA Conference, Limassol, 2005 University of Medicine and Pharmacy “Gr. T. Popa” Iasi Department of Mathematics and Informatics Gabriel Dimitriu University.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High-resolution data assimilation in COSMO: Status and.
Ocean and sea-ice data assimilation and forecasting in the TOPAZ system L. Bertino, K.A. Lisæter, I. Kegouche, S. Sandven NERSC, Bergen, Norway Arctic.
Kalman Filter (Thu) Joon Shik Kim Computational Models of Intelligence.
IGST Meeting June 2-4, 2008 The GMAO’s Ocean Data Assimilation & SI Forecasts Michele Rienecker, Christian Keppenne, Robin Kovach Jossy Jacob, Jelena Marshak.
Inter-comparison and Validation Task Team Breakout discussion.
Assimilation of HF Radar Data into Coastal Wave Models NERC-funded PhD work also supervised by Clive W Anderson (University of Sheffield) Judith Wolf (Proudman.
Probabilistic Robotics Bayes Filter Implementations.
Potential benefits from data assimilation of carbon observations for modellers and observers - prerequisites and current state J. Segschneider, Max-Planck-Institute.
TOPAZ evaluation L. Bertino, F. Counillon, P. Sakov Mohn-Sverdrup Center/NERSC GODAE workshop, Toulouse, June 2009.
TOPAZ operations, products, ongoing developments Laurent Bertino, Knut Arild Lisæter, Goran Zangana, NERSC OPNet meeting, Geilo, 6 th Nov
In collaboration with: J. S. Allen, G. D. Egbert, R. N. Miller and COAST investigators P. M. Kosro, M. D. Levine, T. Boyd, J. A. Barth, J. Moum, et al.
IICWG 5 th Science Workshop, April Sea ice modelling and data assimilation in the TOPAZ system Knut A. Lisæter and Laurent Bertino.
TOPAZ the Arctic TEP and the Arctic GOOS L. Bertino, G. Evensen, K.A. Lisæter, I. Keghouche Arctic GOOS opening, Bergen, 12 th Sept
2004 SIAM Annual Meeting Minisymposium on Data Assimilation and Predictability for Atmospheric and Oceanographic Modeling July 15, 2004, Portland, Oregon.
Applications of optimal control and EnKF to Flow Simulation and Modeling Florida State University, February, 2005, Tallahassee, Florida The Maximum.
MODEL ERROR ESTIMATION EMPLOYING DATA ASSIMILATION METHODOLOGIES Dusanka Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University.
Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005.
2nd GODAE Observing System Evaluation Workshop - June Ocean state estimates from the observations Contributions and complementarities of Argo,
GODAE Progress on national activities France (Mercator Ocean) Eric Dombrowsky - Mercator Océan.
Adaptive Hybrid EnKF-OI for State- Parameters Estimation in Contaminant Transport Models Mohamad E. Gharamti, Johan Valstar, Ibrahim Hoteit European Geoscience.
Maximum a posteriori sequence estimation using Monte Carlo particle filters S. J. Godsill, A. Doucet, and M. West Annals of the Institute of Statistical.
MPO 674 Lecture 28 4/23/15. The course on one slide 1. Intro: numerical models, ensembles, the science of prediction 2. Lorenz 1963,
EWGLAM Oct Some recent developments in the ECMWF model Mariano Hortal ECMWF Thanks to: A. Beljars (physics), E. Holm (humidity analysis)
DRAFT – Page 1 – January 14, 2016 Development of a Convective Scale Ensemble Kalman Filter at Environment Canada Luc Fillion 1, Kao-Shen Chung 1, Monique.
Nonlinear State Estimation
The Unscented Particle Filter 2000/09/29 이 시은. Introduction Filtering –estimate the states(parameters or hidden variable) as a set of observations becomes.
Ocean Biological Modeling and Assimilation of Ocean Color Data Watson Gregg NASA/GSFC/Global Modeling and Assimilation Office Assimilation Objectives:
A Random Subgrouping Scheme for Ensemble Kalman Filters Yun Liu Dept. of Atmospheric and Oceanic Science, University of Maryland Atmospheric and oceanic.
The Unscented Kalman Filter for Nonlinear Estimation Young Ki Baik.
1 Simulations of Rapid Intensification of Hurricane Guillermo with Data assimilation Using Ensemble Kalman Filter and Radar Data Jim Kao (X-2, LANL) Presentation.
Predictability of Mesoscale Variability in the East Australia Current given Strong Constraint Data Assimilation Hernan G. Arango IMCS, Rutgers John L.
Demonstration and Comparison of Sequential Approaches for Altimeter Data Assimilation in HYCOM A. Srinivasan, E. P. Chassignet, O. M. Smedstad, C. Thacker,
HYCOM data assimilation Short term: ▪ Improve current OI based technique Assimilate satellite data (tracks) directly Improve vertical projection technique.
The Ensemble Kalman filter
Ocean Monitoring and Forecasting A Commercial Perspective Dr Ralph Rayner Ocean Numerics/Fugro GEOS.
Incorporating Satellite Time-Series data into Modeling Watson Gregg NASA/GSFC/Global Modeling and Assimilation Office Topics: Models, Satellite, and In.
TOPAZ monitoring and forecasting system
Data Assimilation Theory CTCD Data Assimilation Workshop Nov 2005
Local Ensemble Transform Kalman Filter for ROMS in Indian Ocean
background error covariance matrices Rescaled EnKF Optimization
14th Cyclone Workshop Brian Ancell The University of Washington
Development of an advanced ensemble-based ocean data assimilation approach for ocean and coupled reanalyses Eric de Boisséson, Hao Zuo, Magdalena Balmaseda.
2. University of Northern British Columbia, Prince George, Canada
MOGREPS developments and TIGGE
Sarah Dance DARC/University of Reading
Presentation transcript:

Status and perspectives of the T O P A Z system An EC FP V project, Dec 2000-Nov NERSC/LEGI/CLS/AWI Continued development of DIADEM system… Continuing with the MerSea Str.1 and MerSea IP EC-projects

The monitoring and prediction system

From DIADEM to TOPAZ Model upgrades –MICOM upgraded to HYCOM –2 Sea-Ice models –3 ecosystem models (1 simple, 2 complex) –Nesting: Gulf of Mexico, North Sea (MONCOZE)

From DIADEM to TOPAZ Assimilation already in Real-time –SST ¼ degree from CLS, with clouds. –SLA ¼ degree from CLS. Assimilation tested –SeaWIFs Ocean Colour data (ready) –Ice parameters from SSMI, Cryosat (ready) –In situ observations: ARGO floats and XBT (ready) –Temperature brightness from SMOS (ready)

Assimilation methods Kalman filters: full Atlantic domain –Ensemble Kalman Filter (EnKF) –Singular Evolutive Extended Kalman Filter (SEEK) Optimal Interpolation: Nested models –Ensemble Optimal Interpolation (EnOI)

Grid size: from 20 to 40 km

SSH from assimilation and data

EnKF: local assimilation of SST

Perspectives EnKF: one generic assimilation scheme (global/local) Possibilities for specific schemes –using methodology from geostatistics –Estimation under constraints (conservation) –Estimation of transformed Gaussian variables (Anamorphosis)

Thus TOPAZ is Extension and utilization of DIADEM system Product and user oriented with strong link to off shore industry Contribution to GODAE and EuroGOOS task teams To be continued with Mersea IP EC-project. CUSTOMERS TOPAZ GODAE

Summary HYCOM model system completed and validated Assimilation capability for in situ and ice observations ready Development of forecasting capability for regional nested model (cf Winther & al.) Operational demonstration phase started on the web

Assimilating ice concentrations Assimilation of ice concentration controls the location of the ice edge Correlation changes sign dependent on season A fully multivariate approach is needed Largest impact along the ice edge

Ice concentration update

Temperature update

Assimilating TB data Brightness temperature TB will be available from SMOS (2006) Assimilation of TB data controls SSS and impacts SST TB (SST, SSS, Wind speed, Incidence, Azimuth, Polarization) Results are promising using the EnKF

TB data SST SSS TB

TB Assimilation SST impact SSS impact

Bibliography The Ensemble Kalman Filter: Theoretical Formulation and Practical Implementation, Geir Evensen, in print, Ocean Dynamics, About the anamorphosis: Sequential data assimilation techniques in oceanography, L. Bertino, G. Evensen, H. Wackernagel, (2003) International Statistical Review, (71), 1, pp

An Ensemble Kalman Filter for non-Gaussian variables L. Bertino 1, A. Hollard 2, G. Evensen 1, H. Wackernagel 2 1- NERSC, Norway 2- ENSMP - Centre de Géostatistique, France Work performed within the TOPAZ EC- project

Overview “Optimality” in Data Assimilation –Simple stochastic models, complex physical models → Difficulty: feeding models with estimates The anamorphosis: –Suggestion for an easier model-data interface Illustration –A simple ecological model

Data assimilation at the interface between statistics and physics State Observations stochastic model –f, h: linear operators –X, Y: Gaussian –Linear estimation optimal “optimality” for non-physical criteria => post-processing physical model –f, h: nonlinear –X, Y: not Gaussian –… sub-optimal

The multi-Gaussian model underlying in linear estimation methods state variables and assimilated data between all variables and all locations Gaussian histogram s Linear relations The world does not need to look like this...

Why Monte Carlo sampling? Non-linear estimation: no direct method –The mean does not commute with nonlinear functions: E(f(X))  f(E(X)) With random sampling A={X 1, … X 100 } E(f(X))  1/100  i f(X i ) EnKF: Monte-Carlo in propagation step Present work: Monte-Carlo in analysis step

The EnKF Monte-Carlo in model propagation Advantage 1: a general tool –No model linearization –Valid for a large class of nonlinear physical models –Models evaluated via the choice of model errors. Advantage 2: practical to implement –Short portable code, separate from the model code –Perturb the states in a physically understandable way –Little engineering: results easy to interpret Inconvenient: CPU-hungry

Ensemble Kalman filter basic algorithm (details in Evensen 2003) State Observations nonlinear propagation, linear analysis A a n = f(A a n-1 ) + K n (Y n - HA f n ) A a n = A f n. X 5 Notations: Ensemble A = {X 1, X 2,… X 100 }, A’ = A - Ā Kalman gain: K n = A n f A’ f n T H T. ( H A’ f n A’ f n T H T + R ) - 1

Anamorphosis A classical tool from geostatistics More adequate for linear estimation and simulations Physical variable Cumulative density function Statistical variable Example: phytoplankton in-situ concentrations

Anamorphosis in sequential DA separate the physics from statistics Physical operations: Anamorphosis function Statistical operation: A and Y transformed Forecast A f n = f (A a n-1 ) Forecast A f n+1 = f (A a n ) Analysis A a n = A f n + K n (Y n -HA f n ) Adjusted every time or once for all Polynomial fit, distribution tails by hand

The anamorphosis Monte-Carlo in statistical analysis Advantage 1: a general tool –Valid for a larger class of variables and data –Applicable in any sequential DA (OI, EKF …) –Further use: probability of a risk variable Advantage 2: practical implementation –No truncation of unrealistic/negative values (no gravity waves?) –No additional CPU cost –Simple to implement Inconvenient: handle with care!

Characteristics Sensitive to initial conditions Non-linear dynamics Nutrients PhytoplanktonHerbivores Illustration Idealised case: 1-D ecological model Spring bloom model, yearly cycles in the ocean Evans & Parslow (1985), Eknes & Evensen (2002) time-depths plots

Anamorphosis (logarithmic transform) Original histograms asymmetric Histograms of logarithms less asymmetric NPH Arbitrary choice, possible refinements (polynomial fit)

EnKF assimilation results Gaussian assumption –Truncated H < 0 –Low H values overestimated –“False starts” Lognormal assumption –Only positive values –Errors dependent on values RMS errors GaussianLognormal N P H

Conclusions An “Optimal estimate” is not an absolute concept –“Optimality” refers to a given stochastic model –Monte-Carlo methods for complex stochastic models The anamorphosis and linear estimation –Handles a more general class of variables –Applications in marine ecology (positive variables) Can be used with OI, EKF and EnKF. Next: combination of EnKF with SIR …