Dynamical Climate Reconstruction Greg Hakim University of Washington Sebastien Dirren, Helga Huntley, Angie Pendergrass David Battisti, Gerard Roe.

Slides:



Advertisements
Similar presentations
Introduction to Data Assimilation NCEO Data-assimilation training days 5-7 July 2010 Peter Jan van Leeuwen Data Assimilation Research Center (DARC) University.
Advertisements

OSE meeting GODAE, Toulouse 4-5 June 2009 Interest of assimilating future Sea Surface Salinity measurements.
Use of Kalman filters in time and frequency analysis John Davis 1st May 2011.
Initialization Issues of Coupled Ocean-atmosphere Prediction System Climate and Environment System Research Center Seoul National University, Korea In-Sik.
Targetting and Assimilation: a dynamically consistent approach Anna Trevisan, Alberto Carrassi and Francesco Uboldi ISAC-CNR Bologna, Italy, Dept. of Physics.
Operational Forecasting and Sensitivity-Based Data Assimilation Tools Dr. Brian Ancell Texas Tech Atmospheric Sciences.
Design and Validation of Observing System Simulation Experiments (OSSEs) Ronald Errico Goddard Earth Sciences Technology and Research Center at Morgan.
Observers and Kalman Filters
W. McNair Bostick, Oumarou Badini, James W. Jones, Russell S. Yost, Claudio O. Stockle, and Amadou Kodio Ensemble Kalman Filter Estimation of Soil Carbon.
State space model of precipitation rate (Tamre Cardoso, PhD UW 2004) Updating wave height forecasts using satellite data (Anders Malmberg, PhD U. Lund.
Ibrahim Hoteit KAUST, CSIM, May 2010 Should we be using Data Assimilation to Combine Seismic Imaging and Reservoir Modeling? Earth Sciences and Engineering.
Toward a Real Time Mesoscale Ensemble Kalman Filter Gregory J. Hakim Dept. of Atmospheric Sciences, University of Washington Collaborators: Ryan Torn (UW)
Performance Characteristics of a Pseudo-operational Ensemble Kalman Filter April 2006, EnKF Wildflower Meeting Greg Hakim & Ryan Torn University of Washington.
Probabilistic Mesoscale Analyses & Forecasts Progress & Ideas Greg Hakim University of Washington Brian Ancell, Bonnie.
Brian Ancell, Cliff Mass, Gregory J. Hakim University of Washington
Advanced data assimilation methods- EKF and EnKF Hong Li and Eugenia Kalnay University of Maryland July 2006.
Estimation and the Kalman Filter David Johnson. The Mean of a Discrete Distribution “I have more legs than average”
UNBIASED ESTIAMTION OF ANALYSIS AND FORECAST ERROR VARIANCES
Background In deriving basic understanding of atmospheric phenomena, the analysis often revolves around discovering and exploiting relationships between.
A comparison of hybrid ensemble transform Kalman filter(ETKF)-3DVAR and ensemble square root filter (EnSRF) analysis schemes Xuguang Wang NOAA/ESRL/PSD,
A Regression Model for Ensemble Forecasts David Unger Climate Prediction Center.
RLSELE Adaptive Signal Processing 1 Recursive Least-Squares (RLS) Adaptive Filters.
Paleoclimatology Why is it important? Angela Colbert Climate Modeling Group October 24, 2011.
Ensemble-variational sea ice data assimilation Anna Shlyaeva, Mark Buehner, Alain Caya, Data Assimilation and Satellite Meteorology Research Jean-Francois.
Kalman filtering techniques for parameter estimation Jared Barber Department of Mathematics, University of Pittsburgh Work with Ivan Yotov and Mark Tronzo.
Ensemble Data Assimilation and Uncertainty Quantification Jeffrey Anderson, Alicia Karspeck, Tim Hoar, Nancy Collins, Kevin Raeder, Steve Yeager National.
EnKF Overview and Theory
Observing Strategy and Observation Targeting for Tropical Cyclones Using Ensemble-Based Sensitivity Analysis and Data Assimilation Chen, Deng-Shun 3 Dec,
1 ESTIMATING THE STATE OF LARGE SPATIOTEMPORALLY CHAOTIC SYSTEMS: WEATHER FORECASTING, ETC. Edward Ott University of Maryland Main Reference: E. OTT, B.
Streamflow Predictability Tom Hopson. Conduct Idealized Predictability Experiments Document relative importance of uncertainties in basin initial conditions.
Gridding Daily Climate Variables for use in ENSEMBLES Malcolm Haylock, Climatic Research Unit Nynke Hofstra, Mark New, Phil Jones.
CSDA Conference, Limassol, 2005 University of Medicine and Pharmacy “Gr. T. Popa” Iasi Department of Mathematics and Informatics Gabriel Dimitriu University.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High-resolution data assimilation in COSMO: Status and.
Assimilation of HF Radar Data into Coastal Wave Models NERC-funded PhD work also supervised by Clive W Anderson (University of Sheffield) Judith Wolf (Proudman.
Potential benefits from data assimilation of carbon observations for modellers and observers - prerequisites and current state J. Segschneider, Max-Planck-Institute.
Data assimilation and observing systems strategies Pierre Gauthier Data Assimilation and Satellite Meteorology Division Meteorological Service of Canada.
In collaboration with: J. S. Allen, G. D. Egbert, R. N. Miller and COAST investigators P. M. Kosro, M. D. Levine, T. Boyd, J. A. Barth, J. Moum, et al.
Improved ensemble-mean forecast skills of ENSO events by a zero-mean stochastic model-error model of an intermediate coupled model Jiang Zhu and Fei Zheng.
Vaisala/University of Washington Real-observation Experiments Vaisala/University of Washington Real-observation Experiments Clifford Mass, Gregory Hakim,
Applications of Neural Networks in Time-Series Analysis Adam Maus Computer Science Department Mentor: Doctor Sprott Physics Department.
Assimilating chemical compound with a regional chemical model Chu-Chun Chang 1, Shu-Chih Yang 1, Mao-Chang Liang 2, ShuWei Hsu 1, Yu-Heng Tseng 3 and Ji-Sung.
Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005.
Research Vignette: The TransCom3 Time-Dependent Global CO 2 Flux Inversion … and More David F. Baker NCAR 12 July 2007 David F. Baker NCAR 12 July 2007.
2nd GODAE Observing System Evaluation Workshop - June Ocean state estimates from the observations Contributions and complementarities of Argo,
Coupled Atmosphere-Ocean Assimilation Climate System Exploring Coupled Atmosphere-Ocean Data Assimilation Strategies with an EnKF and a Low-Order Analogue.
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
What Uncertainties Exist in Tropical SST Reconstructions Derived From Tropical Precipitation Records? Jason C. Furtado Advisor: E. Di Lorenzo School of.
Local Predictability of the Performance of an Ensemble Forecast System Liz Satterfield and Istvan Szunyogh Texas A&M University, College Station, TX Third.
Assimilating stats – the problem and experience with the DATUN approach Hans von Storch and Martin Widmann, Institute for Coastal Research, GKSS, Germany.
Joint OS & SWH meeting in support of Wide-Swath Altimetry Measurements Washington D.C. – October 30th, 2006 Baptiste MOURRE ICM – Barcelona (Spain) Pierre.
Prepared by Dusanka Zupanski and …… Maximum Likelihood Ensemble Filter: application to carbon problems.
Data assimilation applied to simple hydrodynamic cases in MATLAB
A Random Subgrouping Scheme for Ensemble Kalman Filters Yun Liu Dept. of Atmospheric and Oceanic Science, University of Maryland Atmospheric and oceanic.
Geogg124: Data assimilation P. Lewis. What is Data Assimilation? Optimal merging of models and data Models Expression of current understanding about process.
Pg 1 SAMSI UQ Workshop; Sep Ensemble Data Assimilation and Uncertainty Quantification Jeff Anderson National Center for Atmospheric Research.
The Unscented Kalman Filter for Nonlinear Estimation Young Ki Baik.
The application of ensemble Kalman filter in adaptive observation and information content estimation studies Junjie Liu and Eugenia Kalnay July 13th, 2007.
NOAA Northeast Regional Climate Center Dr. Lee Tryhorn NOAA Climate Literacy Workshop April 2010 NOAA Northeast Regional Climate.
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
ECMWF/EUMETSAT NWP-SAF Satellite data assimilation Training Course Mar 2016.
Carbon Cycle Data Assimilation with a Variational Approach (“4-D Var”) David Baker CGD/TSS with Scott Doney, Dave Schimel, Britt Stephens, and Roger Dargaville.
Jeffrey Anderson, NCAR Data Assimilation Research Section
STATISTICAL ORBIT DETERMINATION Kalman (sequential) filter
ASEN 5070: Statistical Orbit Determination I Fall 2014
Climate and Global Dynamics Laboratory, NCAR
FSOI adapted for used with 4D-EnVar
Waves, Information and Local Predictability
2. University of Northern British Columbia, Prince George, Canada
Hartmut Bösch and Sarah Dance
Sarah Dance DARC/University of Reading
Presentation transcript:

Dynamical Climate Reconstruction Greg Hakim University of Washington Sebastien Dirren, Helga Huntley, Angie Pendergrass David Battisti, Gerard Roe

Plan Motivation: fusing observations & models State estimation theory Results for a simple model Results for a less simple model Optimal networks Plans for the future

Motivation Range of approaches to climate reconstruction. Observations: –time-series analysis; multivariate regression –no link to dynamics Models –spatial and temporal consistency –no link to observations State estimation (this talk) –few attempts thus far –stationary statistics

Goals Test new method Reconstruct last 1-2K years –Unique dataset for climate variability? –E.g. hurricane variability. –E.g. rational regional downscaling (hydro). Test network design ideas –Where to take highest impact new obs?

Medieval warm period temperature anomalies IPCC Chapter 6

Climate variability: a qualitative approach North GRIP δ 18 O (temperature) GISP2 K + (Siberian High) Swedish tree line limit shift Sea surface temperature from planktonic foraminiferals hematite-stained grains in sediment cores (ice rafting) Varve thickness (westerlies) Cave speleotherm isotopes (precipitation) foraminifera Mayewski et al., 2004

Statistical reconstructions “Multivariate statistical calibration of multiproxy network” (Mann et al. 1998) Requires stationary spatial patterns of variability Mann et al. 1998

Paleoclimate modeling IPCC Chapter 6

An attempt at fusion Data Assimilation through Upscaling and Nudging (DATUN) Jones and Widmann 2003 Multivariate regression

Fusion Hierarchy Nudging: no error estimates Statistical interpolation 3DVAR 4DVAR Kalman filters Kalman smoothers fixed stats } } Today’s talk } oper NWP The curse of dimensionality looms large in geoscience

State Estimation Primer

Gaussian Update analysis = background + weighted observations new obs information Kalman gain matrix analysis error covariance ‘<’ background

Gaussian PDFs

Ensemble Kalman Filter Crux: use an ensemble of fully non-linear forecasts to model the statistics of the background (expected value and covariance matrix). Advantages No à priori assumption about covariance; state-dependent corrections. Ensemble forecasts proceed immediately without perturbations.

Summary of Ensemble Kalman Filter (EnKF) Algorithm (1)Ensemble forecast provides background estimate & statistics (B) for new analyses. (2)Ensemble analysis with new observations. (3) Ensemble forecast to arbitrary future time.

Paleo-assimilation dynamical climate reconstruction Observations often time-averaged. –e.g. gauge precip; wind; ice cores. Sparse networks. Issue: –How to combine averaged observations with instantaneous model states?

Issue with Traditional Approach Problem: Conventional Kalman filtering requires covariance relationships between time-averaged observations and instantaneous states. High-frequency noise in the instantaneous states contaminates the update. Solution: Only update the time-averaged state.

Algorithm 1. Time-averaged of background 2. Compute model-estimate of time-av obs 3. Perturbation from time mean 4. Update time-mean with existing EnKF 5. Add updated mean and unmodified perturbations 6. Propagate model states 7. Recycle with the new background states

Model (adapted from Lorenz & Emanuel (1998)): Linear combination of fast & slow processes Illustrative Example Dirren & Hakim (2005) “low-freq.” “high-freq.” - LE ~ a scalar discretized around a latitude circle. - LE has elements of atmos. dynamics: chaotic behavior, linear waves, damping, forcing

RMS instantaneous Instantaneous states have large errors (comparable to climatology) Due to lack of observational constraint (dashed : clim)

RMS all means Obs uncertaintyClimatology uncertainty Improvement Percentage of RMS errors Total state variable Constrains signal at higher freq.than the obs themselves! Averaging time of state variable

Potential Problems 1.Possible covariance contamination 2.Extra observation noise

A less simple model Helga Huntley (U. Delaware) QG “climate model” –Radiative relaxation to assumed temperature field –Mountain in center of domain Truth simulation –Rigorous error calculations –100 observations (50 surface & 50 tropopause) –Gaussian errors –Range of time averages

Snapshot

Correlation Patterns as a Function of averaging time (tau)

Observation Locations

Average Spatial RMS Error

Ensemble used for control

Implications State is well constrained by few, noisy, obs. Forecast error saturates at climatology for tau ~ 30. For longer averaging times, the model adds little.  Equally good results can be obtained by assimilating the observations with an ensemble drawn from climatology (no model runs required)!

Observation error Experiments

Changing  o (Observation Error) Previously: –  o = 0.27 for all . Now: –  o ≈  c /3 –(a third of control error).

Observing Network Design Helga Huntley (U. Delaware)

Optimal Observation Locations Rather than use random networks, can we devise a strategy to optimally site new observations? –Yes: choose locations with the largest impact on a metric of interest. –New theory based on ensemble sensitivity (Hakim & Torn 2005; Ancell & Hakim 2007; Torn and Hakim 2007) –Here, metric = projection coefficient for first EOF.

Ensemble Sensitivity Given metric J, find the observation that reduces uncertainy most (ensemble variance). Find a second observation conditional on first. Sketch of theory ( let x denote the state). –Analysis covariance –Changes in metric given changes in state + O(  x 2 ) –Metric variance

Sensitivity + State Estimation Estimate variance change for the i’th observation Kalman filter theory gives A i : where Given  at each point, find largest value.

Ensemble Sensitivity (cont’d) If H chooses a specific location x i, this all simplifies very nicely: –For the first observation: –For the second observation, given assimilation of the first observation: –Etc.

Ensemble Sensitivity (cont’d) In fact, with some more calculations, one can find a nice recursive formula, which requires the evaluation of just k+3 lines (1 covariance vector + (k+6) entry-wise mults/divs/adds/subs) for the k’th point.

Results for tau = 20 First EOF

Results for tau = 20 The ten most sensitive locations (without accounting for prior assimilations)  o = 0.10

Results for tau = 20 The four most sensitive locations, accounting for previously found pts.

Results for tau = 20;  o = 0.10 Note the decreasing effect on the variance.

Control Case: No Assimilation Avg error =

100 Random Observation Locations Avg Error - Anal = Fcst =

4 Random Observation Locations Avg Error - Anal = Fcst =

4 Optimal Observation Locations Avg Error - Anal = Fcst =

Summary Avg Error FcstAnal Control obs chosen random random random Assimilating just the 4 chosen locations yields a significant portion of the gain in error reduction in J achieved with 100 obs. Percent of ctr error

Experiment: 15 Chosen Observations For this experiment, take –4 best obs to reduce variability in 1st EOF –4 best obs to reduce variability in 2nd EOF –2 best obs to reduce variability in 3rd EOF –2best obs to reduce variability in 4th EOF –3 best obs to reduce variability in 5th EOF The cut-off for each EOF was chosen as the observation with. All obs conditioal on assimilation of previous obs.

15 Obs: Error in 1st EOF Coeff EOF1Control100R4R4O8O15 total Fcst Anal

15 Obs: Error in 2nd EOF Coeff EOF2Control100R4R4O8O15 total Fcst Anal

15 Observations: RMS Error RMSControl100 R4 R4 O8 O15 O Fcst Anal

Current & Future Plans Angie Pendergrass (UW) modeling on the sphere: SPEEDY – simplified physics – slab ocean simulated precipitation observations ice-core assimilation – annual accumulation – oxygen isotopes

Summary State estimation = fusion of obs & models –Lower errors than obs and model. –Provides best estimate & error estimate Idealized experiments: proof of concept –Averaged obs constrain state estimates. –Optimal observing networks Moving toward real observations –Opportunity for regional downscaling.