Using wavelet tools to estimate and assess trends in atmospheric data Peter Guttorp University of Washington NRCSE.

Slides:



Advertisements
Similar presentations
Noise & Data Reduction. Paired Sample t Test Data Transformation - Overview From Covariance Matrix to PCA and Dimension Reduction Fourier Analysis - Spectrum.
Advertisements

ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Periodograms Bartlett Windows Data Windowing Blackman-Tukey Resources:
University of Ioannina - Department of Computer Science Wavelets and Multiresolution Processing (Background) Christophoros Nikou Digital.
Signal Denoising with Wavelets. Wavelet Threholding Assume an additive model for a noisy signal, y=f+n K is the covariance of the noise Different options.
Characterizing Non- Gaussianities or How to tell a Dog from an Elephant Jesús Pando DePaul University.
Applications in Signal and Image Processing
1 LES of Turbulent Flows: Lecture 4 (ME EN ) Prof. Rob Stoll Department of Mechanical Engineering University of Utah Spring 2011.
Maximum Covariance Analysis Canonical Correlation Analysis.
The Global Digital Elevation Model (GTOPO30) of Great Basin Location: latitude 38  15’ to 42  N, longitude 118  30’ to 115  30’ W Grid size: 925 m.
STAT 497 APPLIED TIME SERIES ANALYSIS
Using wavelet tools to estimate and assess trends in atmospheric data Peter Guttorp University of Washington NRCSE.
Determination of Solar Cycle and Natural Climate Variation using both Surface Air/Soil Temperature and Thermal Diffusion Model Xiquan Dong (Atmospheric.
Climate modeling Current state of climate knowledge – What does the historical data (temperature, CO 2, etc) tell us – What are trends in the current observational.
Environmental Data Analysis with MatLab Lecture 17: Covariance and Autocorrelation.
Meet the professor Friday, January 23 at SFU 4:30 Beer and snacks reception.
Nonstationary covariance structures II NRCSE. Drawbacks with deformation approach Oversmoothing of large areas Local deformations not local part of global.
Texture Turk, 91.
Biomedical signal processing: Wavelets Yevhen Hlushchuk, 11 November 2004.
The Fourier transform. Properties of Fourier transforms Convolution Scaling Translation.
1 Using A Multiscale Approach to Characterize Workload Dynamics Characterize Workload Dynamics Tao Li June 4, 2005 Dept. of Electrical.
Multi-Resolution Analysis (MRA)
Introduction to Wavelets
Wavelet-based Coding And its application in JPEG2000 Monia Ghobadi CSC561 project
Nonstationary covariance structures II NRCSE. Drawbacks with deformation approach Oversmoothing of large areas Local deformations not local part of global.
Global processes Problems such as global warming require modeling of processes that take place on the globe (an oriented sphere). Optimal prediction of.
STAT 592A(UW) 526 (UBC-V) 890-4(SFU) Spatial Statistical Methods NRCSE.
Using wavelet tools to estimate and assess trends in atmospheric data NRCSE.
Introduction to Wavelets -part 2
Multiscale transforms : wavelets, ridgelets, curvelets, etc.
Statistical Tools for Environmental Problems NRCSE.
Correlation and spectral analysis Objective: –investigation of correlation structure of time series –identification of major harmonic components in time.
Groundwater permeability Easy to solve the forward problem: flow of groundwater given permeability of aquifer Inverse problem: determine permeability from.
R. Werner Solar Terrestrial Influences Institute - BAS Time Series Analysis by descriptive statistic.
Statistical Methods for long-range forecast By Syunji Takahashi Climate Prediction Division JMA.
Review of Probability.
ENG4BF3 Medical Image Processing
Lecture 7: Simulations.
Linking sea surface temperature, surface flux, and heat content in the North Atlantic: what can we learn about predictability? LuAnne Thompson School of.
10 IMSC, August 2007, Beijing Page 1 An assessment of global, regional and local record-breaking statistics in annual mean temperature Eduardo Zorita.
Surface and Boundary-Layer Fluxes during the DYNAMO Field Program C. Fairall, S. DeSzoeke, J. Edson, + Surface cloud radiative forcing (CF) Diurnal cycles.
1 LES of Turbulent Flows: Lecture 2 Supplement (ME EN ) Prof. Rob Stoll Department of Mechanical Engineering University of Utah Fall 2014.
Regional climate prediction comparisons via statistical upscaling and downscaling Peter Guttorp University of Washington Norwegian Computing Center
Yaomin Jin Design of Experiments Morris Method.
Basics of Neural Networks Neural Network Topologies.
Surface and Bulk Fluctuations of the Lennard-Jones Clusrers D. I. Zhukhovitskii.
LES of Turbulent Flows: Lecture 2 (ME EN )
Assimilation of HF radar in the Ligurian Sea Spatial and Temporal scale considerations L. Vandenbulcke, A. Barth, J.-M. Beckers GHER/AGO, Université de.
1 Using Wavelets for Recognition of Cognitive Pattern Primitives Dasu Aravind Feature Group PRISM/ASU 3DK – 3DK – September 21, 2000.
Corrective Dynamics for Atmospheric Single Column Models J. Bergman, P. Sardeshmukh, and C. Penland NOAA-CIRES Climate Diagnostics Center With special.
Wavelets and Multiresolution Processing (Wavelet Transforms)
Geo479/579: Geostatistics Ch4. Spatial Description.
2.There are two fundamentally different approaches to this problem. One can try to fit a theoretical distribution, such as a GEV or a GP distribution,
Convection in Flat Plate Boundary Layers P M V Subbarao Associate Professor Mechanical Engineering Department IIT Delhi A Universal Similarity Law ……
WCRP Extremes Workshop Sept 2010 Detecting human influence on extreme daily temperature at regional scales Photo: F. Zwiers (Long-tailed Jaeger)
ECE-7000: Nonlinear Dynamical Systems 2. Linear tools and general considerations 2.1 Stationarity and sampling - In principle, the more a scientific measurement.
Of what use is a statistician in climate modeling? Peter Guttorp University of Washington Norwegian Computing Center
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and  2 Now, we need procedures to calculate  and  2, themselves.
Chapter 13 Discrete Image Transforms
Space-time processes NRCSE. Separability Separable covariance structure: Cov(Z(x,t),Z(y,s))=C S (x,y)C T (s,t) Nonseparable alternatives Temporally varying.
CWR 6536 Stochastic Subsurface Hydrology Optimal Estimation of Hydrologic Parameters.
Biointelligence Laboratory, Seoul National University
Wavelet Transform Advanced Digital Signal Processing Lecture 12
Why Stochastic Hydrology ?
Yinghui Liu1, Jeff Key2, and Xuanji Wang1
Multi-resolution analysis
Filtering and State Estimation: Basic Concepts
Digital Image Processing Lecture 21: Principal Components for Description Prof. Charlene Tsai *Chapter 11.4 of Gonzalez.
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and 2 Now, we need procedures to calculate  and 2 , themselves.
Chapter 15: Wavelets (i) Fourier spectrum provides all the frequencies
Wavelet Analysis Objectives: To Review Fourier Transform and Analysis
Presentation transcript:

Using wavelet tools to estimate and assess trends in atmospheric data Peter Guttorp University of Washington NRCSE

Wavelets Fourier analysis uses big waves Wavelets are small waves

Requirements for wavelets Integrate to zero Square integrate to one Measure variation in local averages Describe how time series evolve in time for different scales (hour, year,...) or how images change from one place to the next on different scales (m 2, continents,...)

Continuous wavelets Consider a time series x(t). For a scale l and time t, look at the average How much do averages change over time?

Haar wavelet where

Translation and scaling

Continuous Wavelet Transform Haar CWT: Same for other wavelets where

Basic facts CWT is equivalent to x: CWT decomposes energy: energy

Discrete time Observe samples from x(t): x 0,x 1,...,x N-1 Discrete wavelet transform (DWT) slices through CWT restricted to dyadic scales  j = 2 j-1, j = 1,...,J t restricted to integers 0,1,...,N-1 Yields wavelet coefficients Think of as the rough of the series, so is the smooth (also called the scaling filter). A multiscale analysis shows the wavelet coefficients for each scale, and the smooth.

Properties Let W j = (W j,0,...,W j,N-1 ); S = (s 0,...,s N-1 ). Then W = (W 1,...,W J,S ) is the DWT of X = (x 0,...,x N-1 ). (1) We can recover X perfectly from its DWT W, X = W -1 W. (2) The energy in X is preserved in its DWT:

The pyramid scheme Recursive calculation of wavelet coefficients: {h l } wavelet filter of even length L; {g l = (-1) l h L-1-l } scaling filter Let S 0,t = x t for each t For j=1,...,J calculate t = 0,...,N 2 -j -1

Daubachie’s LA(8)-wavelet

Oxygen isotope in coral cores at Malindi, Kenya Cole et al. (Science, 2000): 194 yrs of monthly  18 O-values in coral core. Decreased oxygen corresponds to increased sea surface temperature Decadal variability related to monsoon activity

Multiscale analysis of coral data

Long term memory A process has long term memory if the autocorrelation decays very slowly with lag May still look stationary Example: Fractionally differenced Gaussian process, has parameter d related to spectral decay If |d| < 1/2 the process is stationary

Nile river annual minima

Annual northern hemisphere temperature anomalies

Decorrelation properties of wavelet transform Periodogram values are approximately uncorrelated at Fourier frequencies for stationary processes (but not for long memory processes) Wavelet coefficient at different scales are also approximately uncorrelated, even for long memory processes (approximation better for larger L)

Coral data correlation

What is a trend? “The essential idea of trend is that it shall be smooth” (Kendall,1973) Trend is due to non-stochastic mechanisms, typically modeled independently of the stochastic portion of the series: X t = T t + Y t

Wavelet analysis of trend where A is diagonal, picks out S and the boundary wavelet coefficients. Write where R= W T A W, so if X is Gaussian we have

Confidence band calculation Let v be the vector of sd’s of and. Then which we can make 1-  by choosing d by Monte Carlo (simulating the distribution of U). Note that this confidence band will be simultaneous, not pointwise.

Malindi trend

Air turbulence EPIC: East Pacific Investigation of Climate Processes in the Coupled Ocean-Atmosphere System Objectives: (1) To observe and understand the ocean-atmosphere processes involved in large-scale atmospheric heating gradients (2) To observe and understand the dynamical, radiative, and microphysical properties of the extensive boundary layer cloud decks

Flights Measure temperature, pressure, humidity, air flow in East Pacific

Flight pattern The airplane flies some high legs (1500 m) and some low legs (30 m). The transition between these (somewhat stationary) legs is of main interest in studying boundary layer turbulence.

Wavelet variability The variability at each scale constitutes an analysis of variance. One can clearly distinguish turbulent and non-turbulent regions.

Estimating nonstationary covariance using wavelets 2-dimensional wavelet basis obtained from two functions  and  : First generation scaled translates of all four; subsequent generations scaled translates of the detail functions. Subsequent generations on finer grids. detail functions

W-transform

Karhunen-Loeve expansion and where A i are iid N(0,1) Idea: use wavelet basis instead of eigenfunctions, allow for dependent A i

Covariance expansion For covariance matrix  write Useful if D close to diagonal. Enforce by thresholding off-diagonal elements (set all zero on finest scales)

Surface ozone model ROM, daily average ozone 48 x 48 grid of 26 km x 26 km centered on Illinois and Ohio. 79 days summer x3 coarsest level (correlation length is about 300 km) Decimate leading 12 x 12 block of D by 90%, retain only diagonal elements for remaining levels.

ROM covariance