Nonstationary covariance structures II NRCSE. Drawbacks with deformation approach Oversmoothing of large areas Local deformations not local part of global.

Slides:



Advertisements
Similar presentations
Spatial modelling an introduction
Advertisements

Spatial point patterns and Geostatistics an introduction
Spatial point patterns and Geostatistics an introduction
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Periodograms Bartlett Windows Data Windowing Blackman-Tukey Resources:
Lecture 6 (chapter 5) Revised on 2/22/2008. Parametric Models for Covariance Structure We consider the General Linear Model for correlated data, but assume.
STAT 497 APPLIED TIME SERIES ANALYSIS
Spectral analysis for point processes. Error bars. Bijan Pesaran Center for Neural Science New York University.
University of Wisconsin-Milwaukee Geographic Information Science Geography 625 Intermediate Geographic Information Science Instructor: Changshan Wu Department.
Gaussian process emulation of multiple outputs Tony O’Hagan, MUCM, Sheffield.
Spectral analysis Kenneth D. Harris 18/2/15. Continuous processes A continuous process defines a probability distribution over the space of possible signals.
Meet the professor Friday, January 23 at SFU 4:30 Beer and snacks reception.
The Fourier transform. Properties of Fourier transforms Convolution Scaling Translation.
Using wavelet tools to estimate and assess trends in atmospheric data Peter Guttorp University of Washington NRCSE.
Applied Geostatistics
Statistics, data, and deterministic models NRCSE.
Continuity and covariance Recall that for stationary processes so if C is continuous then Z is mean square continuous. To get results about sample paths.
Modelling non-stationarity in space and time for air quality data Peter Guttorp University of Washington NRCSE.
Deterministic Solutions Geostatistical Solutions
Bayesian kriging Instead of estimating the parameters, we put a prior distribution on them, and update the distribution using the data. Model: Matrix with.
Nonstationary covariance structures II NRCSE. Drawbacks with deformation approach Oversmoothing of large areas Local deformations not local part of global.
Global processes Problems such as global warming require modeling of processes that take place on the globe (an oriented sphere). Optimal prediction of.
Space-time processes NRCSE. Separability Separable covariance structure: Cov(Z(x,t),Z(y,s))=C S (x,y)C T (s,t) Nonseparable alternatives Temporally varying.
Bayesian kriging Instead of estimating the parameters, we put a prior distribution on them, and update the distribution using the data. Model: Prior: Posterior:
STAT 592A(UW) 526 (UBC-V) 890-4(SFU) Spatial Statistical Methods NRCSE.
Space-time Modelling Using Differential Equations Alan E. Gelfand, ISDS, Duke University (with J. Duan and G. Puggioni)
Introduction Statistical options tend to be limited in most GIS applications. This is likely to be redressed in the future. We will look at spatial statistics.
Spatial Statistics III Stat 518 Sp08. Bayesian kriging Instead of estimating the parameters, we put a prior distribution on them, and update the distribution.
Stat 592A Spatial Statistical Methods NRCSE.
Statistical Tools for Environmental Problems NRCSE.
Groundwater permeability Easy to solve the forward problem: flow of groundwater given permeability of aquifer Inverse problem: determine permeability from.
(1) A probability model respecting those covariance observations: Gaussian Maximum entropy probability distribution for a given covariance observation.
Review of Probability.
EE513 Audio Signals and Systems Statistical Pattern Classification Kevin D. Donohue Electrical and Computer Engineering University of Kentucky.
Binary Variables (1) Coin flipping: heads=1, tails=0 Bernoulli Distribution.
The horseshoe estimator for sparse signals CARLOS M. CARVALHO NICHOLAS G. POLSON JAMES G. SCOTT Biometrika (2010) Presented by Eric Wang 10/14/2010.
Time Series Analysis.
STAT 497 LECTURE NOTES 2.
The Poisson Process. A stochastic process { N ( t ), t ≥ 0} is said to be a counting process if N ( t ) represents the total number of “events” that occur.
Removal of Artifacts T , Biomedical Image Analysis Seminar presentation Hannu Laaksonen Vibhor Kumar.
WAVELET TRANSFORM.
Regional climate prediction comparisons via statistical upscaling and downscaling Peter Guttorp University of Washington Norwegian Computing Center
Estimation of the spectral density function. The spectral density function, f( ) The spectral density function, f(x), is a symmetric function defined.
The Dirichlet Labeling Process for Functional Data Analysis XuanLong Nguyen & Alan E. Gelfand Duke University Machine Learning Group Presented by Lu Ren.
Elements of Stochastic Processes Lecture II
Digtial Image Processing, Spring ECES 682 Digital Image Processing Week 5 Oleh Tretiak ECE Department Drexel University.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: ML and Simple Regression Bias of the ML Estimate Variance of the ML Estimate.
Week 21 Stochastic Process - Introduction Stochastic processes are processes that proceed randomly in time. Rather than consider fixed random variables.
8-1 Chapter 8: Image Restoration Image enhancement: Overlook degradation processes, deal with images intuitively Image restoration: Known degradation processes;
Review of Random Process Theory CWR 6536 Stochastic Subsurface Hydrology.
Semivariogram Analysis and Estimation Tanya, Nick Caroline.
EE 5345 Multiple Random Variables
Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering National Taiwan University 1/90 GEOSTATISTICS VARIOGRAM.
Short course on space-time modeling Instructors: Peter Guttorp Johan Lindström Paul Sampson.
Statistical Analysis An Introduction to MRI Physics and Analysis Michael Jay Schillaci, PhD Monday, April 7 th, 2007.
ECE-7000: Nonlinear Dynamical Systems 2. Linear tools and general considerations 2.1 Stationarity and sampling - In principle, the more a scientific measurement.
Maximum likelihood estimators Example: Random data X i drawn from a Poisson distribution with unknown  We want to determine  For any assumed value of.
Spatial Point Processes Eric Feigelson Institut d’Astrophysique April 2014.
Space-time processes NRCSE. Separability Separable covariance structure: Cov(Z(x,t),Z(y,s))=C S (x,y)C T (s,t) Nonseparable alternatives Temporally varying.
Exposure Prediction and Measurement Error in Air Pollution and Health Studies Lianne Sheppard Adam A. Szpiro, Sun-Young Kim University of Washington CMAS.
Chapter 6 Random Processes
Charles University Charles University STAKAN III
Review of Probability Theory
Tatiana Varatnitskaya Belаrussian State University, Minsk
Ch3: Model Building through Regression
Ch9 Random Function Models (II)
NRCSE 2. Covariances.
Nonstationary covariance structures II
Paul D. Sampson Peter Guttorp
A Tutorial on Bayesian Speech Feature Enhancement
Chapter 6 Random Processes
Presentation transcript:

Nonstationary covariance structures II NRCSE

Drawbacks with deformation approach Oversmoothing of large areas Local deformations not local part of global fits Covariance shape does not change over space Limited class of nonstationary covariances

Nonstationary spatial covariance: Basic idea: the parameters of a local variogram model–-nugget, range, sill, and anisotropy–vary spatially. Consider some pictures of applications from recent methodology publications.

Major approaches: Haas, 1990, Moving window kriging Kim, Mallock & Holmes, 2005, Piecewise Gaussian modeling Nott & Dunsmuir, 2002, Biometrika, Average of locally stationary processes Fuentes, 2002, Kernel averaging of orthogonal, locally stationary processes. Pintore & Holmes, 2005, Fourier and Karhunen-Loeve expansions Higdon & Swall, 1998, 2000, Gaussian moving averages or “process convolution” model Nychka, Wikle & Royle, Wavelet expansion.

Kim, Mallock & Holmes, JASA 2005 Piecewise Gaussian model for groundwater permeability data

Fig. 2. Sydney wind pattern data. Contours of equal estimated correlation with two different fixed sites, shown by open squares: (a) location 33·85°S, 151·22°E, and (b) location 33·74°S, 149·88°E. The sites marked by dots show locations of the 45 monitored sites. Nott & Dunsmuire, 2002, Biometrika.

Pintore & Holmes: Spatially adaptive non-stationary covariance functions via spatially adaptive spectra

Thetford revisited Features depend on spatial location

Kernel averaging Fuentes (2000): Introduce uncorrelated stationary processes Z k (s), k=1,...,K, defined on disjoint subregions S k and construct where w k (s) is a weight function related to dist(s,S k ). Then

Spectral version so where Hence

Estimating spectrum Asymptotically

Details K = 9; h = 687 km Mixture of Matérn spectra

An example Models-3 output, 81x87 grid, 36km x 36km. Hourly averaged nitric acid concentration week of

Models-3 fit

A spectral approach to nonstationary processes Spectral representation:  s slowly varying square integrable, Y uncorrelated increments Hence is the space- varying spectral density Observe at grid; use FFT to estimate in nbd of s

Testing for nonstationarity U(s,w) = log has approximately mean f(s,  ) = log f s (  ) and constant variance in s and . Taking s 1,...,s n and  1,...,  m sufficently well separated, we have approximately U ij = U(s i,  j ) = f ij +  ij with the  ij iid. We can test for interaction between location and frequency (nonstationarity) using ANOVA.

Details The general model has The hypothesis of no interaction (  ij =0) corresponds to additivity on log scale: (uniformly modulated process: Z 0 stationary) Stationarity corresponds to Tests based on approx  2 -distribution (known variance)

Models-3 revisited Sourcedfsum of squares 22 Between spatial points Between frequencies Interaction Total

Moving averages A simple way of constructing stationary sequences is to average an iid sequence. A continuous time counterpart is, where  is a random measure which is stationary and assigns independent random variables to disjoint sets, i.e., has stationary and independent increments.

Lévy-Khinchine is the Lévy measure, and  t is the Lévy process. We can construct it from a Poisson measure H(du,ds) on R 2 with intensity E(H(du,ds))= (du)ds and a standard Brownian motion B t as

Examples Brownian motion with drift:  t ~N(  t,  2 t) (du)=0. Poisson process:  t ~Po( t)  =  2 =0, (du)=  {1} (du) Gamma process:  t ~  (  t,  )  =  2 =0, (du)=  e -  u 1(u>0)du/u Cauchy process:  =  2 =0, (du)=  u -2 du/ 

Spatial moving averages We can replace R for t with R 2 (or a general metric space) We can replace R for s with R 2 (or a general metric space) We can replace b(t-s) by b t (s) to relax stationarity We can let the intensity measure for H be an arbitrary measure (ds,du)

Gaussian moving averages Higdon (1998), Swall (2000): Let  be a Brownian motion without drift, and. This is a Gaussian process with correlation Account for nonstationarity by letting the kernel b vary with location:

Details yields an explicit covariance function which is squared exponential with parameter changing with spatial location. The prior distribution describes “local ellipses,” i.e., smoothly changing random kernels.

Local ellipses Foci

Prior parametrization Foci chosen independently Gaussian with isotropic squared exponential covariance Another parameter describes the range of influence of a given ellipse. Prior gamma.

Example Piazza Road Superfund cleanup. Dioxin applied to road seeped into groundwater.

Posterior distribution