Some remarks about Lab 1. image(parana.krige,val=sqrt(parana.kri ge$krige.var)) contour(parana.krige,loc=loci,add=T)

Slides:



Advertisements
Similar presentations
Pattern Recognition and Machine Learning
Advertisements

Spatial point patterns and Geostatistics an introduction
Spatial point patterns and Geostatistics an introduction
Computational Statistics. Basic ideas  Predict values that are hard to measure irl, by using co-variables (other properties from the same measurement.
Colorado Center for Astrodynamics Research The University of Colorado ASEN 5070 OD Accuracy Assessment OD Overlap Example Effects of eliminating parameters.
Pattern Recognition and Machine Learning
Kriging.
Data Modeling and Parameter Estimation Nov 9, 2005 PSCI 702.
Cost of surrogates In linear regression, the process of fitting involves solving a set of linear equations once. For moving least squares, we need to.
Prediction, Correlation, and Lack of Fit in Regression (§11. 4, 11
Smoothing 3D Meshes using Markov Random Fields
1 Def: Let and be random variables of the discrete type with the joint p.m.f. on the space S. (1) is called the mean of (2) is called the variance of (3)
Meet the professor Friday, January 23 at SFU 4:30 Beer and snacks reception.
Error Propagation. Uncertainty Uncertainty reflects the knowledge that a measured value is related to the mean. Probable error is the range from the mean.
1 Chapter 3 Multiple Linear Regression Ray-Bing Chen Institute of Statistics National University of Kaohsiung.
AGC DSP AGC DSP Professor A G Constantinides© Estimation Theory We seek to determine from a set of data, a set of parameters such that their values would.
Nonstationary covariance structure I: Deformations.
FOUR METHODS OF ESTIMATING PM 2.5 ANNUAL AVERAGES Yan Liu and Amy Nail Department of Statistics North Carolina State University EPA Office of Air Quality,
Spatial Statistics IV Stat 518 Sp08. Recall Method of moments: square of all pairwise differences, smoothed over lag bins Problems: Not necessarily a.
Applied Geostatistics
Statistics, data, and deterministic models NRCSE.
Continuity and covariance Recall that for stationary processes so if C is continuous then Z is mean square continuous. To get results about sample paths.
Variograms/Covariances and their estimation
Modelling non-stationarity in space and time for air quality data Peter Guttorp University of Washington NRCSE.
Arizona State University DMML Kernel Methods – Gaussian Processes Presented by Shankar Bhargav.
Experimental System for Predicting Shelf-Slope Optics (ESPreSSO): Assimilating ocean color data using an iterative ensemble smoother: skill assessment.
Global processes Problems such as global warming require modeling of processes that take place on the globe (an oriented sphere). Optimal prediction of.
Bayesian kriging Instead of estimating the parameters, we put a prior distribution on them, and update the distribution using the data. Model: Prior: Posterior:
STAT 592A(UW) 526 (UBC-V) 890-4(SFU) Spatial Statistical Methods NRCSE.
Spatial Statistics III Stat 518 Sp08. Bayesian kriging Instead of estimating the parameters, we put a prior distribution on them, and update the distribution.
Empirical Financial Economics 2. The Efficient Markets Hypothesis - Generalized Method of Moments Stephen Brown NYU Stern School of Business UNSW PhD Seminar,
Stat 592A Spatial Statistical Methods NRCSE.
Statistical Tools for Environmental Problems NRCSE.
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
Regression and Correlation Methods Judy Zhong Ph.D.
Modeling Your Spiking Data with Generalized Linear Models.
The Triangle of Statistical Inference: Likelihoood
Least-Mean-Square Training of Cluster-Weighted-Modeling National Taiwan University Department of Computer Science and Information Engineering.
Theory of Probability Statistics for Business and Economics.
Random Regressors and Moment Based Estimation Prepared by Vera Tabakova, East Carolina University.
1 Advances in the Construction of Efficient Stated Choice Experimental Designs John Rose 1 Michiel Bliemer 1,2 1 The University of Sydney, Australia 2.
Dataset Development within the Surface Processes Group David I. Berry and Elizabeth C. Kent.
Ch 2. Probability Distributions (1/2) Pattern Recognition and Machine Learning, C. M. Bishop, Summarized by Yung-Kyun Noh and Joo-kyung Kim Biointelligence.
Fast Simulators for Assessment and Propagation of Model Uncertainty* Jim Berger, M.J. Bayarri, German Molina June 20, 2001 SAMO 2001, Madrid *Project of.
Multiple Regression Petter Mostad Review: Simple linear regression We define a model where are independent (normally distributed) with equal.
1 Motivation Motivation SST analysis products at NCDC SST analysis products at NCDC  Extended Reconstruction SST (ERSST) v.3b  Daily Optimum Interpolation.
- 1 - Bayesian inference of binomial problem Estimating a probability from binomial data –Objective is to estimate unknown proportion (or probability of.
Modern Navigation Thomas Herring MW 11:00-12:30 Room
Week 21 Stochastic Process - Introduction Stochastic processes are processes that proceed randomly in time. Rather than consider fixed random variables.
Semivariogram Analysis and Estimation Tanya, Nick Caroline.
Problem: 1) Show that is a set of sufficient statistics 2) Being location and scale parameters, take as (improper) prior and show that inferences on ……
Short course on space-time modeling Instructors: Peter Guttorp Johan Lindström Paul Sampson.
Of what use is a statistician in climate modeling? Peter Guttorp University of Washington Norwegian Computing Center
1 Information Content Tristan L’Ecuyer. 2 Degrees of Freedom Using the expression for the state vector that minimizes the cost function it is relatively.
Ch 2. Probability Distributions (1/2) Pattern Recognition and Machine Learning, C. M. Bishop, Summarized by Joo-kyung Kim Biointelligence Laboratory,
Single Season Study Design. 2 Points for consideration Don’t forget; why, what and how. A well designed study will:  highlight gaps in current knowledge.
Exposure Prediction and Measurement Error in Air Pollution and Health Studies Lianne Sheppard Adam A. Szpiro, Sun-Young Kim University of Washington CMAS.
CWR 6536 Stochastic Subsurface Hydrology Optimal Estimation of Hydrologic Parameters.
Biointelligence Laboratory, Seoul National University
Probability Theory and Parameter Estimation I
Parameter Estimation and Fitting to Data
NRCSE 2. Covariances.
Alan Qi Thomas P. Minka Rosalind W. Picard Zoubin Ghahramani
Special Topics In Scientific Computing
Inference for Geostatistical Data: Kriging for Spatial Interpolation
Mean and Fluctuating Quantities
Paul D. Sampson Peter Guttorp
10701 / Machine Learning Today: - Cross validation,
Pattern Recognition and Machine Learning Chapter 2: Probability Distributions July chonbuk national university.
Concepts and Applications of Kriging
Presentation transcript:

Some remarks about Lab 1

image(parana.krige,val=sqrt(parana.kri ge$krige.var)) contour(parana.krige,loc=loci,add=T)

Dist 22 22  meth line Gau e3315ols Gau436.8 e3232rob Gau e3250wlsc Cir6.3 e57 e4wlsc Exp e64 e5wlsc

likfit(parana,nugget=470,cov.model="gaussian ",ini.cov.pars=c(5000,250)) kappa not used for the gaussian correlation function likfit: likelihood maximisation using the function optim. likfit: estimated model parameters: beta tausq sigmasq phi " 260.6" " 521.1" "6868.9" " 336.2" Practical Range with cor=0.05 for asymptotic range: likfit: maximised log-likelihood =

Nonstationary variance Let  (x) be a Gaussian process with constant mean , constant variance , and correlation. f is the same deformation as for the covariance modelling. Define the variance process Its distribution at gauged sites is

Moments of the variance process Mean: Variance: Covariance: Correlation:

Priors  ~ N( ,  ) The full conditional distributions are then of the same form (Gibbs sampler). To set the hyperparameters we use an empirical approach: Let S ii be the sample variance at site i.

Method of moments Setting the sample moments (over the sites) equal to the theoretical moments we get and let that be the prior mean. The prior variance is set appropriately diffuse.

French precipitation Constant varianceNonconstant variance

Prediction vs estimation Leave out 8 stations, use remaining 31 for estimation Compute predictive distribution for the 8 stations Plot observed variances (incl. nugget) vs. estimated variances and against predictive distribution

Estimated variance field

Global processes Problems such as global warming require modeling of processes that take place on the globe (an oriented sphere). Optimal prediction of quantities such as global mean temperature need models for global covariances. Note: spherical covariances can take values in [-1,1]–not just imbedded in R 3. Also, stationarity and isotropy are identical concepts on the sphere.

Isotropic covariances on the sphere Isotropic covariances on a sphere are of the form where p and q are directions,  pq the angle between them, and P i the Legendre polynomials:

Some examples Let a i =  i, o≤  <1. Then Let a i =(2i+1)  i. Then Given C(p,q)

Global temperature Global Historical Climatology Network 7280 stations with at least 10 years of data. Subset with 839 stations with data selected.

Isotropic correlations

Spherical deformation Need isotropic covariance model on transformation of sphere/globe Covariance structure on convex manifolds Simple option: deform globe into another globe Alternative: MRF approach

A class of global transformations Deformation of sphere g=(g 1,g 2 ) latitude def longitude def Avoid crossing of latitudes or longitudes Poles are fixed points Equator can be fixed as well

Simple latitude deformation knot Iterated simple deformations

Two-dimensional deformation Let b and  depend on longitude  Alternating deform longitude and latitude. locationscaleamplitude

Three iterations

Resulting isocovariance curves

Comparison IsotropicAnisotropic

Assessing uncertainty

Another current climate problem General circulation models require accurate historical ocean surface temperature recordsocean surface temperature Data from buoys, ships, satellites