Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 Surrogates and Kriging Part I: Kriging Ralf Lindau.

Slides:



Advertisements
Similar presentations
Spatial point patterns and Geostatistics an introduction
Advertisements

Multiple Regression and Model Building
Managerial Economics in a Global Economy
The Simple Regression Model
Kriging.
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
Basic geostatistics Austin Troy.
Spatial Interpolation
Deterministic Solutions Geostatistical Solutions
Diplomanden-Doktoranden-Seminar Bonn – 23 June 2008 LandCaRe 2020 Dynamical and Statistical Downscaling Ralf Lindau.
Diplomanden-Doktoranden-Seminar Bonn, now Cologne – 8 Januar 2007 CMSAF water vapour in comparison to radiosondes and CHAMP Ralf Lindau.
Curve-Fitting Regression
3. Jahrestreffen LandCaRe 2020, Tharandt – 30. November 2009 TP 2.3 Bonn Temporal downscaling of heavy precipitation Ralf Lindau.
Evaluating Hypotheses
Applied Geostatistics
Diplomanden-Doktoranden-Seminar Bonn – 18. Mai 2008 LandCaRe 2020 Temporal downscaling of heavy precipitation and some general thoughts about downscaling.
1 Simple Linear Regression Chapter Introduction In this chapter we examine the relationship among interval variables via a mathematical equation.
Deterministic Solutions Geostatistical Solutions
The Simple Regression Model
Ordinary Kriging Process in ArcGIS
7. Homogenization Seminar Budapest – October 2011 What is the correct number of break points hidden in a climate record? Ralf Lindau Victor Venema.
Geostatistics Mike Goodchild. Spatial interpolation n A field –variable is interval/ratio –z = f(x,y) –sampled at a set of points n How to estimate/guess.
FIN357 Li1 The Simple Regression Model y =  0 +  1 x + u.
Diplomanden-Doktoranden-Seminar Bonn – 18. Januar 2010 Kriging Connection between Stepwise Kriging and Data Construction and Stepwise Kriging of Victorian.
Applications in GIS (Kriging Interpolation)
Daily Stew Kickoff – 27. January 2011 First Results of the Daily Stew Project Ralf Lindau.
Method of Soil Analysis 1. 5 Geostatistics Introduction 1. 5
Introduction to Regression Analysis, Chapter 13,
Ordinary Least Squares
Constant process Separate signal & noise Smooth the data: Backward smoother: At any give T, replace the observation yt by a combination of observations.
1 Terminating Statistical Analysis By Dr. Jason Merrick.
Two and a half problems in homogenization of climate series concluding remarks to Daily Stew Ralf Lindau.
Geo479/579: Geostatistics Ch13. Block Kriging. Block Estimate  Requirements An estimate of the average value of a variable within a prescribed local.
Geo479/579: Geostatistics Ch17. Cokriging
Spatial Interpolation of monthly precipitation by Kriging method
Detection of inhomogeneities in Daily climate records to Study Trends in Extreme Weather Detection of Breaks in Random Data, in Data Containing True Breaks,
$88.65 $ $22.05/A profit increase Improving Wheat Profits Eakly, OK Irrigated, Behind Cotton.
Geo479/579: Geostatistics Ch12. Ordinary Kriging (1)
Gridding Daily Climate Variables for use in ENSEMBLES Malcolm Haylock, Climatic Research Unit Nynke Hofstra, Mark New, Phil Jones.
Explorations in Geostatistical Simulation Deven Barnett Spring 2010.
Geog. 579: GIS and Spatial Analysis - Lecture 21 Overheads 1 Point Estimation: 3. Methods: 3.6 Ordinary Kriging Topics: Lecture 23: Spatial Interpolation.
Geographic Information Science
Breaks in Daily Climate Records Ralf Lindau University of Bonn Germany.
GEOSTATISICAL ANALYSIS Course: Special Topics in Remote Sensing & GIS Mirza Muhammad Waqar Contact: EXT:2257.
MGS3100_04.ppt/Sep 29, 2015/Page 1 Georgia State University - Confidential MGS 3100 Business Analysis Regression Sep 29 and 30, 2015.
Spatial Interpolation III
Measures of Central Tendency: The Mean, Median, and Mode
9.3 and 9.4 The Spatial Model And Spatial Prediction and the Kriging Paradigm.
Spatial Analysis & Geostatistics Methods of Interpolation Linear interpolation using an equation to compute z at any point on a triangle.
On the reliability of using the maximum explained variance as criterion for optimum segmentations Ralf Lindau & Victor Venema University of Bonn Germany.
Additional Topics in Prediction Methodology. Introduction Predictive distribution for random variable Y 0 is meant to capture all the information about.
Geology 6600/7600 Signal Analysis 04 Nov 2015 © A.R. Lowry 2015 Last time(s): Discussed Becker et al. (in press):  Wavelength-dependent squared correlation.
Stochastic Hydrology Random Field Simulation Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.
Geostatistics GLY 560: GIS for Earth Scientists. 2/22/2016UB Geology GLY560: GIS Introduction Premise: One cannot obtain error-free estimates of unknowns.
Correction of spurious trends in climate series caused by inhomogeneities Ralf Lindau.
Geo479/579: Geostatistics Ch12. Ordinary Kriging (2)
CWR 6536 Stochastic Subsurface Hydrology
The joint influence of break and noise variance on break detection Ralf Lindau & Victor Venema University of Bonn Germany.
- 1 - Preliminaries Multivariate normal model (section 3.6, Gelman) –For a multi-parameter vector y, multivariate normal distribution is where  is covariance.
CWR 6536 Stochastic Subsurface Hydrology Optimal Estimation of Hydrologic Parameters.
Chapter 7. Classification and Prediction
Part 5 - Chapter
Part 5 - Chapter 17.
Break and Noise Variance
Inference for Geostatistical Data: Kriging for Spatial Interpolation
Adjustment of Temperature Trends In Landstations After Homogenization ATTILAH Uriah Heat Unavoidably Remaining Inaccuracies After Homogenization Heedfully.
Part 5 - Chapter 17.
Variance Variance: Standard deviation:
Stochastic Hydrology Random Field Simulation
Confidence intervals for the difference between two means: Independent samples Section 10.1.
Presentation transcript:

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 Surrogates and Kriging Part I: Kriging Ralf Lindau

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 Contents Stepwise Kriging (the future) Simple Kriging (the past) avoiding negative weights Victorian LWP Stefanian Permeability

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 Summary of Distingish between two types: 1. downscaling of averages (true downscaling) 2. downscaling of point measurements (interpolation) Example for average downscaling: Precipitation from 60 to 30 min Three methods for point downscaling: 1. Linear interpolation plus noise 2. Stepwise kriging 3. Stepwise spatio-temporal data construction

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 Stepwise Kriging The covariances of a new kriging point to all old observation points are correct by definition. However the explained variance is smaller than 1 (normalized case). This leads to an underestimation of the correlation. Thus: Do not use the kriging technique several times in series for all intermediate points. But: 1.Predict only a single point 2.Correct its variance by adding noise 3.Consider in the next step the predicted value as an old one.

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 Sequential vs Stepwise J.A. Vargas-Guzman, T.-C. Jim Yeh, 1999: Sequential kriging and cokriging: Two powerful geostatistical approaches Stochastic Environmental Research and Risk Assessment, 13, The sequential estimator is shown to produce the best, unbiased linear estimate, and to provide the same estimates and variances as classic simple kriging or cokriging with the simultaneous use of the entire data set. However, by using data sets sequentially, this new algorithm alleviates numerical difficulties associated with the classical kriging or cokriging techniques when a large amount of data are used. The expression Sequential Kriging means here: Decomposition of a huge matrix into several smaller matrices, which can be solved easier. The presented method of Stepwise Kriging means something else: Add the information and correct the variance stepwise, data point by data point.

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 Stepwise Kriging We proudly present: The algorithm is readily programmed and awaits eagerly to work.

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 So far the future. Now, the past: two examples for simple kriging. 1. Clouds (Victor) 2. Soil (Stefan) Most important difference to OK: No trend:no gradient, only (normalized) anomalies. No negative weights:dont panic, no more discussion about that.

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 Negative weights in literature Deutsch, C.V., 1996: Correcting for Negative Weights in Ordinary Kriging, Computers & Geociences, 22, (7), Negative weights in ordinary kriging (OK) arise when data close to the location being estimated screen outlying data. Depending on the variogram and the amount of screening, the negative weights can be significant; there is nothing in the OK algorithm that alerts the kriging system about the zero threshold for weights. Negative weights, when interpreted as probabilities for constructing a local conditional distribution, are nonphysical. Also, negative weights when applied to high data values may lead to negative and nonphysical estimates. In these situations the negative weights in ordinary kriging must be corrected. An algorithm is presented to reset negative kriging weights, and compensating positive weights to zero. The sum of the remaining nonzero weights is restandardized to 1.0 to ensure unbiasedness. The situations when this correction is appropriate are described and a number of examples are given. Deutsch presented a steamroller method to avoid negative kriging weights. My method is slightly ;-) more elegant.

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 Autocorrelation Difficulties arise for cumulus clouds, where only a small number of non-zero observations may occur. In this case the autocorrelation function is not derivable. Solution: Kriging is based on the mean autocorrelation for all cumulus cases

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 Victorian LWP measurement krigerror krig

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 Concluding the total variance Lines have a smaller variance than the entire field. Why? Divide a field into several lines. Then the total variance is equal to: internal: the mean variance inside the lines plus external: the variance of the lines means Technically, there are more short distances in lines than in the entire area. Multiply the relative frequencies of distances with their corresponding variance. Then the expected total variances (lines/area) can be concluded.

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 Stefanian Permeability OriginalKriged (the truth) Semivariogram Org Krig

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 Nice effects of kriging Half of the variance is attributed to errors. This error variance can be interpreted in two ways: Pure inaccuracy of measurements. (Observation error) Point measuremnts are less representative for the entire grid box. (Small scale variability) For both cases the reduction of variance ís necessary. The kriged field is superior compared to the the original. It can be called Truth for this spatial resolution

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 Only the edge OriginalKriged

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 Random 31% Original Kriged

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 True, Edge, 31% True Edge 31% – = – = – = Total – Error = Remain

Diplomanden-Doktoranden-Seminar Bonn – 29. Juni 2008 Summary It is the difficulty to calculate total and error variance from a reduced data amount, which defines mainly how much variability is remaining in the obtained kriging result. Strong smoothing may occur. But the main reasons are underestimation of the total variance or overestimation of the error variance. Not the kriging method itself. Stepwise kriging is ready to go.