Uncertainty “God does not play dice” –Einstein “the end of certainty” –Prigogine, 1977 Nobel Prize What remains is: –Quantifiable probability with uncertainty.

Slides:



Advertisements
Similar presentations
Februar 2003 Workshop Kopenhagen1 Assessing the uncertainties in regional climate predictions of the 20 th and 21 th century Andreas Hense Meteorologisches.
Advertisements

Probability Distributions CSLU 2850.Lo1 Spring 2008 Cameron McInally Fordham University May contain work from the Creative Commons.
Statistics : Statistical Inference Krishna.V.Palem Kenneth and Audrey Kennedy Professor of Computing Department of Computer Science, Rice University 1.
Sampling Distributions (§ )
Best Model Dylan Loudon. Linear Regression Results Erin Alvey.
Robert Plant != Richard Plant. Sample Data Response, covariates Predictors Remotely sensed Build Model Uncertainty Maps Covariates Direct or Remotely.
Copyright © 2006 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Slide
Approaches to Data Acquisition The LCA depends upon data acquisition Qualitative vs. Quantitative –While some quantitative analysis is appropriate, inappropriate.
SAMPLING DISTRIBUTIONS. SAMPLING VARIABILITY
T T07-01 Sample Size Effect – Normal Distribution Purpose Allows the analyst to analyze the effect that sample size has on a sampling distribution.
PROBABILITY AND SAMPLES: THE DISTRIBUTION OF SAMPLE MEANS.
Chapter 7 Probability and Samples: The Distribution of Sample Means
Standard error of estimate & Confidence interval.
Review of normal distribution. Exercise Solution.
© Harry Campbell & Richard Brown School of Economics The University of Queensland BENEFIT-COST ANALYSIS Financial and Economic Appraisal using Spreadsheets.
ESRM 250 & CFR 520: Introduction to GIS © Phil Hurvitz, KEEP THIS TEXT BOX this slide includes some ESRI fonts. when you save this presentation,
Basic Geographic Concepts GEOG 370 Instructor: Christine Erlien.
Monte Carlo Simulation CWR 6536 Stochastic Subsurface Hydrology.
Copyright © 2010 Lumina Decision Systems, Inc. Monte Carlo Simulation Analytica User Group Modeling Uncertainty Series #3 13 May 2010 Lonnie Chrisman,
Montecarlo Simulation LAB NOV ECON Montecarlo Simulations Monte Carlo simulation is a method of analysis based on artificially recreating.
Probabilistic Mechanism Analysis. Outline Uncertainty in mechanisms Why consider uncertainty Basics of uncertainty Probabilistic mechanism analysis Examples.
Orthorectification using
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 6-1 Business Statistics: A Decision-Making Approach 6 th Edition Chapter.
AP Statistics Section 7.2 C Rules for Means & Variances.
Interpolation Tools. Lesson 5 overview  Concepts  Sampling methods  Creating continuous surfaces  Interpolation  Density surfaces in GIS  Interpolators.
STATISTICS INTERVAL ESTIMATION Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.
Statistics Workshop Tutorial 5 Sampling Distribution The Central Limit Theorem.
Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc.. Chap 7-1 Developing a Sampling Distribution Assume there is a population … Population size N=4.
Distributions of the Sample Mean
Sampling Error SAMPLING ERROR-SINGLE MEAN The difference between a value (a statistic) computed from a sample and the corresponding value (a parameter)
Digital Image Processing
Concepts and Applications of Kriging
Simulated data sets Extracted from:. The data sets shared a common time period of 30 years and age range from 0 to 16 years. The data were provided to.
Machine Design Under Uncertainty. Outline Uncertainty in mechanical components Why consider uncertainty Basics of uncertainty Uncertainty analysis for.
BOT / GEOG / GEOL 4111 / Field data collection Visiting and characterizing representative sites Used for classification (training data), information.
Statistical Surfaces Any geographic entity that can be thought of as containing a Z value for each X,Y location –topographic elevation being the most obvious.
Summarizing Risk Analysis Results To quantify the risk of an output variable, 3 properties must be estimated: A measure of central tendency (e.g. µ ) A.
MCMC reconstruction of the 2 HE cascade events Dmitry Chirkin, UW Madison.
Statistics for Engineer. Statistics  Deals with  Collection  Presentation  Analysis and use of data to make decision  Solve problems and design.
How Good is a Model? How much information does AIC give us? –Model 1: 3124 –Model 2: 2932 –Model 3: 2968 –Model 4: 3204 –Model 5: 5436.
© 2010 Pearson Prentice Hall. All rights reserved Chapter Sampling Distributions 8.
© 2014 Minitab, Inc. Justin Callahan Commercial Sales Representative.
Lecture 5 Introduction to Sampling Distributions.
ISRIC Spring School – Hand’s on Global Soil Information Facilities, 9-13 May 2016 Uncertainty quantification and propagation Gerard Heuvelink.
Bootstrapping James G. Anderson, Ph.D. Purdue University.
Chapter 9 Day 2. Warm-up  If students picked numbers completely at random from the numbers 1 to 20, the proportion of times that the number 7 would be.
Markov Chain Monte Carlo in R
Who will you trust? Field technicians? Software programmers?
Why Model? Make predictions or forecasts where we don’t have data.
Statistical Inference
Questions from lectures
Robert Plant != Richard Plant
How Good is a Model? How much information does AIC give us?
Monte Carlo Simulation Managing uncertainty in complex environments.
Direct or Remotely sensed
Probability & Statistics Probability Theory Mathematical Probability Models Event Relationships Distributions of Random Variables Continuous Random.
STATISTICS INTERVAL ESTIMATION
Sampling Distribution
Sampling Distribution
QQ Plot Quantile to Quantile Plot Quantile: QQ Plot:
Uncertainty “God does not play dice”
Concepts and Applications of Kriging
Sampling Distribution of a Sample Proportion
Spatial Data Entry via Digitizing
Empirical Bayesian Kriging and EBK Regression Prediction – Robust Kriging as Geoprocessing Tools Eric Krause.
Sampling Distribution of a Sample Proportion
Sampling Distributions (§ )
Quantitative Methods Varsha Varde.
Statistics Review (It’s not so scary).
Presentation transcript:

Uncertainty “God does not play dice” –Einstein “the end of certainty” –Prigogine, 1977 Nobel Prize What remains is: –Quantifiable probability with uncertainty

Situation All data includes some uncertainty The uncertainty is usually not documented Most modeling methods do not provide uncertainty outputs

Solution? Estimate the uncertainty in the measured values and the predictor variables Use “Monte Carlo” methods: 1.Inject error into the input data 2.Create the model 3.Repeat 1 and 2 over and over 4.Find the distribution of the model outputs 1.i.e. the parameters and statistical measures 2.E.g. coefficients, R 2, p values, etc.

Douglas-Fir sample data Create the Model Model “Parameters” Precip To Points Extract Text File To Raster Prediction Attributes

Estimating Uncertainty Field data –Distribution of x,y values –Measurements Predictor layers –Interpolated –Remotely Sensed

Down Sampling

Mean Raster

Additional Error What was the distribution of the contents of each pixel when it was sampled? What’s in a Pixel? Cracknell, 2010

Pixel Sampling Each pixel represents an area that is: –Elliptical –Larger than the pixels dimensions

Point-Spread Function AVHRR

Resampling

Approach? Estimate the standard deviation of the original scene that the pixels represent Use this estimate to create predictor rasters that we down sample for the modeling

Monte Carlo Error Injection 1.Create the model with the “mean raster” 2.Inject normally distributed random “error” into the predictors 3.Recreate the model 4.Repeat 2 & 3 saving results 5.Create distribution of the parameters and performance measures (R 2, AIC, AUC, etc.)

Interpolated Predictors Many predictors are interpolated from point-source data Kriging provides a standard deviation raster as one of it’s output (these are rarely available) By injecting error into the point data and recreating the interpolated surface, we can characterize the error in it. We can also use this to characterize the error’s impact on the model as above

"GSENM" by User:Axcordion - G. Licensed under CC BY-SA 3.0 via Wikimedia Commons - ENM.jpg#mediaviewer/File:GSENM.jpg

Zion

Where was the data collected? On flat spots Near roads Often at airports! The data is not representative of our entire landscape

We’re Missing Data! Interpolated Raster Canyon

Approach If you created the interpolated surface: –Use Monte Carlo methods to repeatedly recreate the interpolated surface to see the effect of missing data Regardless: –Estimate the variability that was missed Maybe from a DEM? –Use this as an uncertainty raster?

Lab This Week Characterizing the uncertainty in Remotely Sensed data

Extra slides

Uncertainty Factors Inherent uncertainty in the world Limitation of human congnition Limitation of measurement Uncertainty in processing and analysis

Dimensions of uncertainty Space Time Attribute Scale Relationships