Esri UC 2014 | Technical Workshop | Performing Regression Analysis Using Raster Data Kevin M. Johnston Xuguang Wang.

Slides:



Advertisements
Similar presentations
Esri International User Conference | San Diego, CA Technical Workshops | Kevin M. Johnston Shitij Mehta ****************** An Introduction to Dynamic Simulation.
Advertisements

Forecasting Using the Simple Linear Regression Model and Correlation
Inference for Regression
Esri UC 2014 | Technical Workshop | ArcGIS 3D Analyst - Lidar Applications Clayton Crawford.
Regression Analysis Once a linear relationship is defined, the independent variable can be used to forecast the dependent variable. Y ^ = bo + bX bo is.
EPI 809/Spring Probability Distribution of Random Error.
Predictive Model of Mountain Goat Summer Habitat Suitability in Glacier National Park, Montana, USA Don White, Jr. 1 and Steve Gniadek 2 1 University of.
Chapter 11 Contingency Table Analysis. Nonparametric Systems Another method of examining the relationship between independent (X) and dependant (Y) variables.
LECTURE 3 Introduction to Linear Regression and Correlation Analysis
Correlation and Autocorrelation
Chapter 12 Simple Regression
Chapter 13 Introduction to Linear Regression and Correlation Analysis
Fall 2006 – Fundamentals of Business Statistics 1 Chapter 13 Introduction to Linear Regression and Correlation Analysis.
Chapter Topics Types of Regression Models
Advanced GIS Using ESRI ArcGIS 9.3 Arc ToolBox 5 (Spatial Statistics)
© 2000 Prentice-Hall, Inc. Chap Forecasting Using the Simple Linear Regression Model and Correlation.
Dr. Mario MazzocchiResearch Methods & Data Analysis1 Correlation and regression analysis Week 8 Research Methods & Data Analysis.
Chapter 14 Introduction to Linear Regression and Correlation Analysis
Esri Maps for Salesforce and Microsoft Dynamics CRM
SW388R7 Data Analysis & Computers II Slide 1 Multiple Regression – Basic Relationships Purpose of multiple regression Different types of multiple regression.
Esri UC 2014 | Technical Workshop | Optimizing Your JavaScript Web App for Performance Jeremy Bartley Derek Swingley.
Esri International User Conference | San Diego, CA Technical Workshops | Xuguang Wang Kevin M. Johnston ****************** Performing Image Classification.
Correlation & Regression
1 Doing Statistics for Business Doing Statistics for Business Data, Inference, and Decision Making Marilyn K. Pelosi Theresa M. Sandifer Chapter 11 Regression.
Title: Spatial Data Mining in Geo-Business. Overview  Twisting the Perspective of Map Surfaces — describes the character of spatial distributions through.
Introduction to Linear Regression and Correlation Analysis
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 12-1 Chapter 12 Simple Linear Regression Statistics for Managers Using.
Chapter 11 Simple Regression
LEARNING PROGRAMME Hypothesis testing Intermediate Training in Quantitative Analysis Bangkok November 2007.
Esri UC 2014 | Technical Workshop | Accessing Spatial Databases in ArcGIS using Query Layers Annie Sasidar.
Esri International User Conference | San Diego, CA Technical Workshops | Spatial Statistics: Best Practices Lauren Rosenshein, MS Lauren M. Scott, PhD.
Food Store Location Analysis Albuquerque New Mexico, 2010 Prepared for: Geography 586L - Spring Semester, 2014 Larry Spear M.A., GISP Sr. Research Scientist.
Using ESRI ArcGIS 9.3 Spatial Analyst
$88.65 $ $22.05/A profit increase Improving Wheat Profits Eakly, OK Irrigated, Behind Cotton.
OPIM 303-Lecture #8 Jose M. Cruz Assistant Professor.
Agronomic Spatial Variability and Resolution What is it? How do we describe it? What does it imply for precision management?
Introduction to Linear Regression
Chap 12-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 12 Introduction to Linear.
Esri UC2013. Technical Workshop. Technical Workshop 2013 Esri International User Conference July 8–12, 2013 | San Diego, California Applying ArcGIS Spatial.
NR 422- Habitat Suitability Models Jim Graham Spring 2009.
Intro to Raster GIS GTECH361 Lecture 11. CELL ROW COLUMN.
Esri UC2013. Technical Workshop. Technical Workshop 2013 Esri International User Conference July 8–12, 2013 | San Diego, California 3D Analyst – Feature.
Esri UC 2014 | Technical Workshop | Python – Raster Analysis Kevin M. Johnston Ryan DeBruyn.
Multiple Regression and Model Building Chapter 15 Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
Why Model? Make predictions or forecasts where we don’t have data.
GeoPlannerSM for ArcGIS®: An Introduction
Environmental Modeling Advanced Weighting of GIS Layers (2)
Regression. Types of Linear Regression Model Ordinary Least Square Model (OLS) –Minimize the residuals about the regression linear –Most commonly used.
Esri UC 2014 | Technical Workshop | Geocoding with ArcGIS Online and ArcGIS Online World Geocoding Service Jeff Rogers and Brad Niemand.
Environmental Modeling Advanced Weighting of GIS Layers.
Raster Analysis. Learning Objectives Develop an understanding of the principles underlying lab 4 Introduce raster operations and functions Show how raster.
Spatial Interpolation Chapter 13. Introduction Land surface in Chapter 13 Land surface in Chapter 13 Also a non-existing surface, but visualized as a.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 13-1 Introduction to Regression Analysis Regression analysis is used.
Applying Spatial Analysis Techniques to Make Better Decisions
Esri UC 2014 | Technical Workshop | Using ArcGIS Online Analysis Widgets Shing Lin, Jerome Yang.
Esri UC 2014 | Technical Workshop | ArcGIS API for JavaScript: What’s New Derek Swingley Jerome Yang
Esri UC 2014 | Technical Workshop | Concepts and Applications of Kriging Eric Krause Konstantin Krivoruchko.
Esri UC2013. Technical Workshop. Technical Workshop 2013 Esri International User Conference July 8–12, 2013 | San Diego, California Concepts and Applications.
There is a hypothesis about dependent and independent variables The relation is supposed to be linear We have a hypothesis about the distribution of errors.
Esri UC 2014 | Demo Theater | Agent-Based Modeling in ArcGIS Kevin M. Johnston.
Esri UC2013. Technical Workshop. Technical Workshop 2013 Esri International User Conference July 8–12, 2013 | San Diego, California Python – Raster Analysis.
Esri UC 2014 | Technical Workshop | Generalization for Multi-scale Mapping Edie Punt Jamie Conley.
Becky K. Kerns 1, Dominique Bachelet 2 and Michelle Buonopane 1 present 1 USDA Forest Service, Pacific Northwest Research Station, Corvallis, OR 2 Oregon.
Esri UC 2014 | Technical Workshop | Enhancing Web Map Performance in ArcGIS Online Julia Guard & Melanie Summers.
Chapter 13 Simple Linear Regression
Why Model? Make predictions or forecasts where we don’t have data.
Chapter 14 Introduction to Multiple Regression
Stats Club Marnie Brennan
Introduction to Logistic Regression
Presentation transcript:

Esri UC 2014 | Technical Workshop | Performing Regression Analysis Using Raster Data Kevin M. Johnston Xuguang Wang

Esri UC 2014 | Technical Workshop | Linear regression - Budworm impact Spatial autocorrelation Sampling Using the coefficients Spatial regression Logistics regression - Species distributions and climate change Outline : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Field data (raster surface) of percent canopy damage caused by spruce bud worm (an insect) Assumption: where the insect has caused greater damage there are more favorable features located there Know what features the insect is responding to but too complex to quantify the relationship Want to predict other areas where the spruce budworm may attack Problem 1: Linear regression : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Establishes the relationship of many features and values Presents the relationship in a concise manner The analysis output is conducive to the GIS Make assumptions from samples and apply to the entire population (every location in the raster) Regression analysis in GIS : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Dependent variable - Biomass - Tree growth - Probability of deer Independent variable - Slope - Soils - Vegetative type Linear regression (methods, stepwise, etc) - Continuous data Logistic regression - Presence or absence Character of regression : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | What is it? The effects on the output from the regression analysis Testing for spatial autocorrelation - Spatial correlation indices Sample points - Correlation (take every 5 cell out of 6 row) - Random sampling In the statistical algorithm - Spatial Regression Spatial autocorrelation : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Synergy between a statistical package and Spatial Analyst Why do we need the statistical package? Basic assumption–independent observations Using a statistical package : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Run regression with the significant factors Obtain the coefficients for each value within each raster Use the coefficients in a Map Algebra expression to create a preference surface The coefficients identify positive or negative influence and magnitude Creating the preference surface : Performing Regression Analysis Using Raster Data Z = a 0 + x 1 a 1 + x 2 a 2 + x 3 a 3 … x n a n

Esri UC 2014 | Technical Workshop | Output from a regression Creating the prediction surface with Map Algebra Creating the preference surface : Performing Regression Analysis Using Raster Data Outgrid = (-0.029* elevation) + (0.263 * distancetoroads) Coef# Coef

Esri UC 2014 | Technical Workshop | Still must determine significant variables Spatial regression uses spatial autocorrelation Use the results to create a probability surface Where the regression capability exist: - Classical statistical packages - SAS, SPSS, R - ArcGIS Spatial Statistics toolbox - Ordinary Least Squares - Geographically Weighted Regression Spatial Regression : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Linear Spatial autocorrelation Demo 1: Regression analysis

Esri UC 2014 | Technical Workshop | Want to examine the potential affects of climate change on the distribution of animal species Know the current distributions of the species (the dependent variable) We have a series of independent variables: - Vegetation type (as dummy variables) - Elevation, slope, and aspect - Distance from roads and cities - Etc. Problem 2: Logistics regression – True absence : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Presence/absence model Create a probability surface Logistics regression : Performing Regression Analysis Using Raster Data Z = 1 / 1 + exp (-  i x i )

Esri UC 2014 | Technical Workshop | Steps - Determine sample points - Run the logistic regression in R (4 scenarios) - Alter input independent variables (All – average temp) (min/max) - Greater than 90% and 95% confidence - Identify top two models based on statistics - Create probability and distribution surfaces - Spatial evaluation - Identify best model - Run model on , 2059, and 2099 Logistics regression : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Sample Points : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | American marten Big horn sheep Desert rat Dusky wood rat Fisher Flying squirrel Gray wolf Prong horn sheep Logistics regression: Dependent variables Pygmy rabbit Red tree vole Rocky mountain elk Sage grouse Silver bat Spotted owl Townsend bat White vole

Esri UC 2014 | Technical Workshop | Aspect Elevation Slope Euclidean distance from population Density of streams Density of roads Average yearly temperature Average maximum temperature Average minimum temperature Average precipitation - Logistics regression: Independent variables : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Vegetation – Subtropical mixed forest Vegetation – Temperate grassland Vegetation – Temperate shrub land Vegetation – Temperate evergreen needle-leaf woodland Vegetation – Temperate warm mixed forest Vegetation – Temperate evergreen needle-leaf forest Vegetation – Maritime evergreen needle-leaf forest Vegetation – Subalpine forest Vegetation - Tundra - Logistics regression: Independent variables (cont.) : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | We have two climate change models - Hadley (from the UK) - MIROC 3.2 (from Japan) Each model has two scenarios - The moderate, mid-level “A1B” carbon scenario - The higher, more extreme “A2” carbon scenario There are three time periods - “e”: Early-century, or averaged - “m”: Mid-century, or averaged - “l”: Late-century, or averaged The climate data : Performing Regression Analysis Using Raster Data From Ron Nielson’s group at Oregon State University/ US Forest Service

Esri UC 2014 | Technical Workshop | Still must determine significant variables Spatial regression uses spatial autocorrelation Use the results to create a probability surface Where the regression capability exist: - Classical statistical packages - SAS, SPSS, R - ArcGIS Spatial Statistics toolbox - Ordinary Least Squares - Geographically Weighted Regression Spatial Regression : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Steps - Determine sample points - Run the logistic regression in R (4 scenarios) - Alter input independent variables (All – average temp) (min/max) - Greater than 90% and 95% confidence - Identify top two models based on statistics - Create probability and distribution surfaces - Spatial evaluation - Identify best model - Run model on , 2059, and 2099 Logistics regression : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Logistics Diagnostics Table : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Logistic Statistics Table : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Steps - Determine sample points - Run the logistic regression in R (4 scenarios) - Alter input independent variables (All – average temp) (min/max) - Greater than 90% and 95% confidence - Identify top two models based on statistics - Create probability and distribution surfaces - Spatial evaluation - Identify best model - Run model on , 2059, and 2099 Logistics regression : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Map Algebra Statement – Probability Surface : Performing Regression Analysis Using Raster Data outraster = 1 / (1 + Exp(-1 * ( ( * Raster(aspectdata)) + ( * Raster(demdata)) + ( * Raster(slopedata)) + ( * Raster(eucpopareasdata)) + ( * Raster(roaddendata)) + ( * Raster(streamsdendata)) + ( * Raster(tempmaxdata)) + ( * Raster(tempmindata)) + ( * Raster(precpptdata)) + ( * Raster(veg22data)) + ( * Raster(veg17data)) + ( * Raster(veg16data)) + ( * Raster(veg12data)) + ( * Raster(veg11data)) + ( * Raster(veg8data)) + ( * Raster(veg7data)) + ( * Raster(veg6data)) + ( * Raster(veg2data)))))

Esri UC 2014 | Technical Workshop | Probability Surface : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Actual Distribution : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Prediction Surface Current.5 : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Steps - Determine sample points - Run the logistic regression in R (4 scenarios) - Alter input independent variables (All – average temp) (min/max) - Greater than 90% and 95% confidence - Identify top two models based on statistics - Create probability and distribution surfaces - Spatial evaluation - Identify best model - Run model on , 2059, and 2099 Logistics regression : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Evaluation - If species is there and predict it is there (100) - If the species is not there and predict it is not there (100) Adjustments false positives and false negatives - Adjust based on how far the misprediction is - Adjust if Maxent also predicted the species is there or not - Adjust if historically the species was present Spatial evaluation : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Spatial evaluation : Performing Regression Analysis Using Raster Data outPow = Int(((Power((Abs(Raster(distance1) ) + 0), 4) - minValue1) / (maxValue1 - minValue1)) * ((25 - 1) + 1))

Esri UC 2014 | Technical Workshop | Steps - Determine sample points - Run the logistic regression in R (4 scenarios) - Alter input independent variables (All – average temp) (min/max) - Greater than 90% and 95% confidence - Identify top two models based on statistics - Create probability and distribution surfaces - Spatial evaluation - Identify best model - Run model on , 2059, and 2099 Logistics regression : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Logistics regression Climate change analysis Demo 2: Regression analysis

Esri UC 2014 | Technical Workshop | Linear regression - Magnitude Logistics regression - Presence/absence Spatial regression Sample, calculate coefficients, and create surface Statistical capability - Spatial Statistics Toolbox - ArcGIS to R; SAS Bridge Summary : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | Thank you… Please fill out the session survey: First Offering ID: 340/1732 Online – Paper – pick up and put in drop box : Performing Regression Analysis Using Raster Data

Esri UC 2014 | Technical Workshop | : Performing Regression Analysis Using Raster Data