Environmental change and statistical trends – some examples Marian Scott Dept of Statistics, University of Glasgow NERC September 2011.

Slides:



Advertisements
Similar presentations
P ROBLEMS IN DETECTING TREND IN HYDROMETEOROLOGICAL SERIES FOR CLIMATE CHANGE STUDIES Jasna Plavšić 1 and Zoran Obušković 2 1 University of Belgrade –
Advertisements

Some statistical ideas Marian Scott Statistics, University of Glasgow June 2012.
1 Statistical trends and time series a recap July 2012 Marian Scott and Adrian Bowman.
What can Statistics do for me? Marian Scott Dept of Statistics, University of Glasgow Statistics course, March 2009.
Time series modelling and statistical trends
Introduction to modelling extremes
What can Statistics do for me? Marian Scott Dept of Statistics, University of Glasgow Statistics course, September 2006.
Environmental change and statistical trends – some examples Marian Scott Dept of Statistics, University of Glasgow NERC August 2012.
Some statistical ideas Marian Scott Statistics, University of Glasgow January 2014.
Spatial point patterns and Geostatistics an introduction
Environmental change and statistical trends – some examples Marian Scott Dept of Statistics, University of Glasgow NERC September 2010.
Environmental change and statistical trends – some examples
Some statistical ideas Marian Scott Statistics, University of Glasgow September 2011.
Measurement and assessment of change What it the status quo in environmental science? In time – A simple trend line – A p-value or a 95% confidence interval.
What can Statistics do for me? Marian Scott Dept of Statistics, University of Glasgow Statistics course, September 2007.
Trend detection- birds Marian Scott Dept of Statistics, University of Glasgow Glasgow, Sept 2007.
Sulphur dioxide- space and time Marian Scott Dept of Statistics, University of Glasgow NERC August 2013.
Case study 1: Central England temperature Hadley Centre Central England Temperature (HadCET) dataset The CET dataset is the longest instrumental record.
Marian Scott SAGES, March 2009
Spatiotemporal Modelling of Nitrate and Phosphorus in River Catchments for England and Wales Claire Miller 1, Ana-Maria Magdalina 1, Adrian Bowman 1, Marian.
Spatiotemporal Modelling of Nitrate and Phosphorus in River Catchments for England and Wales Claire Miller 1, Ana-Maria Magdalina 1, Adrian Bowman 1, Marian.
Introduction Describe what panel data is and the reasons for using it in this format Assess the importance of fixed and random effects Examine the Hausman.
Correlation & the Coefficient of Determination
Multiple Regression and Model Building
Why gap filling isn’t always easy Andrew Richardson University of New Hampshire Jena Gap Filling Workshop September 2006.
Forecasting OPS 370.
Objectives 10.1 Simple linear regression
Forecasting Using the Simple Linear Regression Model and Correlation
Trend analysis: considerations for water quality management Sylvia R. Esterby Mathematics, Statistics and Physics, University of British Columbia Okanagan.
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
Correlation and regression Dr. Ghada Abo-Zaid
Moving Averages Ft(1) is average of last m observations
Chapter 10 Simple Regression.
Chapter 12 Simple Regression
Some more issues of time series analysis Time series regression with modelling of error terms In a time series regression model the error terms are tentatively.
Chapter 5 Time Series Analysis
© 2003 Prentice-Hall, Inc.Chap 14-1 Basic Business Statistics (9 th Edition) Chapter 14 Introduction to Multiple Regression.
Elementary hypothesis testing Purpose of hypothesis testing Type of hypotheses Type of errors Critical regions Significant levels Hypothesis vs intervals.
Statistics for Managers Using Microsoft Excel, 5e © 2008 Prentice-Hall, Inc.Chap 13-1 Statistics for Managers Using Microsoft® Excel 5th Edition Chapter.
Chapter 11 Multiple Regression.
Part II – TIME SERIES ANALYSIS C2 Simple Time Series Methods & Moving Averages © Angel A. Juan & Carles Serrat - UPC 2007/2008.
Linear Regression Example Data
Copyright ©2006 Brooks/Cole, a division of Thomson Learning, Inc. More About Regression Chapter 14.
Fall, 2012 EMBA 512 Demand Forecasting Boise State University 1 Demand Forecasting.
© 2003 Prentice-Hall, Inc.Chap 12-1 Business Statistics: A First Course (3 rd Edition) Chapter 12 Time-Series Forecasting.
Diane Stockton Trend analysis. Introduction Why do we want to look at trends over time? –To see how things have changed What is the information used for?
Statistical Methods For Engineers ChE 477 (UO Lab) Larry Baxter & Stan Harding Brigham Young University.
Introduction to Linear Regression and Correlation Analysis
Inference for regression - Simple linear regression
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 12-1 Chapter 12 Simple Linear Regression Statistics for Managers Using.
Datta Meghe Institute of Management Studies Quantitative Techniques Unit No.:04 Unit Name: Time Series Analysis and Forecasting 1.
TIME SERIES by H.V.S. DE SILVA DEPARTMENT OF MATHEMATICS
Business Forecasting Used to try to predict the future Uses two main methods: Qualitative – seeking opinions on which to base decision making – Consumer.
Geographic Information Science
Time series Decomposition Farideh Dehkordi-Vakil.
Copyright ©2011 Brooks/Cole, Cengage Learning Inference about Simple Regression Chapter 14 1.
Jon Curwin and Roger Slater, QUANTITATIVE METHODS: A SHORT COURSE ISBN © Thomson Learning 2004 Jon Curwin and Roger Slater, QUANTITATIVE.
ANOVA, Regression and Multiple Regression March
1 BABS 502 Moving Averages, Decomposition and Exponential Smoothing Revised March 14, 2010.
Time Series and Forecasting
1 Detection of discontinuities using an approach based on regression models and application to benchmark temperature by Lucie Vincent Climate Research.
Techniques for Decision-Making: Data Visualization Sam Affolter.
Stats Methods at IC Lecture 3: Regression.
Statistical Forecasting
Chapter 13 Simple Linear Regression
of Temperature in the San Francisco Bay Area
Forecasting Methods Dr. T. T. Kachwala.
What is Correlation Analysis?
of Temperature in the San Francisco Bay Area
Exponential Smoothing
Presentation transcript:

Environmental change and statistical trends – some examples Marian Scott Dept of Statistics, University of Glasgow NERC September 2011

questions about trends and change one of the most common questions common in official and policy documents- often based on simple indicators draws together much of preceeding technical sessions- time series, regression, even spatial… some challenging issues to consider

Observed temperature trend in Europe (EEA signals 2004). Global average temp increased by °C over the past 100 years Change in different periods of the year may have different effects, – start of the growing season determined by spring and autumn temps, – changes in winter important for species survival.

Climate change in Scotland (SNIFFER report, 2006) Annual average 24- hour maximum temperature over 90 year period, in 3 regions of Scotland – Very varied, non monotonic

What is the state and trend in biodiversity (EEA CSI 009) Populations of common and widespread farmland bird species in 2003 are only 71% of their 1980 levels. Key message: Butterfly and bird species across Europe show population declines of between -2% and -37% since the early 1970s.

Measurement and assessment of change What it the status quo in environmental science? In time – A simple trend line – A p-value or a 95% confidence interval for the slope – A smooth curve – The relative change in an index between two time points (%) Is this sufficient?

Measurement and assessment of change- common tools In time (SNIFFER, 2006) – A linear regression equation was calculated for each dataset and then the trend was calculated from the gradient parameter (i.e. the rate of change) multiplied by the length of the data period to provide a clear change value since the start of the period. the significance of trends was tested using the non- parametric Mann-Kendall tau test (Sneyers, 1990). Linear trends with the Mann-Kendall significance test are widely used in the analysis of climate trends

Trends

Joint Nature Conservation Council definition of trend a trend is a measurement of change derived from a comparison of the results of two or more statistics. A trend relates to a range of dates spanning the statistics from which it is derived, e.g A trend will generally be expressed as a percentage change (+ for an increase, - for a decrease) or as an index.

Statistical definition of trend What is a statistical trend? – A long-term change in the mean level (Chatfield, 1996) – Long-term movement (Kendall and Ord, 1990) – The non-random function (t)= E (Y(t)) (Diggle, 1990) Trend is a long-term behaviour of the process, trends in mean, variance and extremes may be of interest (Chandler, this course) Environmental change often but not always means a statistical trend Not restricted to linear (or even monotonic) trends

Statistical tools for exploring and quantifying trend Exploratory tools – Time series plots, smoothed trends over time (are the series equally spaced, no missing data?) More formal tools – Can you assume monotonicity?, is the trend linear? – Non-parametric estimation and testing (classic tests) – Semi-parametric and non-parametric additive models (for irregular spaced data) what is monotonic? steadily increasing or decreasing

two time series- what are the trends? are they monotonic? Example 1: an index of bird species population

two time series- what are the trends? are they monotonic? Example 1: a linear trend

two time series- what are the trends? are they monotonic? Example 1: a non-monotonic trend

Example: The river Nile data Volume of the river for approx 100 year period. is there evidence of a change? if yes, when and in what way?

a non-parametric model for the Nile a smooth function (LOESS) or non- parametric regression model OK? any suggestion that there may be a change- point? (which is what?)

the simple problem – change in mean value here we imagine a series with two mean levels 20 observations N(10,2 2 ) and 20 observations N(20, 2 2 ) our ability to detect a change depends on the size of the change and the variability in the series

some simple examples

exploring whether a changepoint exists principle for this method concerns a comparison of a left and right smooth and difference between them confidence bands indicated, look for whether the left and right smooths leave the blue band

An alternative model for the Nile two smooth sections, broken at roughly different mean levels in the two periods so modelling the two periods separately

Unequally spaced data what are the sources of the irregularity? – roughly regular (every month but a different day) – missing observations (over the Xmas vacation) cant use ACF (use variogram instead) can I plug the hole (if missing data) a qualified yes, if gap is not too large, the reason for the missing data is not related to the values how? – interpolation (say fill in with annual mean) – build a simple seasonal model

Alternative statistical tools (for long, irregular time series, which may be non- monotonic) already seen many of these Parametric and semi-parametric models, non-parametric additive models Extensions to trends in space and time not especially useful for forecasting

Example: trends in atmospheric SO 2 levels over space- EMEP network Daily measurements made at more than 100 monitoring stations over a 20 year period over Europe: Complex statistical model developed to describe the pattern, the model portions the variation to trend, seasonality, residual variation Main question: – what is the long term trend and is it the same over Europe?

Additive models including space ln(SO 2 ) = f ym (years, months) + f ll (latitude, longitude) + ln(SO 2 ) = f y (years) + f m (months) + f ll (latitude, longitude) + with appropriate assumptions on

ln(SO 2 ) = f y (years) + f m (months) + f ll (latitude, longitude) + ln(SO 2 ) = f ym (years, months) + f ll (latitude, longitude) +

time and space interaction The movie highlights the spatial adjustments that should be added to the main effect for space at particular time points. Easting Northing Spatial Trend Interaction between space and time TON for Coquet, Wansbeck, Blyth LHA in the NE ( ) Claire Miller, Ana Maria Magdalena, Adrian Bowman

Measurement and assessment of change-three questions to consider Is routine monitoring data useful/adequate/sufficient for environmental change detection? Are the classical (well accepted) simple procedures such as – the % change between two time points (the slope), – A p-value or a 95% confidence interval for the slope sufficient for the complexity of environmental behaviour? What do statistical trends offer to evaluation of environmental change, to management and to policy setting? how long does a time series need to be?

Statistical trends and environmental change Sophisticated statistical models for trends can give – added value and better descriptions of complex change behaviour and – begin to tease out climate change driven effects in environmental quality

Case study 1: Central England temperature R script in CETcasestudy explore the trend (linear or otherwise) is the trend the same in the different months does the starting point matter in our conclusions?

Case study 2: haddocks R script in haddock explore the trend (linear or otherwise) Think about projections