Estimating the effects of covariates and seasonal effects in state-space models Applied Time Series Analysis for Ecologists Stockholm, Sweden24-28 March.

Slides:



Advertisements
Similar presentations
Time series modelling and statistical trends
Advertisements

Environmental Data Analysis with MatLab Lecture 21: Interpolation.
Time Series II.
Computer Programming (TKK-2144) 13/14 Semester 1 Instructor: Rama Oktavian Office Hr.: M.13-15, W Th , F
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 ~ Curve Fitting ~ Least Squares Regression Chapter.
Time Varying Coefficient Models; A Proposal for selecting the Coefficient Driver Sets Stephen G. Hall, P. A. V. B. Swamy and George S. Tavlas,
Simple Regression. Major Questions Given an economic model involving a relationship between two economic variables, how do we go about specifying the.
Read Chapter 17 of the textbook
Least Square Regression
Least Square Regression
The Islamic University of Gaza Faculty of Engineering Civil Engineering Department Numerical Analysis ECIV 3306 Chapter 17 Least Square Regression.
R. Werner Solar Terrestrial Influences Institute - BAS Time Series Analysis by descriptive statistic.
Business Forecasting Chapter 4 Data Collection and Analysis in Forecasting.
What are the dominant frequencies? Fourier transforms decompose a data sequence into a set of discrete spectral estimates – separate the variance of a.
Correlation and regression 1: Correlation Coefficient
Empirical Modeling Dongsup Kim Department of Biosystems, KAIST Fall, 2004.
© 2002 Prentice-Hall, Inc.Chap 14-1 Introduction to Multiple Regression Model.
Applications The General Linear Model. Transformations.
1 Trend Analysis Step vs. monotonic trends; approaches to trend testing; trend tests with and without exogeneous variables; dealing with seasonality; Introduction.
Case Studies in Time Series II Periodic Behavior and Related issues David A. Dickey Professor of Statistics N. C. State University.
Chapter 8 Curve Fitting.
Copyright © 2014, 2011 Pearson Education, Inc. 1 Chapter 27 Time Series.
General Linear Models; Generalized Linear Models Hal Whitehead BIOL4062/5062.
Regression Regression relationship = trend + scatter
Autocorrelation in Time Series KNNL – Chapter 12.
Part 4 Chapter 16 Fourier Analysis PowerPoints organized by Prof. Steve Chapra, University All images copyright © The McGraw-Hill Companies, Inc. Permission.
Copyright © 2011 Pearson Education, Inc. Time Series Chapter 27.
KFUPM SE301: Numerical Methods Topic 5: Interpolation Lectures 20-22:
In Stat-I, we described data by three different ways. Qualitative vs Quantitative Discrete vs Continuous Measurement Scales Describing Data Types.
All the World’s a Polynomial Chris Harrow
Lecture 17 - Approximation Methods CVEN 302 July 17, 2002.
Transformations.
Data Analytics CMIS Short Course part II Extra Material: Forecasting Sam Buttrey December 2015.
Curve Fitting Introduction Least-Squares Regression Linear Regression Polynomial Regression Multiple Linear Regression Today’s class Numerical Methods.
ECE 8443 – Pattern Recognition EE 3512 – Signals: Continuous and Discrete Objectives: Eigenfunctions Fourier Series of CT Signals Trigonometric Fourier.
CS 376b Introduction to Computer Vision 03 / 17 / 2008 Instructor: Michael Eckmann.
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and  2 Now, we need procedures to calculate  and  2, themselves.
1 ECE 221 Electric Circuit Analysis I Chapter 6 Cramer’s Rule Herbert G. Mayer, PSU Status 11/14/2014 For use at Changchun University of Technology CCUT.
ECE 8443 – Pattern Recognition ECE 3163 – Signals and Systems Objectives: Eigenfunctions Fourier Series of CT Signals Trigonometric Fourier Series Dirichlet.
Eric Ward Mark Scheuerell Eli Holmes Applied Time Series Analysis FISH 507.
Environmental Data Analysis with MatLab 2 nd Edition Lecture 22: Linear Approximations and Non Linear Least Squares.
The Frequency Domain Digital Image Processing – Chapter 8.
The “Big Picture” (from Heath 1995). Simple Linear Regression.
Stockholm, Sweden24-28 March 2014 Introduction to MAR(1) models for estimating community interactions This lecture follows largely from: Ives AR, Dennis.
Time Series Forecasting Trends and Seasons and Time Series Models PBS Chapters 13.1 and 13.2 © 2009 W.H. Freeman and Company.
ELEC 413 Linear Least Squares. Regression Analysis The study and measure of the statistical relationship that exists between two or more variables Two.
FREQUENCY DISTRIBUTION
of Temperature in the San Francisco Bay Area
An introduction to Dynamic Linear Models
FISH 507 – Applied Time Series Analysis
The general linear model and Statistical Parametric Mapping
CH 5: Multivariate Methods
of Temperature in the San Francisco Bay Area
INTERPOLATION Prof. Samuel Okolie, Prof. Yinka Adekunle & Dr
Chapter 12 Curve Fitting : Fitting a Straight Line Gab-Byung Chae
Today’s class Multiple Variable Linear Regression
MATH 2140 Numerical Methods
CSCE 643 Computer Vision: Thinking in Frequency
Fourier Integrals For non-periodic applications (or a specialized Fourier series when the period of the function is infinite: L) -L L -L- L
Linear regression Fitting a straight line to observations.
Jeopardy.
FORECASTING 16-Jan-19 Dr.B.Sasidhar.
The general linear model and Statistical Parametric Mapping
Nonlinear Fitting.
Least Square Regression
Jeopardy.
Discrete Fourier Transform
Jeopardy.
Approximation of Functions
FORECASTING 11-Dec-19 Dr.B.Sasidhar.
Presentation transcript:

Estimating the effects of covariates and seasonal effects in state-space models Applied Time Series Analysis for Ecologists Stockholm, Sweden24-28 March 2014

Topics for this afternoon Covariates, regressors, drivers o In the observation model o In the process model o In both obs & process models Seasonal, periodical effects

Types of covariates Numerical o Continuous (eg, temperature) o Discrete (eg, counts) Categorical o Before/After o North/South o January, February, March, …

Why include covariates in a model? Most ecologists are interested in explaining observed patterns Covariates can explain the process that generated the patterns

Covariates occur in state, obs or both State equation Observation equation (eg, nutrients affects growth) (eg, vegetation obscures individuals)

Covariates occur in state, obs or both State equation Observation equation (eg, temperature affects growth) (eg, temperature affects activity)

Can you spot the Anolis lizards?

Covariates occur in state, obs or both State equation m rows k cols k rows 1 col m is number of states; k is number of covariates

Covariates occur in state, obs or both n rows k cols k rows 1 col n is number of obs; k is number of covariates Observation equation

Covariate effects can differ or not Different effectsSame effect

Covariates occur in state, obs or both Multivariate linear regression

Linear regression with AR(1) errors State equation Observation equation Use the state equation for autocorrelated errors The states are the observation errors

Linear regression on the state

Covariates can be seasons or periods State equation Observation equation

Seasonal or periodical effects For example, effects of “season” on 3 states WinterSpringSummerAutumnWinterSpringSummerAutumnWinterSpringSummerAutumn

Seasonal or periodical effects For example, effects of “season” on 3 states ctct

Seasonal or periodical effects For example, effects of “season” on 3 states c t+1

Non-factor seasons or periods We can also estimate “season” via a nonlinear model Two common options: 1)Cubic polynomial 2)Fourier frequency

Season as a polynomial For months:

Season as a Fourier series Fourier series are paired sets of sine and cosine waves They are commonly used in time series analysis in the frequency domain (which we will not cover here)

Season as a Fourier series Cc t = b 1 sin(2  t/p) + b 2 cos(2  t/p) t is time step; p is period

Dealing with missing covariates Drop years / shorten time series to remove missing values Interpolate missing values Develop process model for the covariates – Allows us to incorporate observation error into the covariates (known or unknown)

Dealing with missing covariates (v) are the variates (data) (c) are the covariates

And back to our MARSS form

What about the model likelihood? The log-likelihood of the expanded model includes the that for the covariate data If you want only the the log-likelihood of the non- covariate data, you need to subtract the log-likelihood of for the covariate model To do so, fit the expanded model, but pass missing values (NA’s) for the non-covariate data

Topics for the computer lab Covariates in models with: – only observation errors – with only process errors – with both observation & process errors Seasonal effects in models with both observation & process errors Missing covariates