Eric Ward Mark Scheuerell Eli Holmes Applied Time Series Analysis FISH 507.

Slides:



Advertisements
Similar presentations
Time series modelling and statistical trends
Advertisements

Marian Scott SAGES, March 2009
Part II – TIME SERIES ANALYSIS C5 ARIMA (Box-Jenkins) Models
Part II – TIME SERIES ANALYSIS C1 Introduction to TSA © Angel A. Juan & Carles Serrat - UPC 2007/2008 "If we could first know where we are, then whither.
1 BIS APPLICATION MANAGEMENT INFORMATION SYSTEM Advance forecasting Forecasting by identifying patterns in the past data Chapter outline: 1.Extrapolation.
STAT 497 APPLIED TIME SERIES ANALYSIS
Business Forecasting Chapter 10 The Box–Jenkins Method of Forecasting.
Exponential Smoothing Methods
Time Series Analysis Autocorrelation Naive & Simple Averaging
13 Introduction toTime-Series Analysis. What is in this Chapter? This chapter discusses –the basic time-series models: autoregressive (AR) and moving.
Moving Averages Ft(1) is average of last m observations
Lecture 23: Tues., Dec. 2 Today: Thursday:
Chapter 12 - Forecasting Forecasting is important in the business decision-making process in which a current choice or decision has future implications:
Time series analysis - lecture 5
Data Sources The most sophisticated forecasting model will fail if it is applied to unreliable data Data should be reliable and accurate Data should be.
MOVING AVERAGES AND EXPONENTIAL SMOOTHING
X-12 ARIMA Eurostat, Luxembourg Seasonal Adjustment.
L7: ARIMA1 Lecture 7: ARIMA Model Process The following topics will be covered: Properties of Stock Returns AR model MA model ARMA Non-Stationary Process.
1 BABS 502 Moving Averages, Decomposition and Exponential Smoothing Revised March 11, 2011.
© 2003 Prentice-Hall, Inc.Chap 12-1 Business Statistics: A First Course (3 rd Edition) Chapter 12 Time-Series Forecasting.
Introduction to Multilevel Modeling Using SPSS
© 2002 Prentice-Hall, Inc.Chap 13-1 Statistics for Managers using Microsoft Excel 3 rd Edition Chapter 13 Time Series Analysis.
ANCOVA Lecture 9 Andrew Ainsworth. What is ANCOVA?
Doc.Ing. Zlata Sojková, CSc.1 Time series (TS). doc.Ing. Zlata Sojková, CSc.2.
Time Series “The Art of Forecasting”. What Is Forecasting? Process of predicting a future event Underlying basis of all business decisions –Production.
CLASS B.Sc.III PAPER APPLIED STATISTICS. Time Series “The Art of Forecasting”
TIME SERIES by H.V.S. DE SILVA DEPARTMENT OF MATHEMATICS
1 Least squares procedure Inference for least squares lines Simple Linear Regression.
Business Forecasting Used to try to predict the future Uses two main methods: Qualitative – seeking opinions on which to base decision making – Consumer.
Copyright © 2015 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education.
Chapter 17 Time Series Analysis and Forecasting ©.
Multivariate Analysis. One-way ANOVA Tests the difference in the means of 2 or more nominal groups Tests the difference in the means of 2 or more nominal.
Time series Decomposition Farideh Dehkordi-Vakil.
Week 11 Introduction A time series is an ordered sequence of observations. The ordering of the observations is usually through time, but may also be taken.
Spatial Interpolation III
Big Data at Home Depot KSU – Big Data Survey Course Steve Einbender Advanced Analytics Architect.
© 1999 Prentice-Hall, Inc. Chap Chapter Topics Component Factors of the Time-Series Model Smoothing of Data Series  Moving Averages  Exponential.
In Stat-I, we described data by three different ways. Qualitative vs Quantitative Discrete vs Continuous Measurement Scales Describing Data Types.
N318b Winter 2002 Nursing Statistics Specific statistical tests Chi-square (  2 ) Lecture 7.
Statistics 349.3(02) Analysis of Time Series. Course Information 1.Instructor: W. H. Laverty 235 McLean Hall Tel:
1 BABS 502 Moving Averages, Decomposition and Exponential Smoothing Revised March 14, 2010.
Stats Term Test 4 Solutions. c) d) An alternative solution is to use the probability mass function and.
QM Spring 2002 Business Statistics Analysis of Time Series Data: an Introduction.
Cycles and Exponential Smoothing Models Materials for this lecture Lecture 10 Cycles.XLS Lecture 10 Exponential Smoothing.XLSX Read Chapter 15 pages
Introduction to stochastic processes
1 Ka-fu Wong University of Hong Kong A Brief Review of Probability, Statistics, and Regression for Forecasting.
Demand Management and Forecasting Chapter 11 Portions Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
Analyses of intervention effects Mark Scheuerell & Eli Holmes FISH 507 – Applied Time Series Analysis 5 March 2015.
Forecasting. Model with indicator variables The choice of a forecasting technique depends on the components identified in the time series. The techniques.
Chapter 11 – With Woodruff Modications Demand Management and Forecasting Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
Time Series Forecasting Trends and Seasons and Time Series Models PBS Chapters 13.1 and 13.2 © 2009 W.H. Freeman and Company.
Estimating the effects of covariates and seasonal effects in state-space models Applied Time Series Analysis for Ecologists Stockholm, Sweden24-28 March.
Hierarchical models. Hierarchical with respect to Response being modeled – Outliers – Zeros Parameters in the model – Trends (Us) – Interactions (Bs)
Lecture 9 Forecasting. Introduction to Forecasting * * * * * * * * o o o o o o o o Model 1Model 2 Which model performs better? There are many forecasting.
An introduction to Dynamic Factor Analysis
Covariance, stationarity & some useful operators
Eric Ward Mark Scheuerell Eli Holmes
Time Series Analysis and Its Applications
An introduction to Dynamic Linear Models
FISH 507 – Applied Time Series Analysis
Statistics for Managers using Microsoft Excel 3rd Edition
Chapter 4: Seasonal Series: Forecasting and Decomposition
Statistics 153 Review - Sept 30, 2008
Statistics and Modelling 3.8
Chapter 9 Model Building
Checking the data and assumptions before the final analysis.
Time Series introduction in R - Iñaki Puigdollers
Model Selection, Seasonal Adjustment, Analyzing Results
Presentation transcript:

Eric Ward Mark Scheuerell Eli Holmes Applied Time Series Analysis FISH 507

Introductions Who are we? Who & why you’re here? What are you looking to get from this class?

Days and Times Lectures When: Tues & Thurs from 1:30-2:50 Where: FSH 203 Computer lab When: Thurs from 3:00-3:50 Where: FSH 207

Grading Weekly homework (40% of total) – Assigned every Thurs at the end of computer lab – Due by 5:00 PM the following Tues – Based on material from lecture & computer lab Research project & paper (40% of total) – Must involve some form of time series model(s) – Due by 11:59 PM on March 13 Two anonymous peer-reviews (20% of total) – One review each for 2 colleague’s papers – Due by 11:59 PM on March 17

Expectations for final project Research paper or thesis chapter that you can turn into a peer-reviewed publication Ideally a solo effort, but you can work in pairs Focus on applied time series analysis – Univariate or multivariate Short format similar to “Report” in Ecology or “Rapid Communication” in CJFAS – Max of 20 pages, inclusive of refs, tables, figs, etc – 12-pt font, double-spaced throughout

Don’t have any time series data? RAM Legacy RAM’s Stock-Recruitment Database Global Population Dynamics Database NOAA NWFSC Salmon Population Summary SAFS – Alaska Salmon Program – Lake Washington plankton

Course topics Week 1: Decomposition, covariance, autocorrelation Week 2: Autoregressive & moving-average models, model estimation Week 3: Univariate state-space models, model selection Week 4: Multivariate state-space models, covariates & seasonal effects Week 5: Multivariate regression, species interactions Week 6: Univariate & multivariate dynamic linear models Week 7: Spatial models, multi-stage models Week 8: Dynamic factor analysis & hierarchical models Week 9: Detection of outliers & perturbation analysis Week 10: Presentations of final projects

An introduction to time series and their analysis Mark Scheuerell FISH 507 – Applied Time Series Analysis 6 January 2015

Topics for today (lecture) Characteristics of time series (ts) o What is a ts? o Classifying ts o Trends o Seasonality (periodicity) Classical decomposition

What is a time series? A time series (ts) is a set of observations taken sequentially in time A ts can be represented as a set {x t : t = 1,2,3,…,n} = {x 1,x 2,x 3,…,x n } For example, {10,31,27,42,53,15}

Example of a time series Number of wild spr/sum Chinook salmon returning to the Snake R

Classification of time series (I) I.By some index set A.Interval across real time x(t); t  [1.1,2.5] B.Discrete time x t 1.Equally spaced; t = {1,2,3,4,5} 2.Equally spaced w/ missing values; t = {1,2,4,5,6} 3.Unequally spaced; t = {2,3,4,6,9}

Classification of time series (II) II.By underlying process A.Discrete (eg, total # of fish caught per trawl) B.Continuous (eg, salinity, temperature)

Classification of time series (III) III.By number of values recorded A.Univariate/scalar (eg, total # of fish caught) B.Multivariate/vector (eg, # of each spp of fish caught)

Classification of time series (IV) IV.By type of values recorded A.Integer (eg, # of fish in 5 min trawl = 2413) B.Rational (eg, fraction of unclipped fish = 47/951) C.Real (eg, fish mass = 10.2 g) D.Complex (eg, cos[2π*2.43] + i sin[2π*2.43])

Statistical analyses of time series Most statistical analyses are concerned with estimating properties of a population from a sample Time series analysis, however, presents a different situation Although we could vary the length of an observed sample, it is often impossible to make multiple observations at a given time For example, one can’t observe today’s closing price of Microsoft stock more than once This makes conventional statistical procedures, based on large sample estimates, inappropriate

Examples of time series How would we describe this ts? flat decreasing increasing

Examples of time series How would we describe this ts? “Regular” cycle

What is a time series model? A time series model for {x t } is a specification of the joint distributions of a sequence of random variables {X t } of which {x t } is thought to be a realization For example, “white” noise:x t = w t and w t ~ N(0,1) autoregressive:x t = x t-1 + w t and w t ~ N(0,1)

Iterative approach to model building Postulate general class of models Identify candidate model Estimate parameters Diagnostics: is model adequate? Use model for forecasting or control NoYes Also known as the “Box-Jenkins Approach”

Classical decomposition of time series Classical decomposition of an observed time series is a fundamental approach in time series analysis The idea is to decompose a time series {x t } into a trend (m t ), a seasonal component (s t ), and a remainder (e t ) x t = m t + s t + e t

Linear filtering of time series Beginning with the trend (m t ), we need a means for extracting a “signal” A common method is to use linear filters For example, moving averages with equal weights (FYI, this is what Excel does)

Example of linear filtering

Linear filtering of time series Consider case where season is based on 12 months & ts begins in January (t=1) Monthly averages over year will result in t = 6.5 for m t (which is not good) One trick is to average (1) the average of Jan-Dec & (2) the average of Feb-Jan

Example of linear filtering

Data from

Example of linear filtering

Decomposition of time series Now that we have an estimate of m t, we can get estimate of s t simply by subtraction:

Example of linear filtering

Decomposition of time series Now that we have an estimate of s t, we can get estimate of e t simply by subtraction:

Example of linear filtering

Notes on decomposition Obtaining a “model” for a ts via decomposition is easy, but… You don’t get a formula with which to obtain forecasts Let’s look at an alternative

Example of linear trend fitting A simple method for trend extraction is to use linear regression Note: the t index here could be a non- integer in cases with seasonal data

Example of linear trend fitting

Decomposition of time series Another means for extracting a trend is via nonparametric regression models (eg, LOESS) see R pkg stl

Moving on with decomposition We have decomposed our time series into a trend plus remainder (s t + e t ) x t = ( t) + s t + e t Now let’s consider the seasonal part

Example of linear trend fitting One method is to use fixed effects (eg, ANOVA)

Example of linear trend fitting Adding in a model for season (ie, quarters) So, for example, if q = 10.25: This is the “floor” function

Example of linear trend fitting Our final decomposition model

Example of trend + season fitting

Are the residuals stationary? The goal with decomposition is to reduce the time series to a trend, season & stationary residuals

Iterative approach to model building Postulate general class of models Identify candidate model Estimate parameters Diagnostics: is model adequate? Use model for forecasting or control NoYes

Summary This was a brief overview—there is lots of stuff we didn’t cover Please ask for help/guidance if you’re looking for more details, other R code, etc