Performance of Seasonal Adjustment Procedures Philip Hans Franses, Richard Paap, and Dennis Fok Econometric Institute Erasmus University Rotterdam.

Slides:



Advertisements
Similar presentations
The Robert Gordon University School of Engineering Dr. Mohamed Amish
Advertisements

DSCI 5340: Predictive Modeling and Business Forecasting Spring 2013 – Dr. Nick Evangelopoulos Exam 1 review: Quizzes 1-6.
Part II – TIME SERIES ANALYSIS C3 Exponential Smoothing Methods © Angel A. Juan & Carles Serrat - UPC 2007/2008.
Forecasting OPS 370.
© Copyright 2001, Alan Marshall1 Regression Analysis Time Series Analysis.
Seasonal Adjustment of National Index Data at International Level
G. Alonso, D. Kossmann Systems Group
Unit Roots & Forecasting
STAT 497 APPLIED TIME SERIES ANALYSIS
Chapter 3 Producing Data 1. During most of this semester we go about statistics as if we already have data to work with. This is okay, but a little misleading.
Time Series Analysis Autocorrelation Naive & Simple Averaging
The Simple Linear Regression Model: Specification and Estimation
Chapter 12 Simple Regression
Chapter 12 - Forecasting Forecasting is important in the business decision-making process in which a current choice or decision has future implications:
Data Sources The most sophisticated forecasting model will fail if it is applied to unreliable data Data should be reliable and accurate Data should be.
(ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics.
MOVING AVERAGES AND EXPONENTIAL SMOOTHING
Chapter 3 Forecasting McGraw-Hill/Irwin
REGRESSION MODEL ASSUMPTIONS. The Regression Model We have hypothesized that: y =  0 +  1 x +  | | + | | So far we focused on the regression part –
Learning Objectives  Recommend the appropriate forecasting model for a given situation.  Conduct a Delphi forecasting exercise.  Describe.
Forecasting McGraw-Hill/Irwin Copyright © 2012 by The McGraw-Hill Companies, Inc. All rights reserved.
1 An Introduction to Nonparametric Regression Ning Li March 15 th, 2004 Biostatistics 277.
Slides 13b: Time-Series Models; Measuring Forecast Error
Chapter 5 DEMAND FORECASTING Prepared by Mark A. Jacobs, PhD
CHAPTER 18 Models for Time Series and Forecasting
Vienna, 23 April 2008 UNECE Work Session on SDE Topic (v) Editing on results (post-editing) 1 Topic (v): Editing based on results Discussants: Maria M.
1 1 Slide © 2009 South-Western, a part of Cengage Learning Chapter 6 Forecasting n Quantitative Approaches to Forecasting n Components of a Time Series.
Slides by John Loucks St. Edward’s University.
Samuel H. Huang, Winter 2012 Basic Concepts and Constant Process Overview of demand forecasting Constant process –Average and moving average method –Exponential.
Estimating Potentials and Forecasting Sales
Chapter 12 Multiple Regression and Model Building.
Development of a Macro Editing Approach Work Session on Statistical Data Editing, Topic v: Editing based on results April 2008 WP 30.
Using Bayesian Networks to Analyze Expression Data N. Friedman, M. Linial, I. Nachman, D. Hebrew University.
Business Forecasting Used to try to predict the future Uses two main methods: Qualitative – seeking opinions on which to base decision making – Consumer.
Chapter Twelve Census: Population canvass - not really a “sample” Asking the entire population Budget Available: A valid factor – how much can we.
Forecasting Revenue: An Example of Regression Model Building Setting: Possibly a large set of predictor variables used to predict future quarterly revenues.
USING DEMETRA+ IN DAILY WORK SAUG – Luxembourg, 16 October 2012 Enrico INFANTE, Eurostat Unit B1: Quality, Methodology and Research.
DSc 3120 Generalized Modeling Techniques with Applications Part II. Forecasting.
10.2 Tests of Significance Use confidence intervals when the goal is to estimate the population parameter If the goal is to.
Multiple Regression and Model Building Chapter 15 Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
Copyright © 2011 Pearson Education, Inc. The Simple Regression Model Chapter 21.
Managerial Economics Demand Estimation & Forecasting.
Confidence intervals and hypothesis testing Petter Mostad
Analysis of Covariance adjusting for potential confounds.
Chapter 7: Demand Estimation and Forecasting McGraw-Hill/Irwin Copyright © 2011 by the McGraw-Hill Companies, Inc. All rights reserved.
Reserve Variability – Session II: Who Is Doing What? Mark R. Shapland, FCAS, ASA, MAAA Casualty Actuarial Society Spring Meeting San Juan, Puerto Rico.
BUILDING THE REGRESSION MODEL Data preparation Variable reduction Model Selection Model validation Procedures for variable reduction 1 Building the Regression.
Multivariate selective editing via mixture models: first applications to Italian structural business surveys Orietta Luzi, Guarnera U., Silvestri F., Buglielli.
A comparison of automatic model selection procedures for seasonal adjustment Cathy Jones.
Demand Forecasting Prof. Ravikesh Srivastava Lecture-11.
Demand Estimation & Forecasting. Direct Methods of Demand Estimation Consumer interviews – Range from stopping shoppers to speak with them to administering.
1 1 Chapter 6 Forecasting n Quantitative Approaches to Forecasting n The Components of a Time Series n Measures of Forecast Accuracy n Using Smoothing.
USING DEMETRA+ IN DAILY WORK SAUG – Luxembourg, 16 October 2012 Enrico INFANTE, Eurostat Unit B1: Quality, Methodology and Research.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Multiple Regression Chapter 14.
Workshop on MDG, Bangkok, Jan.2009 MDG 3.2: Share of women in wage employment in the non-agricultural sector National and global data.
Demand Management and Forecasting Chapter 11 Portions Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin.
Copyright 2010, The World Bank Group. All Rights Reserved. Producer prices, part 2 Measurement issues Business Statistics and Registers 1.
Forecasting Quantitative Methods. READ FIRST Outline Define Forecasting The Three Time Frames of Forecasting Forms of Forecast Movement Forecasting Approaches.
Statistics & Evidence-Based Practice
Quantified perceived and Expected Inflation in the Euro Area
Forecasting Methods Dr. T. T. Kachwala.
Data mining and statistical learning, lecture 1b
SIMPLE LINEAR REGRESSION MODEL
Product moment correlation
Problematic time series and how to treat them
BUSINESS MATHEMATICS & STATISTICS.
Lecturer Dr. Veronika Alhanaqtah
Model Selection, Seasonal Adjustment, Analyzing Results
Presumptions Subgroups (samples) of data are formed.
Exponential Smoothing
Presentation transcript:

Performance of Seasonal Adjustment Procedures Philip Hans Franses, Richard Paap, and Dennis Fok Econometric Institute Erasmus University Rotterdam

Outline This study concerns the seasonal adjustment of business and consumer survey [BCS] data. This study concerns the seasonal adjustment of business and consumer survey [BCS] data. Three methods of seasonal adjustment, that is, Census X12-ARIMA, TRAMO/SEATS and Dainties, are evaluated. Three methods of seasonal adjustment, that is, Census X12-ARIMA, TRAMO/SEATS and Dainties, are evaluated. We use simulated data and actual BCS data. We use simulated data and actual BCS data.

BCS data Business and consumer survey data are qualitative data. Business and consumer survey data are qualitative data. They are also bounded between 100 and -100 They are also bounded between 100 and -100 What are the time series properties? What are the time series properties?

Trend For the trend, a deterministic trend model is implausible. Similarly, a trend model of the unit root type is more plausible. For the trend, a deterministic trend model is implausible. Similarly, a trend model of the unit root type is more plausible. On the other hand, a unit root model can capture level shifts at unknown moments. On the other hand, a unit root model can capture level shifts at unknown moments.

Seasonality Strictly speaking, there should be no seasonality! Strictly speaking, there should be no seasonality! The surveys involve questions where respondents should compare the past months to future months. For the consumer surveys the comparison period is 12 months, whereas for the business surveys it is mostly 3 months. In all cases respondents are explicitly asked to disregard seasonal influences. The surveys involve questions where respondents should compare the past months to future months. For the consumer surveys the comparison period is 12 months, whereas for the business surveys it is mostly 3 months. In all cases respondents are explicitly asked to disregard seasonal influences. If there is seasonality, it is either due to the respondents’ inability to disregard seasonality or to features from the outside, like the weather or festivals. In sum, seasonal variation in BCS data is probably not strong, and also, it is unlikely to change much over time. If there is seasonality, it is either due to the respondents’ inability to disregard seasonality or to features from the outside, like the weather or festivals. In sum, seasonal variation in BCS data is probably not strong, and also, it is unlikely to change much over time.

Outliers BCS data may have outliers, either additive outliers or innovation outliers. BCS data may have outliers, either additive outliers or innovation outliers. When a unit-root trend model is imposed, all outlier observations will be of the additive type. When a unit-root trend model is imposed, all outlier observations will be of the additive type. Seasonal adjustment should be robust to an unknown but not too large amount of additive outliers at unknown locations. Seasonal adjustment should be robust to an unknown but not too large amount of additive outliers at unknown locations.

Main idea of our study We examine the link between models for seasonal data and the assumptions underlying the three seasonal adjustment methods. We examine the link between models for seasonal data and the assumptions underlying the three seasonal adjustment methods. The methods do not specifically assume a certain model, but it can be envisaged that some methods would work best for data which could be described by a certain model. The methods do not specifically assume a certain model, but it can be envisaged that some methods would work best for data which could be described by a certain model. For example, if the seasonal adjustment method would simply be that one subtracts seasonal means from the data, then data according to a model with constant deterministic seasonality would be best adjusted using that particular method. For example, if the seasonal adjustment method would simply be that one subtracts seasonal means from the data, then data according to a model with constant deterministic seasonality would be best adjusted using that particular method. In sum, we aim to see which type of data would be “best adjusted” by which method. In sum, we aim to see which type of data would be “best adjusted” by which method. We use simulated and actual data for this purpose. We use simulated and actual data for this purpose.

Diagnostics We use tests, which are based on the statistical relevance of parameters in certain regression models. We use tests, which are based on the statistical relevance of parameters in certain regression models. These diagnostics either focus on (i) does the seasonal adjustment method effectively remove seasonality?, (ii) does the seasonal adjustment method change features of the time series other than seasonality? These diagnostics either focus on (i) does the seasonal adjustment method effectively remove seasonality?, (ii) does the seasonal adjustment method change features of the time series other than seasonality? They concern seasonal unit roots, seasonality in variance, seasonality in means, and periodicity in AR parameters. They concern seasonal unit roots, seasonality in variance, seasonality in means, and periodicity in AR parameters.

Data generating processes We use six data generating processes in the simulations. These concern stable seasonality, unit root-type seasonality, time-varying parameter seasonality, and no seasonality. All have parameters that are commonly found in practice. We use six data generating processes in the simulations. These concern stable seasonality, unit root-type seasonality, time-varying parameter seasonality, and no seasonality. All have parameters that are commonly found in practice. We consider cases with and without outliers We consider cases with and without outliers

Findings (1) Census X12-ARIMA and TRAMO/SEATS methods are most robust to variations in the data generating process. This implies that in case one would not have any strong indications as to which model could best describe the raw (unadjusted) data, then these two methods are to be preferred. (2) Dainties method performs relatively well when the data show patterns that are close to deterministic seasonality.

Findings-2 (3) The effect of additive outliers on the performance of the adjustment methods is relatively small. Especially, the Census X-12 method seems to handle these outliers quite well. (4) All three adjustment methods are very sensitive to innovation outliers. It seems that none of the methods is capable of removing these types of outliers adequately from the series before seasonal adjustment. This is especially true if the series contains seasonal unit roots. (5) No differences between “first aggregation and then adjustment” and “first adjustment and then aggregation”

Findings BCS data When we compare the performance of the three seasonal adjustment methods on 300 series from the business and consumer surveys, we find that there are no marked differences in the performance of the three seasonal adjustment methods. When we compare the performance of the three seasonal adjustment methods on 300 series from the business and consumer surveys, we find that there are no marked differences in the performance of the three seasonal adjustment methods. Finally, the BCS data come close to “deterministic seasonality case”, and this implies that the Dainties method is very useful. Finally, the BCS data come close to “deterministic seasonality case”, and this implies that the Dainties method is very useful.