1 Seasonal Adjustments: Causes of Revisions Øyvind Langsrud Statistics Norway

Slides:



Advertisements
Similar presentations
Issues in Modeling and Adjusting Calendar Effects in Economic Time Series Brian C. Monsell U. S. Census Bureau ICES III June 2007 U S C E N S U S B U R.
Advertisements

Modeling Recession Effects and the Consequences for Seasonal Adjustment Demetra Lytras Office of Statistical Methods and Research for Economic Programs.
Seasonal Adjustment of National Index Data at International Level
SADNA – Ad Auction lecture #3 Time Series Yishay Mansour Mariano Schain.
Economics 20 - Prof. Anderson1 Testing for Unit Roots Consider an AR(1): y t =  +  y t-1 + e t Let H 0 :  = 1, (assume there is a unit root) Define.
Economics 20 - Prof. Anderson1 Time Series Data y t =  0 +  1 x t  k x tk + u t 2. Further Issues.
Performance of Seasonal Adjustment Procedures Philip Hans Franses, Richard Paap, and Dennis Fok Econometric Institute Erasmus University Rotterdam.
Internal documentation and user documentation
1 Spreadsheet Modeling & Decision Analysis: A Practical Introduction to Management Science, 3e by Cliff Ragsdale.
(ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics.
1Prof. Dr. Rainer Stachuletz Testing for Unit Roots Consider an AR(1): y t =  +  y t-1 + e t Let H 0 :  = 1, (assume there is a unit root) Define 
T T18-05 Trend Adjusted Exponential Smoothing Forecast Purpose Allows the analyst to create and analyze the "Trend Adjusted Exponential Smoothing"
Quantitative Business Forecasting Introduction to Business Statistics, 5e Kvanli/Guynes/Pavur (c)2000 South-Western College Publishing.
United Nations Statistics Division Seasonal adjustment Training Workshop on the Compilation of Quarterly National Accounts for Economic Cooperation Organization.
X-12 ARIMA Eurostat, Luxembourg Seasonal Adjustment.
1 BABS 502 Moving Averages, Decomposition and Exponential Smoothing Revised March 11, 2011.
Components of Time Series, Seasonality and Pre-conditions for Seasonal Adjustment Anu Peltola Economic Statistics Section, UNECE UNECE Workshop on Short-Term.
(c) Martin L. Puterman1 BABS 502 Regression Based Forecasting February 28, 2011.
Temperature correction of energy consumption time series Sumit Rahman, Methodology Advisory Service, Office for National Statistics.
Introduction to Seasonal Adjustment
Eurostat Seasonal Adjustment. Topics Motivation and theoretical background (Øyvind Langsrud) Seasonal adjustment step-by-step (László Sajtos) (A few)
Hydrologic Modeling: Verification, Validation, Calibration, and Sensitivity Analysis Fritz R. Fiedler, P.E., Ph.D.
04/05/2011 Seasonal Adjustment and DEMETRA+ ESTP course EUROSTAT 3 – 5 May 2011 Dario Buono and Enrico Infante Unit B2 – Research and Methodology © 2011.
1 Spreadsheet Modeling & Decision Analysis: A Practical Introduction to Management Science, 3e by Cliff Ragsdale.
USING DEMETRA+ IN DAILY WORK SAUG – Luxembourg, 16 October 2012 Enrico INFANTE, Eurostat Unit B1: Quality, Methodology and Research.
United Nations Economic Commission for Europe Statistical Division Seasonal Adjustment Process with Demetra+ Anu Peltola Economic Statistics Section, UNECE.
Ronald van der Stegen Reducing statistical discrepancy between direct and indirect GDP.
Time Series Analysis and Forecasting
© 2000 Prentice-Hall, Inc. Chap The Least Squares Linear Trend Model Year Coded X Sales
United Nations Economic Commission for Europe Statistical Division Introduction to Seasonal Adjustment Based on the: Australian Bureau of Statistics’ Information.
Ketty Attal-Toubert and Stéphanie Himpens Insee, France 16th of November, 2011 ESTP course Demetra+ Demetra+ for X12 in Daily Work.
 2007 National Council on Compensation Insurance, Inc. All Rights Reserved. 1 “Forecasting Workers Compensation Severities And Frequency Using The Kalman.
1 Departamento de Contas Nacionais / Serviço de Indicadores de Curto Prazo National Accounts Department / Short Term Statistics Unit Using Demetra+
1 Forecasting with Intervention: Tourism in Croatia Ante Rozga, Toni Marasović, Josip Arnerić University of Split, Croatia.
Anu Peltola Economic Statistics Section, UNECE
Ketty Attal-Toubert and Stéphanie Himpens Insee 22nd of June, 2011 An Overview of seasonal adjustment in the short term statistic department.
1 The Two-Factor Mixed Model Two factors, factorial experiment, factor A fixed, factor B random (Section 13-3, pg. 495) The model parameters are NID random.
April 2011 Testing Seasonal Adjustment with Demetra+ Ariunbold Shagdar National Statistical Office, Mongolia.
Harmonisation of Seasonal Adjustment Methods in EU and OECD Countries Ronny Nilsson Statistics Directorate.
Round Table Round Table Current State of Seasonal Adjustment in Countries/ UNECE Workshop on Short-Term Statistics (STS) and Seasonal Adjustment 14 – 17.
A comparison of automatic model selection procedures for seasonal adjustment Cathy Jones.
Normally Distributed Seasonal Unit Root Tests D. A. Dickey North Carolina State University Note: this presentation is based on the paper “Normally Distributed.
Towards a seasonal adjustment and a revision policy Anu Peltola Economic Statistics Section, UNECE UNECE Workshop on Seasonal Adjustment 20 – 23 February.
1 BABS 502 Moving Averages, Decomposition and Exponential Smoothing Revised March 14, 2010.
Economics 173 Business Statistics Lecture 27 © Fall 2001, Professor J. Petry
1 1 Chapter 6 Forecasting n Quantitative Approaches to Forecasting n The Components of a Time Series n Measures of Forecast Accuracy n Using Smoothing.
USING DEMETRA+ IN DAILY WORK SAUG – Luxembourg, 16 October 2012 Enrico INFANTE, Eurostat Unit B1: Quality, Methodology and Research.
Testing Seasonal Adjustment of the Price Index for tomatoes with Demetra+ Kumpeisova Dinara Agency of Statistics of the Republic of Kazakhstan, Kazakhstan.
*This presentation represents the author’s personal opinion and does not necessarily reflect the *view of the Deutsche Bundesbank or its staff. Sources.
Model based approach for estimating and forecasting crop statistics: Update, consolidation and improvement of AGROMET model “AGROMET Project” Working Group.
1 Exponential smoothing in the telecommunications data Everette S. Gardner, Jr.
Managerial Decision Modeling 6 th edition Cliff T. Ragsdale.
——Comparing between the methods based on X-12ARIMA and TRAMO/SEATS By Ming-Fang Zhang Suo-Xian Pan IAOS Conference, Shanghai, October, 2008 Study.
Carsten Boldsen Hansen Economic Statistics Section, UNECE
Shohreh Mirzaei Yeganeh United Nations Industrial Development
4th Joint EU-OECD Workshop on BCS, Brussels, October 12-13
Migration to JDemetra+
Statistics in WR: Lecture 12
Difficulties in Seasonal Adjustment
How to select regressors and specifications in Demetra+?
New Demetra 2.2 Euro-indicators Working Group
STATISTICAL AGENCY UNDER PRESIDENT OF THE REPUBLIC OF TAJIKISTAN
T18-08 Calculate MAD, MSE Purpose Allows the analyst to create and analyze the MAD and MSE for a forecast. A graphical representation of history and.
Faiz Alsuhail 21 of June, Frankfurt
Problematic time series and how to treat them
Model Selection, Seasonal Adjustment, Analyzing Results
Ermurachi Galina National Bureau of Statistics, Republic of Moldova
Summary of methods presented at the CMBF
Issues on Seasonal Adjustment in the EECCA countries
Presentation transcript:

1 Seasonal Adjustments: Causes of Revisions Øyvind Langsrud Statistics Norway

Seasonally adjustment based on X12-ARIMA Two-step procedure: regARIMA + trend and seasonal filters regARIMA –Seasonal ARIMA model with regression parameters –Holiday and trading day adjustment –Produce forecasts for use in the next step Important choices –Type of ARIMA model –Regression parameters: Holidays and trading days –How to handle outliers langsrud_pdf_movie.pdf

Revision The revision is caused by updated models and parameters Revision is a problem –Can be confusing –Not easy to communicate Choosing seasonal adjustment methodology can be viewed as a question of balancing –the requirement of optimal seasonal adjustment at each time point –against the requirement of minimal revisions. Can revision be reduced without reducing the quality of the adjustment?

Revision on log-scale A t = seasonally adjusted series. Y t = original series A t|t+h is the seasonal adjustment of Y t calculated from the series where Y t+h is the last observation OneMonthRevision t = ( log(A t|t+1 ) – log(A t|t ) ) *100%

regARIMA modeling: Comparison by out-of-sample forecasts Comparison of methods when model selection is involved is not straightforward –Standard model fit criteria do not take into account the selection process –Fair comparison by out-of-sample forecasts X-12-ARIMA make use forecasts

Relative forecasting error Y t+h|t is the forecast of Y t+h calculated from the series where Y t is the last observation Example: Y t+h|t =101, Y t+h =100 –100% * ( )/101 = % –100% * (log(101)-log(100)) = % –100% * ( )/100 = %

% opposite log- increase denominator based Other examples

% opposite log- increase denominator based Other examples

RMSE root mean square error

ARIMA model is held fixed  from a single analysis of the whole series by using the ARIMA model according to automdl. Outliers are held fixed  from the same single analysis as above. Trading days: six parameters  = maximum number of parameters. Eastern is handled as usual at Statistics Norway  up to three parameters. Base method:

ARIMA model is held fixed  from a single analysis of the whole series by using the ARIMA model according to automdl. Outliers are held fixed  from the same single analysis as above. Trading days: six parameters  = maximum number of parameters. Eastern is handled as usual at Statistics Norway  up to three parameters. Comparing methods by deviating from the base method

Automatic ARIMA model selection: automdl vs pickmdl automdl as default in X-12-ARIMA pickmdl selects ARIMA model from five candidates (0 1 1)(0 1 1) * (0 1 2)(0 1 1) X (2 1 0)(0 1 1) X (0 2 2)(0 1 1) X (2 1 2)(0 1 1) X

Automatic outlier detection: critical=4 vs critical=8 t-statistic limit Both additive outliers and level shifts Critical=4 is close to default in X-12-ARIMA Critical=8: outliers are extremely rare

Trading day: 6 parameters vs other choices 6 parameters = maximum number of parameters Other choices – Production index –Standard choice at Statistics Norway based on industrial knowledge –0, 1, 5 and 6 parameters Other choices – Index of household consumption of goods –1 parameter, weekdays vs Sundays/Saturdays

Moving holiday: Easter vs no Easter Method in Norway –Up to three parameters: Before Easter, Easter, After Easter –Selection based on model fit an t-tests History analysis –Exactly as today’s Norwegian procedure

Conclusion Automatic outlier detection and ARIMA model selection leads to revision problems –Problems can be reduced by using pickmdl and by increasing outlier detection limit –Better solutions by fixing outliers and models Holidays and trading days are less important –Norway’s procedure may be improved –More investigation will be performed

Findley DF (2005), "Some Recent Developments and Directions in Seasonal", JOURNAL OF OFFICIAL STATISTICS, Vol 21, 343–365 Findley DF, Monsell BC, Bell WR, Otto MC, and Chen BC (1998), "New capabilities and methods of the X-12-ARIMA seasonal-adjustment program", JOURNAL OF BUSINESS & ECONOMIC STATISTICS, Vol. 16, Roberts CG, Holan SH, Monsell B (2010), "Comparison of X-12-ARIMA Trading Day and Holiday Regressors with Country Specific Regressors", JOURNAL OF OFFICIAL STATISTICS, Vol 26, US Census Bureau (2011), "X-12-ARIMA Reference Manual", UK - The Office for National Statistics (2007), "Guide to Seasonal Adjustment with X-12-ARIMA **DRAFT**", analysis/guide-to-seasonal-adjustment.pdf Eurostat - Methodologies and working papers (2009) "Ess Guidelines on Seasonal Adjustment",

X12-ARIMA output series d11 = Y / e18, in our modelleing e18 = e10*d18 Y = Original series d11 = Final seasonally adjusted data ( A t ) e18 = Final adjustment ratios d10 = Final seasonal factors d18 = Combined holiday and trading day factors Can calculate revisions in e18, d10, d18 similar to d11 d11revision = - e18revision