USING DEMETRA+ IN DAILY WORK SAUG – Luxembourg, 16 October 2012 Enrico INFANTE, Eurostat Unit B1: Quality, Methodology and Research.

Slides:



Advertisements
Similar presentations
Multiple Regression.
Advertisements

F-tests continued.
New innovative 3-way ANOVA a-priori test for direct vs. indirect approach in Seasonal Adjustment Enrico Infante * – Università degli studi di Napoli Federico.
3-way anova test test for direct vs. indirect approach in Seasonal Adjustment Enrico Infante * – Università degli studi di Napoli Federico II Dario Buono.
Enrico Infante* EUROSTAT, Unit G3: Short-Term Statistics; Tourism Dario Buono* EUROSTAT, Unit B1: Quality, Research and Methodology Workshop on Seasonal.
COMM 472: Quantitative Analysis of Financial Decisions
1 Chapter 4 Experiments with Blocking Factors The Randomized Complete Block Design Nuisance factor: a design factor that probably has an effect.
Chapter 4 Randomized Blocks, Latin Squares, and Related Designs
Internal documentation and user documentation
BA 555 Practical Business Analysis
Data Sources The most sophisticated forecasting model will fail if it is applied to unreliable data Data should be reliable and accurate Data should be.
Lecture 24: Thurs. Dec. 4 Extra sum of squares F-tests (10.3) R-squared statistic (10.4.1) Residual plots (11.2) Influential observations (11.3,
Chapter 11 Multiple Regression.
Topic 3: Regression.
X-12 ARIMA Eurostat, Luxembourg Seasonal Adjustment.
5-3 Inference on the Means of Two Populations, Variances Unknown
Chapter 9: Introduction to the t statistic
Richard M. Jacobs, OSA, Ph.D.
Introduction to Regression Analysis, Chapter 13,
Correlation and Regression
Regression Method.
Chapter 12 Multiple Regression and Model Building.
13-Jul-07 European Statistical System guidelines on seasonal adjustment: a major step towards PEEIs harmonisation C. Calizzani – G.L. Mazzi – R. Ruggeri.
03/05/2011 Seasonal Adjustment and DEMETRA+ ESTP course Dario Buono and Enrico Infante Unit B2 – Research and Methodology EUROSTAT 3 – 5 May 2011 © 2011.
United Nations Economic Commission for Europe Statistical Division Seasonal Adjustment Process with Demetra+ Anu Peltola Economic Statistics Section, UNECE.
© 2000 Prentice-Hall, Inc. Chap The Least Squares Linear Trend Model Year Coded X Sales
Part 2: Model and Inference 2-1/49 Regression Models Professor William Greene Stern School of Business IOMS Department Department of Economics.
Lesson Multiple Regression Models. Objectives Obtain the correlation matrix Use technology to find a multiple regression equation Interpret the.
Multiple Regression Petter Mostad Review: Simple linear regression We define a model where are independent (normally distributed) with equal.
Ketty Attal-Toubert and Stéphanie Himpens Insee, France 16th of November, 2011 ESTP course Demetra+ Demetra+ for X12 in Daily Work.
1 Departamento de Contas Nacionais / Serviço de Indicadores de Curto Prazo National Accounts Department / Short Term Statistics Unit Using Demetra+
May 2004 Prof. Himayatullah 1 Basic Econometrics Chapter 5: TWO-VARIABLE REGRESSION: Interval Estimation and Hypothesis Testing.
Ketty Attal-Toubert and Stéphanie Himpens Insee 22nd of June, 2011 An Overview of seasonal adjustment in the short term statistic department.
Eurostat Weighting and Estimation. Presented by Loredana Di Consiglio Istituto Nazionale di Statistica, ISTAT.
Testing seasonal adjustment with Demetra+ Dovnar Olga Alexandrovna The National Statistical Committee, Republic of Belarus.
April 2011 Testing Seasonal Adjustment with Demetra+ Ariunbold Shagdar National Statistical Office, Mongolia.
Correlation & Regression Analysis
DTC Quantitative Methods Bivariate Analysis: t-tests and Analysis of Variance (ANOVA) Thursday 14 th February 2013.
Chapter 15 The Chi-Square Statistic: Tests for Goodness of Fit and Independence PowerPoint Lecture Slides Essentials of Statistics for the Behavioral.
Copyright © 2010 Pearson Education, Inc Chapter Seventeen Correlation and Regression.
SASG 1 Seasonal Adjustment Steering Group Item Report from User Testing Group. Demetra+ compliance with users' requirements Presented by Dario Buono.
The Box-Jenkins (ARIMA) Methodology
The Mixed Effects Model - Introduction In many situations, one of the factors of interest will have its levels chosen because they are of specific interest.
22/06/2011 Using DEMETRA+ Enrico INFANTE - ESTAT Unit B2 – Methodology and Research Task Force: SA tools User testing group 22/06/2011 Paris - INSEE.
USING DEMETRA+ IN DAILY WORK SAUG – Luxembourg, 16 October 2012 Enrico INFANTE, Eurostat Unit B1: Quality, Methodology and Research.
Testing Seasonal Adjustment of the Price Index for tomatoes with Demetra+ Kumpeisova Dinara Agency of Statistics of the Republic of Kazakhstan, Kazakhstan.
Chapter 9: Introduction to the t statistic. The t Statistic The t statistic allows researchers to use sample data to test hypotheses about an unknown.
Ketty Attal-Toubert and Stéphanie Himpens Insee 22nd of June, 2011 Using SAS to implement additional tools.
Forecasting. Model with indicator variables The choice of a forecasting technique depends on the components identified in the time series. The techniques.
JDemetra+: Latest features by the BBk (X-11 part) SAEG Meeting, Frankfurt am Main, 7 June 2016 Andreas Lorenz, Deutsche Bundesbank, Statistics Department.
Stats Methods at IC Lecture 3: Regression.
F-tests continued.
DTC Quantitative Methods Bivariate Analysis: t-tests and Analysis of Variance (ANOVA) Thursday 20th February 2014  
Chow test.
Chapter 13 Created by Bethany Stubbe and Stephan Kogitz.
Chapter 4: Seasonal Series: Forecasting and Decomposition
CHAPTER 29: Multiple Regression*
Multiple Regression Models
How to select regressors and specifications in Demetra+?
Hungarian practice on chain-linking and its implication for SA
Seasonal adjustment with Demetra+
STATISTICAL AGENCY UNDER PRESIDENT OF THE REPUBLIC OF TAJIKISTAN
Euro-indicators Working Group
LAMAS Working Group 5-6 October 2016
New innovative 3-way ANOVA a-priori test for direct vs
Testing seasonal adjustment using Demetra+
Model Selection, Seasonal Adjustment, Analyzing Results
Ermurachi Galina National Bureau of Statistics, Republic of Moldova
Issues on Seasonal Adjustment in the EECCA countries
Using JDemetra+ at STATEC
Presentation transcript:

USING DEMETRA+ IN DAILY WORK SAUG – Luxembourg, 16 October 2012 Enrico INFANTE, Eurostat Unit B1: Quality, Methodology and Research

2 Summary Price Series –Price Volatility Analysis Production Series –Seasonal Adjustment –SARIMA Forecasts –Current vs. Concurrent Adjustment –Direct vs. Indirect approach IB test –In the future… SAUG – Luxembourg, 16 October 2012 Enrico Infante

3 The study is conducted on Italian food and agricultural data SAUG – Luxembourg, 16 October 2012 Enrico Infante Price Volatility Analysis PRICE SERIES Price Volatility Analysis

4 How many series? Sector Price Volatility Analysis Milk1 Butchering10 Agro-food48 Ichthyic12 Total71 SAUG – Luxembourg, 16 October 2012 Enrico Infante Price Volatility Analysis

5 The basic idea is to check whether the price of a determined product in a determined period is outside the expected trend. The procedure follows three main steps: 1.Model the series without the last three observations using a SARIMA(p,d,q)(P,D,Q) 2.Using the model identified during step 1 to produce forecast intervals for the three observations not considered in step 1 3.Check whether the price observed is inside or outside the forecast interval If the price observed is outside the interval, then there is high volatility SAUG – Luxembourg, 16 October 2012 Enrico Infante

6 The procedure is the follow SAUG – Luxembourg, 16 October 2012 Enrico Infante Price Series SARIMA model without 3 obs. Forecast intervals Detect the volatility degree Price Volatility Analysis

7 Example: Parmigiano Reggiano and Grana Padano There is low volatility for the "Grana Padano", as the observed price is in the forecasted interval There is high volatility for the "Parmigiano Reggiano", as the observed price is not within the forecasted interval SAUG – Luxembourg, 16 October 2012 Enrico Infante Price Volatility Analysis

8 Special cases (e.g. fruit) In some cases (typically for the fruit series) there are data just for a certain period of the year. In these cases the available data are considered consecutive, and no seasonal and/or calendar effects are considered SAUG – Luxembourg, 16 October 2012 Enrico Infante Price Volatility Analysis

9 The study is conducted on Italian food and agricultural data SAUG – Luxembourg, 16 October 2012 Enrico Infante Seasonal Adjustment Forecast Direct/Indirect approach Current/Concurrent Adjustment PRODUCTION SERIES Seasonal Adjustment

10 How many series? SectorSA and Forecast Milk5 Butchering21 Ichthyic1 Import/Export Agro-food99 Import/Export Ichthyic20 Total145 SAUG – Luxembourg, 16 October 2012 Enrico Infante Seasonal Adjustment

11 Seasonal Adjustment The series are seasonally adjusted following the ESS guidelines A knowledge of the sectors is a key part for modelling outliers, calendar effects, etc. The series are modelled using the TRAMO/SEATS modules of Demetra+ The models detected from the automatic procedure (RSA4) are modified, when necessary, in order to get better results If necessary, the earliest years are removed from the model SAUG – Luxembourg, 16 October 2012 Enrico Infante

12 SARIMA Forecasts The study focuses on the forecasts of the series The first step is to identify the SARIMA model  Demetra+ forecasts The forecasts are sometimes "adjusted" basing on qualitative information Example: Milk The total milk produced in Italy is more or less the same amount for every production year (from April to March). So the values obtained from Demetra+ are adjusted in order to get the same total (10883,073) SAUG – Luxembourg, 16 October 2012 Enrico Infante

13 Current vs. Concurrent Adjustment The way in which Seasonal Adjustment is carried out has implications for the revisions of seasonally adjusted data There are monthly series that are updated every quarter, so each quarter there are 3 new observations Usually there are no revisions on the series, and even if there are some, they are very small SAUG – Luxembourg, 16 October 2012 Enrico Infante

14 Current vs. Concurrent Adjustment A partial Concurrent Adjustment strategy is chosen, with an update of the parameters coefficient and outliers in the last year SAUG – Luxembourg, 16 October 2012 Enrico Infante The main issue arises when the chosen model does not produce good forecasts, even if the model seems to be good. In that case the model is re-estimated in order to get better results in terms of forecasts

15 Direct vs. Indirect approach Some series are aggregated at different levels In order to decide which approach to follow, an a priori test has been used The main advantage of using an a priori test is that the choice is made on statistical bases without running any seasonal adjustment procedure The test used is the so-called IB test, that is in line with the ESS guidelines on Seasonal Adjustment: when the series composing the aggregate have common similar seasonal patterns, a Direct approach would be used The test is performed using R scripts SAUG – Luxembourg, 16 October 2012 Enrico Infante

16 Direct vs. Indirect approach – IB test The basic idea of the IB test is stated in Infante and Buono (2012)Infante and Buono (2012) The classic test for moving seasonality is based on a 2-way ANOVA test, where the two factors are the time frequency (usually months or quarters) and the years. This test is based on a 3-way ANOVA model, where the three factors are the time frequency, the years and the series The variables tested are the de-trended series, where the trend is determined by applying a Hodrick-Prescott filter for each series The notation SI is kept for remarking the fact that it is a de-trended series SAUG – Luxembourg, 16 October 2012 Enrico Infante

17 Direct vs. Indirect approach – IB test The model is: Where: a i, i=1,…,M, represents the numerical contribution due to the effect of the i-th time frequency (usually M=12 or M=4) b j, j=1,…,N, represents the numerical contribution due to the effect of the j-th year c k, k=1,…,S, represents the numerical contribution due to the effect of the k-th series of the aggregate The residual component term e ijk (assumed to be normally distributed with zero mean, constant variance and zero covariance) represents the effect on the values of the SI of the whole set of factors not explicitly taken into account in the model SAUG – Luxembourg, 16 October 2012 Enrico Infante

18 Direct vs. Indirect approach – IB test The test is based on the decomposition of the variance of the observations: Between time frequencies variance Between years variance Between series variance Residual variance SAUG – Luxembourg, 16 October 2012 Enrico Infante

19 Direct vs. Indirect approach – IB test The table for the ANOVA test VARMeandfSum of Squares SAUG – Luxembourg, 16 October 2012 Enrico Infante

20 Direct vs. Indirect approach – IB test The null hypothesis is made by taking into consideration that there is no change in seasonality over the series The test statistic is the ratio of the between series variance and the residual variance, and it follows a Fisher-Snedecor distribution with (S-1) and (MNS-1)-(M-1)-(N-1)-(S-1) degrees of freedom Rejecting the null hypothesis is to say that the pure Direct Approach should be avoided, and an Indirect Approach should be considered SAUG – Luxembourg, 16 October 2012 Enrico Infante

21 Direct vs. Indirect approach – IB test An example: butchering pork SAUG – Luxembourg, 16 October 2012 Enrico Infante

22 Direct vs. Indirect approach – IB test An example: butchering pork SAUG – Luxembourg, 16 October 2012 Enrico Infante VARMean Squaredf Months Years Series Residual There is no evidence of common seasonal patterns between the series at 5 per cent level An Indirect approach is recommended

23 In the future… From Demetra+ to Jdemetra+!!! SAUG – Luxembourg, 16 October 2012 Enrico Infante

24 In the future… SAUG – Luxembourg, 16 October 2012 Enrico Infante Assessment for residual seasonality Additive aggregate What if the aggregation function is different? Test a priori Java code (older version) R code

25 Questions Many thanks for your attention!!! SAUG – Luxembourg, 16 October 2012 Enrico Infante Your questions and comments are very welcome!