Copula approach to modeling of ARMA and GARCH models residuals Anna Petričková FSTA 2012, Liptovský Ján 31.01.2012.

Slides:



Advertisements
Similar presentations
FINANCIAL TIME-SERIES ECONOMETRICS SUN LIJIAN Feb 23,2001.
Advertisements

Autocorrelation Functions and ARIMA Modelling
Time Series Analysis -- An Introduction -- AMS 586 Week 2: 2/4,6/2014.
Dates for term tests Friday, February 07 Friday, March 07
INTRODUCTION TO COPULAS
Threshold Autoregressive. Several tests have been proposed for assessing the need for nonlinear modeling in time series analysis Some of these.
Use of Business Tendency Survey Results for Forecasting Industry Production in Slovakia Use of Business Tendency Survey Results for Forecasting Industry.
Part II – TIME SERIES ANALYSIS C5 ARIMA (Box-Jenkins) Models
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Slide 1 DSCI 5340: Predictive Modeling and Business Forecasting Spring 2013 – Dr. Nick Evangelopoulos Lecture 7: Box-Jenkins Models – Part II (Ch. 9) Material.
Time Series Building 1. Model Identification
Pair-copula constructions of multiple dependence Workshop on ''Copulae: Theory and Practice'' Weierstrass Institute for Applied Analysis and.
Models for construction of multivariate dependence Workshop on Copulae and Multivariate Probability distributions in Finance – Theory, Applications,
Ch11 Curve Fitting Dr. Deshi Ye
The General Linear Model. The Simple Linear Model Linear Regression.
STAT 497 LECTURE NOTES 8 ESTIMATION.
An Introduction to Time Series Ginger Davis VIGRE Computational Finance Seminar Rice University November 26, 2003.
STAT 497 APPLIED TIME SERIES ANALYSIS
Non-Seasonal Box-Jenkins Models
Forecasting JY Le Boudec 1. Contents 1.What is forecasting ? 2.Linear Regression 3.Avoiding Overfitting 4.Differencing 5.ARMA models 6.Sparse ARMA models.
Modeling Cycles By ARMA
Data Sources The most sophisticated forecasting model will fail if it is applied to unreliable data Data should be reliable and accurate Data should be.
Additional Topics in Regression Analysis
Bootstrap in Finance Esther Ruiz and Maria Rosa Nieto (A. Rodríguez, J. Romo and L. Pascual) Department of Statistics UNIVERSIDAD CARLOS III DE MADRID.
1 Ka-fu Wong University of Hong Kong Pulling Things Together.
Prediction and model selection
ARIMA Forecasting Lecture 7 and 8 - March 14-16, 2011
Financial Econometrics
Chapter 11 Multiple Regression.
A First Peek at the Extremogram: a Correlogram of Extremes 1. Introduction The Autocorrelation function (ACF) is widely used as a tool for measuring Serial.
Non-Seasonal Box-Jenkins Models
Archimedean Copulas Theodore Charitos MSc. Student CROSS.
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
P á l Rakonczai, L á szl ó Varga, Andr á s Zempl é ni Copula fitting to time-dependent data, with applications to wind speed maxima Eötvös Loránd University.
BOX JENKINS METHODOLOGY
Traffic modeling and Prediction ----Linear Models
STAT 497 LECTURE NOTES 2.
TIME SERIES ANALYSIS Time Domain Models: Red Noise; AR and ARMA models LECTURE 7 Supplementary Readings: Wilks, chapters 8.
Random Regressors and Moment Based Estimation Prepared by Vera Tabakova, East Carolina University.
Various topics Petter Mostad Overview Epidemiology Study types / data types Econometrics Time series data More about sampling –Estimation.
Maximum Likelihood Estimation Methods of Economic Investigation Lecture 17.
K. Ensor, STAT Spring 2005 Model selection/diagnostics Akaike’s Information Criterion (AIC) –A measure of fit plus a penalty term for the number.
Week 21 Stochastic Process - Introduction Stochastic processes are processes that proceed randomly in time. Rather than consider fixed random variables.
Generalised method of moments approach to testing the CAPM Nimesh Mistry Filipp Levin.
Random Series / White Noise. Notation WN (white noise) – uncorrelated iid independent and identically distributed Y t ~ iid N( ,  ) Random Series 
Chapter 7 Point Estimation of Parameters. Learning Objectives Explain the general concepts of estimating Explain important properties of point estimators.
Problems with the Durbin-Watson test
STAT 497 LECTURE NOTE 9 DIAGNOSTIC CHECKS 1. After identifying and estimating a time series model, the goodness-of-fit of the model and validity of the.
MULTIVARIATE TIME SERIES & FORECASTING 1. 2 : autocovariance function of the individual time series.
Estimation Method of Moments (MM) Methods of Moment estimation is a general method where equations for estimating parameters are found by equating population.
Forecasting (prediction) limits Example Linear deterministic trend estimated by least-squares Note! The average of the numbers 1, 2, …, t is.
Seasonal ARMA forecasting and Fitting the bivariate data to GARCH John DOE.
Statistics 349.3(02) Analysis of Time Series. Course Information 1.Instructor: W. H. Laverty 235 McLean Hall Tel:
1 Chapter 5 : Volatility Models Similar to linear regression analysis, many time series exhibit a non-constant variance (heteroscedasticity). In a regression.
Review and Summary Box-Jenkins models Stationary Time series AR(p), MA(q), ARMA(p,q)
The Box-Jenkins (ARIMA) Methodology
FORECASTING METHODS OF NON- STATIONARY STOCHASTIC PROCESSES THAT USE EXTERNAL CRITERIA Igor V. Kononenko, Anton N. Repin National Technical University.
Module 4 Forecasting Multiple Variables from their own Histories EC 827.
Computacion Inteligente Least-Square Methods for System Identification.
Time Series Analysis PART II. Econometric Forecasting Forecasting is an important part of econometric analysis, for some people probably the most important.
Stochastic Process - Introduction
Ch8 Time Series Modeling
Chapter 6: Autoregressive Integrated Moving Average (ARIMA) Models
STAT 497 LECTURE NOTE 9 DIAGNOSTIC CHECKS.
CHAPTER 16 ECONOMIC FORECASTING Damodar Gujarati
Forecasting the Return Volatility of the Exchange Rate
STOCHASTIC HYDROLOGY Random Processes
3.2. SIMPLE LINEAR REGRESSION
CH2 Time series.
BOX JENKINS (ARIMA) METHODOLOGY
Presentation transcript:

Copula approach to modeling of ARMA and GARCH models residuals Anna Petričková FSTA 2012, Liptovský Ján

Introduction The state-of-art overview  Overview of the ARMA and GARCH models  The test of homoscedasticity  Copula and autocopula  Goodness of fit test for copulas Application on the hydrological data series  Modeling of dependence structure of the ARMA and GARCH models residuals using autocopulas.  Constructing of improved quality models for the original time series. Conclusion

Linear stochastic models – model ARMA For example ARMA models X t -  1 X t-1 -  2 X t  p X t-p = Z t +  1 Z t-1 +  2 Z t  q Z t-q where Z t, t = 1,..., n are i.i.d. process, coefficients  1,...,  p (AR coefficients) and  1,...,  q (MA coefficients) - unknown parameters. Special cases:  If p = 0, we get MA process  If q = 0, we get AR process

ARCH and GARCH model ARCH – AutoRegressive Conditional Heteroscedasticity Let x t is time series in the form x t = E[x t |  t-1 ] +  t where   t-1 is information set containing all relevant information up to time t-1  predictable part E[x t |  t-1 ] is modeled with linear ARMA models   t is unpredictable part with E[  t |  t-1 ] = 0, E[  t 2 ] =  2. Model of  t in the form with where v t ( i.i.d. process with E( t ) = 0 and D( t ) = 1 ) is called ARCH(m), m is order of the model. Boundaries for parameters:

ARCH and GARCH model GARCH – Generalized ARCH model.  t is time series with E[  t 2 ] =  2 in the form (1) where (2) and {v t } is white noise process with E( t ) = 0 and D( t ) = 1. Time series  t  generated by (1) and (2) is called generalized ARCH of order p, q, and denote GARCH(p, q). Boundaries for parameters: and also

McLeod and Li test of Homoscedasticity (1983) Test statistic where n is a sample size, r k 2 is the squared sample autocorrelation of squared residual series at lag k and m is moderately large. When applied to the residuals from an ARMA (p,q) model, the McL test statistic follows distribution asymptotically.

2-dimensional copula is a function C: [0, 1] 2  [0, 1], C(0, y) = C(x, 0) = 0, C(1, y) = C(x, 1) = x for all x, y  [0, 1] and C(x 1, y 1 ) + C(x 2, y 2 ) − C(x 1, y 2 ) − C(x 2, y 1 )  0 for all x 1, x 2, y 1, y 2  [0, 1], such that x 1  x 2, y 1  y 2. Let F is joint distribution function of 2-dimensional random vectors (X, Y) and F X, F Y are marginal distribution functions. Then F(x, y) = C (F X (x), F Y (y)). Copula C is only one, if X and Y are continuous random variables. utocopula Let X t is strict stationary time series and k  Z +, then autocopula C X,k is copula of random vector (X t, X t-k ). Copula and autocopula

In our work we used families: Archimedean class – Gumbel, strict Clayton, Frank, Joe BB1 convex combinations of Archimedean copulas Extreme Value (EV) Copulas class – Gumbel A, Galambos Copula and autocopula

Let {(x j, y j ), j = 1, …, n } be n modeled 2-dimensional observations, F X, F Y their marginal distribution functions and F their joint distribution function. The class of copulas C  is correctly specified if there exists  0 so that White (H. White: Maximum likelihood estimation of misspecified models. Econometrica 50, 1982, pp. 1 – 26) showed that under correct specification of the copula class C  holds: where and c  is the density function.  yF,xFCy,xF YX 0   Goodness of fit test for copulas

The testing procedure, which is proposed in A. Prokhorov: A goodness-of-fit test for copulas. MPRA Paper No. 9998, 2008 is based on the empirical distribution functions and on a consistent estimator of vector of parameters  0. To introduce the sample versions of A and B put:  ˆ Goodness of fit test for copulas

Put: Under the hypothesis of proper specification the statistics has asymptotical distribution N(0, V), where V is estimated by Statistics is asymptotically as  D ˆ n    kk Goodness of fit test for copulas

S. Grønneberg, N. L. Hjort : The copula information criterion. Statistical Research Report, E-print 7, 2008 Takeuchi criterion TIC

Modeling of dependence of residuals of the ARMA and GARCH models with autocopulas performed using the system MATHEMATICA, version 8 applied the significance level 0.05 from each of the considered time series omitted 12 the most recent values (that were left for purposes of subsequent investigations of the out-of-the-sample forecasting performance of the resulting models) 14 hydrological data series – (monthly) Slovak rivers‘ flows Application

ARMA At first, we have ‘fitted’ these real data series with the ARMA models (seasonally adjusted). We have selected the best model on the basis of the BIC criterion (case 1). We have fitted autocopulas to the subsequent pairs of the above mentioned residuals of time series. Then we have selected the optimal models that attain the minimum of the TIC criterion. Finally we have applied the best autocopulas instead of the white noise into the original model (case 2). McLeod and Li test of homoscedasticity The residuals of the ARMA models should be homoscedastic, that was checked with McLeod and Li test of homoscedasticity. ARCH/GARCH When homoscedasticity in residuals has been rejected, we have fitted them with ARCH/GARCH models (case 3). Sequence of procedures

Archimedean copulas (AC)1 convex combinations of AC13 extreme value copulas0 The best copulas

Instead of, (which is the strict white noise process with E[e t ] = 0, D[e t ] =   e ), we have used the autocopulas that we have chosen as the best copulas above (for each real time series). To compare the quality of the optimal models in all 3 categories we have computed their standard deviations (  ) as well as prediction error RMSE (root mean square error). Improved models rejected For all 14 (seasonally adjusted) data series fitted with ARMA models McLeod and Li test rejected homoscedasticity in residuals, so we fitted them with ARCH/GARCH models.

Comparison - description data sigma of residuals ARMA without copulaARMA with copulaARCH/GARCH Belá - Podbanské2,402012,409132,35738 Čierny Váh1,740831,76881,86467 Dunaj - Bratislava0,554220,553720,86239 Dunajec - Červený Kláštor1,189011,197252,37627 Handlovka - Handlová0,248180,253790,54604 Hnilec - Jalkovce0,348860,349850,71544 Hron - BB0,136260,130720,18785 Kysuca - Čadca0,361730,365150,82324 Litava - Plastovce0,108980,092810,18617 Morava - Moravský Ján0,597580,603720,86566 Orava - Drieňová0,106610,090830,27903 Poprad - Chmelnica0,66530,665181,23505 Topľa - Hanušovce0,420210,426480,61885 Torysa - Košické Olšany0,415710,415380,79986

Comparison - prediction data RMSE ARMA without copulaARMA with copulaARCH/GARCH Belá - Podbanské1,635571,665972,72753 Čierny Váh1,251571,402431,36957 Dunaj - Bratislava0,374160,313380,94412 Dunajec - Červený Kláštor1,824411,851332,48126 Handlovka - Handlová0,276430,257230,35238 Hnilec - Jalkovce0,433780,422890,88977 Hron - BB0,079290,079020,22236 Kysuca - Čadca0,373370,441470,97517 Litava - Plastovce0,080670,080570,29661 Morava - Moravský Ján0,261690,355110,79046 Orava - Drieňová0,099360,098880,26276 Poprad - Chmelnica0,502490,497291,1649 Topľa - Hanušovce0,577530,576120,56784 Torysa - Košické Olšany0,571040,570750,97139

The best descriptive properties belonged to classical ARMA models and ARMA models with copulas, only in 1 case to ARCH/GARCH model. The best predictive properties had ARMA models with copulas (9) and 5 classical ARMA models. ARCH/GARCH models had the worst RMSE of residuals for all 14 time series. Improved models

Conclusions We have found out that ARCH/GARCH models are not very suitable for fitting of rivers’ flows data series. Much better attempt was fitting them with classical linear ARMA models and also ARMA models with copulas, where copulas are able to capture wider range of nonlinearity. In future we also want to describe real time series with non- Archimedean copulas like Gauss, Student copulas, Archimax copulas etc. We also want to use regime-switching model with regimes determined by observable or unobservable variables and compare it with the others.

Thank you for your attention.