Predicting volatility: a comparative analysis between GARCH Models and Neural Network Models MCs Student: Miruna State Supervisor: Professor Moisa Altar - Bucharest, June

Doctoral School of Finance and Banking2 Contents Introduction Models for return series  GARCH models  Mixture Density Networks Aplication and results Conclusion and further research Selective bibliography

Doctoral School of Finance and Banking3 1. Introduction Concepts of risk and volatility Objective: compare the GARCH volatility models with neural network based models for modeling conditional density

Doctoral School of Finance and Banking4 2. Models for time series returns 2.1 ARCH(p) models

Doctoral School of Finance and Banking5 2.2 GARCH (p,q) GARCH(1,1)

Doctoral School of Finance and Banking6 The unconditional variance from the GARCH (1,1) GARCH (1,1) it can be written as an infinite ARCH model :

Doctoral School of Finance and Banking7 2.3 Mixture Density Networks  Venkatamaran (1997), Zangari (1996) -used unconditional mixture densities for calculating VaR  Lockarek-Junge and Prinzler (1998) -used one neural network to model the density conditionally  Schittenkopf and Dorffner(1998, 1999) - concentrated on the performance of the of neural network based models to estimate volatility

Doctoral School of Finance and Banking8 Mixture Densities  the random variable is drawn from one out of many possible normal distributions  allows for heavy tails  preserves some convenient characteristics of a normal distribution

Doctoral School of Finance and Banking9 Neural Networks  have been used for medical diagnostics, system control, pattern recognition, nonlinear regression, and density estimation  relates a set of input variables x t t=1,…,k, to a set of one or more output variables, y t, t=1,…,k  it is composed of nodes

Doctoral School of Finance and Banking10  three common types of non-linearities used in ANNs

Doctoral School of Finance and Banking11 Multi-Layer Perceptron (MLP)  has one hidden layer The mapping performed by the MLP is given by

Doctoral School of Finance and Banking12 Mixture Density Network  combines a MLP and a mixture model  the conditional distribution of the data - expressed as a sum of normal distributions Estimation of MDN - by minimizing the negative logarithm of the likelihood function - by using backpropagation gradient descendent algorithm

Doctoral School of Finance and Banking13 RPROP algorithm  partial derivative of a weight changes its sign - the update value is decreased by a factor η -  If the derivative doesn’t change its sign - slightly increase the update value by the factor η +  0< η - <1< η +  η + =1.2  η - =0.5

Doctoral School of Finance and Banking14 3. Application and results Data used  daily closing values of the BET-C from to  Returns calculated as follows: r t = ln(P t /P t-1 )  Two data sets: - a training one - a testing one  Softwere used: Eviews, Matlab Netlab

Doctoral School of Finance and Banking15 GARCH Estimation The daily BET-C returnsHistogram of the returns series

Doctoral School of Finance and Banking16 Mean equation Dependent Variable: RETURN_BETC Method: Least Squares Sample(adjusted): Included observations: 1019 after adjusting endpoints Convergence achieved after 2 iterations VariableCoefficientStd. Errort-StatisticProb. C AR(1) R-squared Mean dependent var Adjusted R-squared S.D. dependent var S.E. of regression Akaike info criterion Sum squared resid Schwarz criterion Log likelihood F-statistic Durbin-Watson stat Prob(F-statistic) Inverted AR Roots.29

Doctoral School of Finance and Banking17 ARCH LM test for serial correlation in the residuals from the mean equation ARCH Test: F-statistic Probability Obs*R-squared Probability Test Equation: Dependent Variable: RESID^2 Method: Least Squares Sample(adjusted): Included observations: 1015 after adjusting endpoints VariableCoefficientStd. Errort-StatisticProb. C E RESID^2(-1) RESID^2(-2) RESID^2(-3) RESID^2(-4) R-squared Mean dependent var Adjusted R-squared S.D. dependent var S.E. of regression Akaike info criterion Sum squared resid Schwarz criterion Log likelihood F-statistic Durbin-Watson stat Prob(F-statistic)

Doctoral School of Finance and Banking18 Estimation of GARCH (1,1) Dependent Variable: RETURN_BETC Method: ML - ARCH Sample(adjusted): Included observations: 1019 after adjusting endpoints Convergence achieved after 23 iterations Bollerslev-Wooldrige robust standard errors & covariance CoefficientStd. Errorz-StatisticProb. RETURN_BETC(-1) Variance Equation C 4.42E E ARCH(1) GARCH(1) R-squared Mean dependent var Adjusted R-squared S.D. dependent var S.E. of regression Akaike info criterion Sum squared resid Schwarz criterion Log likelihood F-statistic Durbin-Watson stat Prob(F-statistic)

Doctoral School of Finance and Banking19 MDN Estimation  feed forward single-hidden layer neural network  4 hidden units  3 Gaussians  m-dimensional input x t-1,…,x t-m  3n dimensional output : weights, conditional mean, and conditional variance

Doctoral School of Finance and Banking20 Evaluation of the models  Normalized mean absolute error  Normalized mean squared error

Doctoral School of Finance and Banking21  Hit rate  Weighted hit rate

Doctoral School of Finance and Banking22 Results ModelNMAEHRLoss functionWHRNMSE NNLearning sample Testing sample Garch(1,1)Learning sample Test sample GARCH(1,1)

Doctoral School of Finance and Banking23 4. Conclusion and further research Recurrent neural networks The structure of the network used Trading or hedging strategies Methodoligies for measuring market risk

Doctoral School of Finance and Banking24 5. Selective bibliography Bartlmae, K. and R.A. Rauscher (2000) – Measuring DAX Market Risk: A Neural Network Volatility Mixture Approach, Bishop, W. (1994) - Mixture Density Network, Technical Report NCRG/94/004,Neural Computing Research Group, Aston University, Birmingham, February. Jordan, M. and C. Bishop (1996)– Neural Networks, in CDR Handbook of Computer Science, Tucker, A. (ed.), CRC Press, Boca Raton. Locarek-Junge, H. and R. Prinzler (1998) - Estimating Value-at-Risk Using Neural Networks, Application of Machine Learning and Data Mining in Finance, ECML’98 Workshop Notes, Chemnitz. Schittenkopf, C. and G. Dockner (1999) – Forecasting Time-dependent Conditional Densities: A Neural Network Approach, Vienna University of Economic Studies and Business Administration, Report Series no.36. (1998) – Volatility Prediction with Mixture Density Networks, Vienna University of Economic Studies and Business Administration, Report Series no.15. Venkatamaran, S. (1997) – Value at risk for a mixture of normal distributions: The use of quasi-Bayesian estimation techniques, Economic Perspectives (Federal Bank of Chicago), pp Zangari, P. (1996)- An improved methodology for measuring VaR, in RiskMetrics Monitor 2.