MODELLING SPOT PRICE OF ELECTRICITY IN NSW 2005 - 2008 Hilary Green with Nino Kordzakhia and Ruben Thoplan 15th International Conference Computing in Economics.

Slides:



Advertisements
Similar presentations
Statistical Time Series Analysis version 2
Advertisements

Introduction to modelling extremes
Introduction to modelling extremes Marian Scott (with thanks to Clive Anderson, Trevor Hoey) NERC August 2009.
Time Series Analysis -- An Introduction -- AMS 586 Week 2: 2/4,6/2014.
STEPS A Stochastic Top-down Electricity Price Simulator Martin Peat.
DSCI 5340: Predictive Modeling and Business Forecasting Spring 2013 – Dr. Nick Evangelopoulos Exam 1 review: Quizzes 1-6.
BLM Trip Limits Revisited May 28, 2004 Peter Kasper.
Descriptive statistics using Excel
A.M. Alonso, C. García-Martos, J. Rodríguez, M. J. Sánchez Seasonal dynamic factor model and bootstrap inference: Application to electricity market forecasting.
Part II – TIME SERIES ANALYSIS C5 ARIMA (Box-Jenkins) Models
Time Series Building 1. Model Identification
Continuous Probability Distributions.  Experiments can lead to continuous responses i.e. values that do not have to be whole numbers. For example: height.
Introduction Data and simula- tion methodology VaR models and estimation results Estimation perfor- mance analysis Conclusions Appendix Doctoral School.
How should these data be modelled?. Identification step: Look at the SAC and SPAC Looks like an AR(1)- process. (Spikes are clearly decreasing in SAC.
Business Forecasting Chapter 10 The Box–Jenkins Method of Forecasting.
Tutorial for solution of Assignment week 40 “Forecasting monthly values of Consumer Price Index Data set: Swedish Consumer Price Index” sparetime.
The Garch model and their Applications to the VaR
13 Introduction toTime-Series Analysis. What is in this Chapter? This chapter discusses –the basic time-series models: autoregressive (AR) and moving.
Forecasting JY Le Boudec 1. Contents 1.What is forecasting ? 2.Linear Regression 3.Avoiding Overfitting 4.Differencing 5.ARMA models 6.Sparse ARMA models.
Dr. Yukun Bao School of Management, HUST Business Forecasting: Experiments and Case Studies.
Time series analysis - lecture 2 A general forecasting principle Set up probability models for which we can derive analytical expressions for and estimate.
Data Sources The most sophisticated forecasting model will fail if it is applied to unreliable data Data should be reliable and accurate Data should be.
Introduction to Financial Time Series From Ruey. S. Tsay’s slides.
Bootstrap in Finance Esther Ruiz and Maria Rosa Nieto (A. Rodríguez, J. Romo and L. Pascual) Department of Statistics UNIVERSIDAD CARLOS III DE MADRID.
HDD and CDD Option Pricing with Market Price of Weather Risk for Taiwan Hung-Hsi Huang Yung-Ming Shiu Pei-Syun Lin The Journal of Futures Markets Vol.
The generalized Additive Nonparametric GARCH Model --With application to the Chinese stock market Ai Jun Hou Department of Economics School of Economics.
ARIMA Forecasting Lecture 7 and 8 - March 14-16, 2011
1 Econometric Load Forecasting Peak and Energy Forecast 06/14/2005 Econometric Load Forecasting Peak and Energy Forecast 06/14/2005.
Market Risk VaR: Historical Simulation Approach
AGEC 622 Mission is prepare you for a job in business Have you ever made a price forecast? How much confidence did you place on your forecast? Was it correct?
Measuring market risk:
BOX JENKINS METHODOLOGY
Traffic modeling and Prediction ----Linear Models
AR- MA- och ARMA-.
B AD 6243: Applied Univariate Statistics Understanding Data and Data Distributions Professor Laku Chidambaram Price College of Business University of Oklahoma.
TIME SERIES by H.V.S. DE SILVA DEPARTMENT OF MATHEMATICS
PROBABILITY & STATISTICAL INFERENCE LECTURE 3 MSc in Computing (Data Analytics)
© Copyright McGraw-Hill CHAPTER 3 Data Description.
Tutorial for solution of Assignment week 39 “A. Time series without seasonal variation Use the data in the file 'dollar.txt'. “
It’s About Time Mark Otto U. S. Fish and Wildlife Service.
John G. Zhang, Ph.D. Harper College
Analysis of day-ahead electricity data Zita Marossy & Márk Szenes (ColBud) MANMADE workshop January 21, 2008.
Bangladesh Short term Discharge Forecasting time series forecasting Tom Hopson A project supported by USAID.
Introduction to Time Series Analysis
Big Data at Home Depot KSU – Big Data Survey Course Steve Einbender Advanced Analytics Architect.
ANALYSING AND COMPARING ELECTRICITY SPOT PRICES MSc. Student: HACA (GHICA) Andreea Valentina Supervisor: Professor MOISA ALTAR 2007.
STAT 497 LECTURE NOTE 9 DIAGNOSTIC CHECKS 1. After identifying and estimating a time series model, the goodness-of-fit of the model and validity of the.
MULTIVARIATE TIME SERIES & FORECASTING 1. 2 : autocovariance function of the individual time series.
Statistics 349.3(02) Analysis of Time Series. Course Information 1.Instructor: W. H. Laverty 235 McLean Hall Tel:
The Box-Jenkins (ARIMA) Methodology
Cycle Detection and Removal in Electricity Markets “Lunch at Lab” Presentation Matt Lyle Department of mathematics&statistics University of Calgary, Alberta.
1 Randomly Modulated Periodic Signals Melvin J. Hinich Applied Research Laboratories University of Texas at Austin
Chap 5-1 Chapter 5 Discrete Random Variables and Probability Distributions Statistics for Business and Economics 6 th Edition.
Time Series Analysis PART II. Econometric Forecasting Forecasting is an important part of econometric analysis, for some people probably the most important.
Econometric methods of analysis and forecasting of financial markets Lecture 3. Time series modeling and forecasting.
1 Lecture Plan Modelling Profit Distribution from Wind Production (Excel Case: Danish Wind Production and Spot Prices) Reasons for copula.
Forecasting. Model with indicator variables The choice of a forecasting technique depends on the components identified in the time series. The techniques.
Lecture 9 Forecasting. Introduction to Forecasting * * * * * * * * o o o o o o o o Model 1Model 2 Which model performs better? There are many forecasting.
The Exponential and Gamma Distributions
Bangladesh Short term Discharge Forecasting
Chapter 6: Autoregressive Integrated Moving Average (ARIMA) Models
CHAPTER 3 Data Description 9/17/2018 Kasturiarachi.
Market Risk VaR: Historical Simulation Approach
Probability & Statistics Probability Theory Mathematical Probability Models Event Relationships Distributions of Random Variables Continuous Random.
A Weighted Moving Average Process for Forecasting “Economics and Environment” By Chris P. Tsokos.
Chapter 8 Supplement Forecasting.
FORECASTING VOLATILITY I
BOX JENKINS (ARIMA) METHODOLOGY
Chap 7: Seasonal ARIMA Models
Presentation transcript:

MODELLING SPOT PRICE OF ELECTRICITY IN NSW Hilary Green with Nino Kordzakhia and Ruben Thoplan 15th International Conference Computing in Economics and Finance University of Technology, Sydney, Australia University of Technology, Sydney, Australia Wednesday 15 July, 2009

Data NEMCCO (managed the Australian National Electricity Market until July )  AEMO  Half Hourly data for year 2005 to 2008 (NSW only)  Daily averages for year 2005 to 2008

Volatility Mean Reversion SeasonalitySpike

Characteristics of Spot Price 1. Seasonality 2. Mean Reversion 3. Volatility 4. Spikes 5. Residuals Statistical Model

Previous work

Spot Price differs by Month, Day and Time of day Lower Prices on public holidays and weekends. Highest prices in June Highest prices between 5:30 pm and 7:30 pm

Highest Mean Prices Lowest Volatility

Methods 1. Obtain a seasonal model 2. Identify spikes in de-seasonalised data 3. Fit an exponential decay function to spikes 4. Time series analysis on residuals from step 3 5. Distribution of final residuals

Seasonal Analysis (Mon – Thurs) Table 1: Periodogram Results arranged by Intensity IntensityFrequencyPeriodYearsCycles year cycle 1⅓ year cycle 1, 2 year cycle

Seasonal Analysis r 2 = 0.46

De-seasonalised Data Identify spike threshold

Fitting spikes Cluster 1 Cluster k 11 kk 11 kk

Fit the spikes is the time of occurrence of max spike in cluster k is the size of the maximum spike in cluster k, generalised pareto fits

Residuals remain autocorrelated

Time series analysis An autoregressive moving model fitted to the twice differenced Post Poisson residuals. An autoregressive moving model fitted to the twice differenced Post Poisson residuals.  ARIMA(2,2,6) Ljung Box test results confirms appropriate model Ljung Box test results confirms appropriate model

ARIMA(2,2,6) Discrete-time IDPOLY model: A(q)y(t) = C(q)e(t) A(q) = q q -2 C(q) = q q q q q q q q -6 Estimated using ARMAX from twice differenced residuals (Sampling interval: 1) Loss function and FPE

Ljung Box test results of residuals from ARIMA(2,2,6) Ljung Box test results of residuals from ARIMA(2,2,6) LagFitp-valQ_StatCV 1No y y y y y y y y y y y y y y y y y y y y y y y y y y y y y

Residual Analysis after ARIMA

Final residuals are not normally distributed not normally distributed long tailed long tailed General hyperbolic distributions invariant to summation invariant to summation invariant to rescaling invariant to rescaling bell shaped bell shaped long tailed long tailed allow skewness allow skewness popular in financial modelling popular in financial modelling -> Normal Inverse Gaussian Distribution (NIG)

Normal Inverse Gaussian Distribution (NIG) The normal inverse Gaussian distribution is defined as a variance-mean mixture of a normal distribution with the Inverse Gaussian (IG) as the mixing distribution. X ~ NIG(α,β,μ,δ) if it has the following pdf: X ~ NIG(α,β,μ,δ) if it has the following pdf: μ μ : centre β, α β, α : skewness, kurtosis δ δ : scale K 1 is the modified Bessel function of third order and index 1.

Examples: Normal Inverse Gaussian Distribution

Distribution of Final Residuals (Mon-Thurs fit)

The rest of the time

Fridays, Weekends and Public Holidays Cycles r 2 = 0.44

De-seasonalised Holiday Data

From holiday data

Final residuals are long tailed again

NIG fits the residuals from the ARMA model

Summary Used a complex process to model the various components of the Spot Price of electricity for two different weekday behaviour patterns

Future Research Forecasting Forecasting Constant lambda smoothing down parameter Constant lambda smoothing down parameter Poisson intensity  time dependent Poisson intensity  time dependent Include load into the model Include load into the model Pricing of Futures Pricing of Futures Descriptive models not useful Descriptive models not useful Aim to use reduced exp(AR(1)) model with filtered Poisson component to fit to Futures prices. Aim to use reduced exp(AR(1)) model with filtered Poisson component to fit to Futures prices.  futures pricing tool

References [1] Julio J.Lucia and Eduardo S.Schwartz, Electricity Prices and Power Derivatives: Evidence from the Nordic Power Exchange, (2002) [2] Peter Brockwell and Richard Davis, Introduction to Time Series and Forecasting, (Springer, 2002) [3] M.Burger, B.Klar, A.Muller and G. Schindlmayr, A spot market model for pricing derivatives in electricity markets, (2003) [4] H.Geman and A.Roncoroni, Understanding the Fine Structure of ElectricityPrices, (2006) [5] Jan Seifert and Marliese Uhrig-Homburg, Modelling jumps in electricity prices:theory and empirical evidence, (2007) [6] T.Meyer-Brandis and P.Tankov, Multi-factor jump-diusion models of electricity prices, (2008) [7] Thorsten Schmidt, Modelling Energy Markets with Extreme Values in Mathematical Control Theory and Finance, ed Sarychev A. et al., (Springer,2008)