Random Series / White Noise. Notation WN (white noise) – uncorrelated iid independent and identically distributed Y t ~ iid N( ,  ) Random Series 

Slides:



Advertisements
Similar presentations
Probability models- the Normal especially.
Advertisements

COMM 472: Quantitative Analysis of Financial Decisions
Forecasting Using the Simple Linear Regression Model and Correlation
Inference for Linear Regression (C27 BVD). * If we believe two variables may have a linear relationship, we may find a linear regression line to model.
STAT 497 APPLIED TIME SERIES ANALYSIS
Chapter 13 Additional Topics in Regression Analysis
Modeling Cycles By ARMA
Data Sources The most sophisticated forecasting model will fail if it is applied to unreliable data Data should be reliable and accurate Data should be.
Additional Topics in Regression Analysis
1 Ka-fu Wong University of Hong Kong Pulling Things Together.
REGRESSION MODEL ASSUMPTIONS. The Regression Model We have hypothesized that: y =  0 +  1 x +  | | + | | So far we focused on the regression part –
Chapter Topics Types of Regression Models
ARIMA Forecasting Lecture 7 and 8 - March 14-16, 2011
Statistical Analysis SC504/HS927 Spring Term 2008 Session 7: Week 23: 7 th March 2008 Complex independent variables and regression diagnostics.
Simple Linear Regression Analysis
Standard Trend Models. Trend Curves Purposes of a Trend Curve: 1. Forecasting the long run 2. Estimating the growth rate.
Non-Seasonal Box-Jenkins Models
Linear Regression Example Data
Chapter 11: Inference for Distributions
Misspecification tests. Information criteria.
Diagnostics - Choice. Model Diagnostics 1.Explains data well –R-Squared, and adjusted R-Squared 2.Residuals follow a white noise, as specified in the.
Business Statistics - QBM117 Statistical inference for regression.
Chapter 7 Forecasting with Simple Regression
Correlation & Regression
1 Terminating Statistical Analysis By Dr. Jason Merrick.
STAT 497 LECTURE NOTES 2.
1 Least squares procedure Inference for least squares lines Simple Linear Regression.
The Examination of Residuals. The residuals are defined as the n differences : where is an observation and is the corresponding fitted value obtained.
Ch2: Probability Theory Some basics Definition of Probability Characteristics of Probability Distributions Descriptive statistics.
OPIM 303-Lecture #8 Jose M. Cruz Assistant Professor.
The Examination of Residuals. Examination of Residuals The fitting of models to data is done using an iterative approach. The first step is to fit a simple.
Chap 14-1 Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chapter 14 Additional Topics in Regression Analysis Statistics for Business.
Byron Gangnes Econ 427 lecture 3 slides. Byron Gangnes A scatterplot.
Autocorrelation in Time Series KNNL – Chapter 12.
May 2004 Prof. Himayatullah 1 Basic Econometrics Chapter 5: TWO-VARIABLE REGRESSION: Interval Estimation and Hypothesis Testing.
K. Ensor, STAT Spring 2005 Model selection/diagnostics Akaike’s Information Criterion (AIC) –A measure of fit plus a penalty term for the number.
Big Data at Home Depot KSU – Big Data Survey Course Steve Einbender Advanced Analytics Architect.
Week 21 Stochastic Process - Introduction Stochastic processes are processes that proceed randomly in time. Rather than consider fixed random variables.
Testing Regression Coefficients Prepared by: Bhakti Joshi February 06, 2012.
STAT 497 LECTURE NOTE 9 DIAGNOSTIC CHECKS 1. After identifying and estimating a time series model, the goodness-of-fit of the model and validity of the.
1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 
1 Regression Review Population Vs. Sample Regression Line Residual and Standard Error of Regression Interpretation of intercept & slope T-test, F-test.
Week 111 Review - Sum of Normal Random Variables The weighted sum of two independent normally distributed random variables has a normal distribution. Example.
Correlogram - ACF. Modeling for Forecast Forecast Data The Base Model Linear Trend Logistic Growth Others Models Look for a best approximation of the.
SAT Math Scores. Travel Time to Work In repeated sampling, the average distance between the sample means and the population mean will be about
Lecturer: Ing. Martina Hanová, PhD.. Regression analysis Regression analysis is a tool for analyzing relationships between financial variables:  Identify.
Metrics Lab Econometric Problems Lab. Import the Macro data from Excel and use first row as variable names Time set the year variable by typing “tsset.
1 Ka-fu Wong University of Hong Kong A Brief Review of Probability, Statistics, and Regression for Forecasting.
Quantitative Methods Residual Analysis Multiple Linear Regression C.W. Jackson/B. K. Gordor.
Stochastic Process - Introduction
Lecture 11: Simple Linear Regression
REGRESSION DIAGNOSTIC III: AUTOCORRELATION
Review 1. Describing variables.
Statistics for Managers using Microsoft Excel 3rd Edition
Statistics in WR: Lecture 11
Chapter 13 Simple Linear Regression
STAT 497 LECTURE NOTE 9 DIAGNOSTIC CHECKS.
Slides by JOHN LOUCKS St. Edward’s University.
Correlation and Simple Linear Regression
Test for Normal Distribution
PENGOLAHAN DAN PENYAJIAN
Correlation and Simple Linear Regression
Simple Linear Regression and Correlation
The Examination of Residuals
Chapter 13 Additional Topics in Regression Analysis
CH2 Time series.
Introductory Statistics
Correlation and Simple Linear Regression
Correlation and Simple Linear Regression
Presentation transcript:

Random Series / White Noise

Notation WN (white noise) – uncorrelated iid independent and identically distributed Y t ~ iid N( ,  ) Random Series  t ~ iid N(0,  ) White Noise 

Data Generation Independent observations at every t from the normal distribution ( ,  ) t YtYt YtYt

Identification of WN Process How to determine if data are from WN process?

Tests of Randomness - 1 Timeplot of the Data Check trend Check heteroscedasticity Check seasonality

Generating a Random Series Using Eviews Command: nrnd generates a RND N(0, 1)

Test of Randomness - 2 Correlogram

Scatterplot and Correlation Coefficient - Review Y X

Autocorrelation Coefficient Definition: The correlation coefficient between Y t and Y (t-k) is called the autocorrelation coefficient at lag k and is denoted as  k. By definition,  0 = 1. Autocorrelation of a Random Series: If the series is random,  k = 0 for k = 1,...

Process Correlogram Lag, k kk 1 

Sample Autocorrelation Coefficient Sample Autocorrelation at lag k.

Standard Error of the Sample Autocorrelation Coefficient Standard Error of the sample autocorrelation if the Series is Random.

Z- Test of H 0 :  k = 0 Reject H 0 if Z 1.96

Box-Ljung Q Statistic Definition

Sampling Distribution of Q BL (m) | H 0 H 0 :  1 =  2 =…  k = 0 Q BL (m) | H 0 follows a  2 (DF=m) distribution Reject H 0 if Q BL >  2 (95%tile)

Test of Normality - 1 Graphical Test Normal Probability Plot of the Data Check the shape: straight, convex, S-shaped

Construction of a Normal Probability Plot Alternative estimates of the cumulative relative frequency of an observation –p i = (i - 0.5)/ n –p i = i / (n+1) –p i = (i ) / (n+0.25) Estimate of the percentile | Normal –Standardized Q(p i ) = NORMSINV(p i ) –Q(p i ) = NORMINV(p i, mean, stand. dev.)

Non-Normal Populations Flat Skewed Expected | Normal Data Expected | Normal Data

Test of Normality - 2 Test Statistics Stand. Dev. Skewness Kurtosis

The Jarque-Bera Test If the population is normal and the data are random, then: follows approximately  with the # 0f degrees of freedom 2. Reject H 0 if JB > 6

Forecasting Random Series Given the data Y1,...,Yn, the one step ahead forecast Y(n+1) is: or Approx.

Forecasting a Random Series If it is determined that Y t is RND N( ,  ) a) The best point forecast of Y t = E(Y t ) =  b) A 95% interval forecast of Y t = (  – 1.96 ,   ) for all t (one important long run implication of a stationary series.)

The Sampling Distribution of the von-Neumann Ratio The vN Ratio | H0 follows an approximate normal with: Expected Value of v: E(v) = 2 Standard Error of v:

Appendix: The von Neumann Ratio Definition: The non Neumann Ratio of the regression residual is the Durbin - Watson Statistic