Multivariate Regression

Slides:



Advertisements
Similar presentations
Lecture 17: Tues., March 16 Inference for simple linear regression (Ch ) R2 statistic (Ch ) Association is not causation (Ch ) Next.
Advertisements

A. The Basic Principle We consider the multivariate extension of multiple linear regression – modeling the relationship between m responses Y 1,…,Y m and.
Lesson 10: Linear Regression and Correlation
Ridge Regression Population Characteristics and Carbon Emissions in China ( ) Q. Zhu and X. Peng (2012). “The Impacts of Population Change on Carbon.
12-1 Multiple Linear Regression Models Introduction Many applications of regression analysis involve situations in which there are more than.
Learning Objectives 1 Copyright © 2002 South-Western/Thomson Learning Data Analysis: Bivariate Correlation and Regression CHAPTER sixteen.
Ch11 Curve Fitting Dr. Deshi Ye
Objectives (BPS chapter 24)
Multivariate Regression British Butter Price and Quantities from Denmark and New Zealand I. Hilfer (1938). “Differential Effect in the Butter.
© 2010 Pearson Prentice Hall. All rights reserved Least Squares Regression Models.
Linear Regression.
CHAPTER 1 ECONOMETRICS x x x x x Econometrics Tools of: Economic theory Mathematics Statistical inference applied to Analysis of economic data.
© 2000 Prentice-Hall, Inc. Chap Multiple Regression Models.
Multiple Regression Models. The Multiple Regression Model The relationship between one dependent & two or more independent variables is a linear function.
Statistics 350 Lecture 16. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
Lesson #32 Simple Linear Regression. Regression is used to model and/or predict a variable; called the dependent variable, Y; based on one or more independent.
Basic Mathematics for Portfolio Management. Statistics Variables x, y, z Constants a, b Observations {x n, y n |n=1,…N} Mean.
Simple Linear Regression Analysis
Linear Regression – Estimating Demand Elasticities U.S. Sugar Consumption H. Schultz (1933). “A Comparison of Elasticities of Demand Obtained.
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Simple Linear Regression Analysis Chapter 13.
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
1 B IVARIATE AND MULTIPLE REGRESSION Estratto dal Cap. 8 di: “Statistics for Marketing and Consumer Research”, M. Mazzocchi, ed. SAGE, LEZIONI IN.
Business Statistics: A First Course, 5e © 2009 Prentice-Hall, Inc. Chap 12-1 Correlation and Regression.
Thomas Knotts. Engineers often: Regress data  Analysis  Fit to theory  Data reduction Use the regression of others  Antoine Equation  DIPPR.
Multiple Regression and Model Building Chapter 15 Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
Sullivan – Fundamentals of Statistics – 2 nd Edition – Chapter 4 Section 2 – Slide 1 of 20 Chapter 4 Section 2 Least-Squares Regression.
Statistics for Business and Economics 8 th Edition Chapter 11 Simple Regression Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Ch.
Simple Linear Regression (SLR)
Simple Linear Regression (OLS). Types of Correlation Positive correlationNegative correlationNo correlation.
Multiple Regression. Simple Regression in detail Y i = β o + β 1 x i + ε i Where Y => Dependent variable X => Independent variable β o => Model parameter.
Chapter Thirteen Copyright © 2006 John Wiley & Sons, Inc. Bivariate Correlation and Regression.
Environmental Modeling Basic Testing Methods - Statistics III.
I271B QUANTITATIVE METHODS Regression and Diagnostics.
Regression Analysis. 1. To comprehend the nature of correlation analysis. 2. To understand bivariate regression analysis. 3. To become aware of the coefficient.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
Regression Analysis1. 2 INTRODUCTION TO EMPIRICAL MODELS LEAST SQUARES ESTIMATION OF THE PARAMETERS PROPERTIES OF THE LEAST SQUARES ESTIMATORS AND ESTIMATION.
Differential Equations Linear Equations with Variable Coefficients.
1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 
Multiple Regression Analysis Regression analysis with two or more independent variables. Leads to an improvement.
Chapter 14 Introduction to Regression Analysis. Objectives Regression Analysis Uses of Regression Analysis Method of Least Squares Difference between.
Statistics 350 Lecture 13. Today Last Day: Some Chapter 4 and start Chapter 5 Today: Some matrix results Mid-Term Friday…..Sections ; ;
Topics, Summer 2008 Day 1. Introduction Day 2. Samples and populations Day 3. Evaluating relationships Scatterplots and correlation Day 4. Regression and.
Simple linear regression and correlation Regression analysis is the process of constructing a mathematical model or function that can be used to predict.
Lecturer: Ing. Martina Hanová, PhD.. Regression analysis Regression analysis is a tool for analyzing relationships between financial variables:  Identify.
Copyright © 2015 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education.
Bivariate Regression. Bivariate Regression analyzes the relationship between two variables. Bivariate Regression analyzes the relationship between two.
Introduction to Statistics for the Social Sciences SBS200 - Lecture Section 001, Spring 2017 Room 150 Harvill Building 9:00 - 9:50 Mondays, Wednesdays.
Multivariate Regression
Do Age, BMI, and History of Smoking play a role?
Regression.
Chapter 13 Created by Bethany Stubbe and Stephan Kogitz.
BIVARIATE REGRESSION AND CORRELATION
Chapter 12 Inference on the Least-squares Regression Line; ANOVA
LESSON 24: INFERENCES USING REGRESSION
Estimated Demand Elasticities by 2 Methods
Simple Linear Regression
Techniques for Data Analysis Event Study
Prediction of new observations
24/02/11 Tutorial 3 Inferential Statistics, Statistical Modelling & Survey Methods (BS2506) Pairach Piboonrungroj (Champ)
Model Comparison: some basic concepts
Multiple Regression Chapter 14.
Chapter 4, Regression Diagnostics Detection of Model Violation
Product moment correlation
Example on the Concept of Regression . observation
Simple Linear Regression
Multiple Regression Copyright © 2007 Pearson Education, Inc Publishing as Pearson Addison-Wesley.
Multiple Regression Berlin Chen
Correlation and Simple Linear Regression
Correlation and Simple Linear Regression
Presentation transcript:

Multivariate Regression British Butter Price and Quantities from Denmark and New Zealand 1930-1936 I. Hilfer (1938). “Differential Effect in the Butter Market,” Econometrica, Vol. 6, #3, pp.270-284

Data Time Horizon: Monthly 3/1930-10/1936 Response Variables: Y1 ≡ Price of Danish Butter (Inflation Adjusted) Y2 ≡ Price of New Zealand Butter (Inflation Adjusted) Predictor Variables: X1 ≡ Danish Imports X2 ≡ New Zealand/Australia Imports X3 ≡ All Other Imports

Multivariate Regression Model p Responses k Predictors n observations

Least Squares Estimates Note: This assumes independence across months

Butter Price Example p=2 Response Variables (Danish, NZ Prices) k=3 Predictors (Danish, NZ, Other Imports) n=80 Months of Data First and last 4 months (x0 is used for intercept term):

Butter Price Example

Testing Hypotheses Regarding b Many times we have theories to be tested regarding regression coefficients The most basic is that none of the predictors are related to any of the responses Others may be that the regression coefficients for one or more predictor(s) is same for two or more responses Others may be that the effects of two or more predictors are the same for one or more response(s) Tests can be written in the form of H0: LbM = d for specific matrices L,M,d

Matrix Set up for General Linear Tests

Three Statistics Based on H and E

Testing Relation Between Price and Quality (I)

Testing Relation Between Price and Quality (II)

Testing for a Differential Effect Hypothesis: Price of Danish and NZ Butter is equally “effected” by quantities of each type H1: Common Effects for each quantity / price, common intercepts H2: Common Effects for each quantity / price, different intercepts H3: Common Effects for quantities, different effects across prices H4: Differential Effects for quantities, common effects across prices

Matrix Forms for H1:H4

H and E Matrices Note: F.05,6,75=2.22, F.05,5,75=2.34, F.05,4,150=2.44, F.05,4,75=2.49 All 4 hypotheses are rejected