Linear Regression A method of calculating a linear equation for the relationship between two or more variables using multiple data points.

Slides:



Advertisements
Similar presentations
Chapter 4: Basic Estimation Techniques
Advertisements

Managerial Economics in a Global Economy
Regression Analysis Module 3. Regression Regression is the attempt to explain the variation in a dependent variable using the variation in independent.
 Coefficient of Determination Section 4.3 Alan Craig
Regression Analysis Once a linear relationship is defined, the independent variable can be used to forecast the dependent variable. Y ^ = bo + bX bo is.
Simple Regression Model
1 Multiple Regression A single numerical response variable, Y. Multiple numerical explanatory variables, X 1, X 2,…, X k.
Objectives (BPS chapter 24)
Regression Analysis Using Excel. Econometrics Econometrics is simply the statistical analysis of economic phenomena Here, we just summarize some of the.
Chapter 13 Multiple Regression
The Multiple Regression Model Prepared by Vera Tabakova, East Carolina University.
Chapter 12 Multiple Regression
Chapter 3 homework Numbers 6, 7, 12 Review session: Monday 6:30-7:30 Thomas 324.
Chapter 4: Demand Estimation The estimation of a demand function using econometric techniques involves the following steps Identification of the variables.
Probability & Statistics for Engineers & Scientists, by Walpole, Myers, Myers & Ye ~ Chapter 11 Notes Class notes for ISE 201 San Jose State University.
Statistics 303 Chapter 10 Least Squares Regression Analysis.
THE IDENTIFICATION PROBLEM
Ch. 14: The Multiple Regression Model building
Managerial Economics & Business Strategy Chapter 3 Quantitative Demand Analysis.
Simple Linear Regression Analysis
Multiple Linear Regression Analysis
Quantitative Demand Analysis
Correlation and Linear Regression
9 - 1 Intrinsically Linear Regression Chapter Introduction In Chapter 7 we discussed some deviations from the assumptions of the regression model.
Introduction to Linear Regression and Correlation Analysis
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
Inference for regression - Simple linear regression
Chapter 11 Simple Regression
Chapter 5 Estimating Demand Functions
Correlation and Linear Regression
Statistics for Business and Economics 8 th Edition Chapter 11 Simple Regression Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Ch.
5.1 Basic Estimation Techniques  The relationships we theoretically develop in the text can be estimated statistically using regression analysis,  Regression.
OPIM 303-Lecture #8 Jose M. Cruz Assistant Professor.
Managerial Economics Demand Estimation. Scatter Diagram Regression Analysis.
Section 5.2: Linear Regression: Fitting a Line to Bivariate Data.
Multiple regression - Inference for multiple regression - A case study IPS chapters 11.1 and 11.2 © 2006 W.H. Freeman and Company.
Ch4 Describing Relationships Between Variables. Section 4.1: Fitting a Line by Least Squares Often we want to fit a straight line to data. For example.
Regression. Population Covariance and Correlation.
Sullivan – Fundamentals of Statistics – 2 nd Edition – Chapter 4 Section 2 – Slide 1 of 20 Chapter 4 Section 2 Least-Squares Regression.
10B11PD311 Economics REGRESSION ANALYSIS. 10B11PD311 Economics Regression Techniques and Demand Estimation Some important questions before a firm are.
Simple Linear Regression. The term linear regression implies that  Y|x is linearly related to x by the population regression equation  Y|x =  +  x.
Discussion of time series and panel models
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 13-1 Introduction to Regression Analysis Regression analysis is used.
STA 286 week 131 Inference for the Regression Coefficient Recall, b 0 and b 1 are the estimates of the slope β 1 and intercept β 0 of population regression.
STA291 Statistical Methods Lecture LINEar Association o r measures “closeness” of data to the “best” line. What line is that? And best in what terms.
Statistics for Business and Economics 8 th Edition Chapter 11 Simple Regression Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Ch.
Multiple Regression. Simple Regression in detail Y i = β o + β 1 x i + ε i Where Y => Dependent variable X => Independent variable β o => Model parameter.
© 2001 Prentice-Hall, Inc.Chap 13-1 BA 201 Lecture 18 Introduction to Simple Linear Regression (Data)Data.
LESSON 6: REGRESSION 2/21/12 EDUC 502: Introduction to Statistics.
Lesson 14 - R Chapter 14 Review. Objectives Summarize the chapter Define the vocabulary used Complete all objectives Successfully answer any of the review.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
1 Simple Linear Regression and Correlation Least Squares Method The Model Estimating the Coefficients EXAMPLE 1: USED CAR SALES.
Introduction to Multiple Regression Lecture 11. The Multiple Regression Model Idea: Examine the linear relationship between 1 dependent (Y) & 2 or more.
Regression Analysis Deterministic model No chance of an error in calculating y for a given x Probabilistic model chance of an error First order linear.
Regression Modeling Applications in Land use and Transport.
Chapters 8 Linear Regression. Correlation and Regression Correlation = linear relationship between two variables. Summarize relationship with line. Called.
Chapter 14 Introduction to Regression Analysis. Objectives Regression Analysis Uses of Regression Analysis Method of Least Squares Difference between.
Bivariate Regression. Bivariate Regression analyzes the relationship between two variables. Bivariate Regression analyzes the relationship between two.
Copyright © 2010 by the McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Managerial Economics & Business Strategy Chapter 3 Quantitative.
Chapter 4: Basic Estimation Techniques
Chapter 4 Basic Estimation Techniques
Regression Analysis AGEC 784.
3.1 Examples of Demand Functions
Multiple Regression.
S519: Evaluation of Information Systems
CHAPTER 29: Multiple Regression*
Introduction to Regression
Correlation and Simple Linear Regression
Correlation and Simple Linear Regression
Presentation transcript:

Linear Regression A method of calculating a linear equation for the relationship between two or more variables using multiple data points.

Linear Regression General form: Y = a + bX + e “Y” is the dependent variable “X” is the explanatory variable “a” is the intercept parameter “b” is the slope parameter “e” is an error term or residual

Regression Results Y and X come from data A computer program calculates estimates of a and b e is the difference between a + bX and the actual value of Y corresponding to X OLS estimates of a and b minimize the sum of the squared residuals ∑e 2 “OLS” is Ordinary Least Squares

The Regression Line and the Residual

Electricity Demand Example Data for residential customers in U. S. states Y is millions of kilo-watt-hours sold X is population Other data include per capita income, price of electricity (cents/kwh) and price of natural gas

Variable Means 2004

Variable Means 2012

Excel Regression: Milkwh

Actual vs. Predicted Milkwh

Useful Statistics and Tests t-statistic: is estimated coefficient significantly different from zero? Coefficient of determination or R-square: % variation explained F-statistic: statistical significance of the entire regression equation; OR is the R- square significantly different from zero? Find these on the Excel regression output.

Confidence and Significance Levels 99% Confidence = 1% Significance P-value of 0.01 or less 95% Confidence = 5% Significance P-value of 0.05 or less 90% Confidence = 10% Significance P-value of 0.10 or less Smaller Significance Levels Are Better Find P-values for t and F statistics on Excel regression output

Multiple & Nonlinear Regression Multiple Regression Y= a + bX + cW + dZ Nonlinear Regression Quadratic: Y = a + bX + cX 2 Log-Linear: Y = aX b Z c Or Ln Y = (ln a) + b(ln X) + c(ln Z)

Multiple Regression: Milkwh

Quadratic Regression: Milkwh

Log Linear Regression: LnMilkwh

Demand Regression Project DATA: ElecDemandData2012.xls under Project Materials on D2L 1. Using the data file above, run a linear regression of Dependent Variable: Milkwh Explanatory Variables: Pop, Pkwh, PGas, Income. Which coefficients (including the constant) are statistically significant at the 10% level or better? Which are not significant? How much of the variation in the dependent variable is explained by the estimated equation? Is the equation as a whole statistically significant? At what level?

Finding the Marginal Revenue Equation: Overview Evaluate estimated demand at means of all explanatory variables except price Calculate average effect of non-price variables to get demand equation in this form Q = A - b(P) Rearrange to find Inverse Demand equation P = (A/b) - (1/b)Q MR has twice the slope of inverse demand MR = (A/b) – (2/b)Q The end result is an equation, not a number

Finding the Marginal Revenue Equation: Example Write your regression equation in this form Milkwh = 11,000 – 3600Pkwh Pop PGas 11,000 is the intercept or constant coefficient -3600, , and 2150 are estimated coefficients These are made-up numbers for this example Use the mean values of the non-electricity-price variables Pop=5,756,577 PGas=11.4 Substitute into your regression equation and simplify Milkwh = 11,000 – 3600Pkwh (5,756,577) (11.4) Milkwh= [11, , ,510] – 3600(Pkwh) Milkwh = 59, – 3600(Pkwh) This is Q = A – bP from the previous slide

Finding Marginal Revenue Example, Continued Milkwh = 59, – 3600(Pkwh) From end of previous slide Rearrange to find Inverse Demand P = (A/b) - (1/b)Q = (A – Q)/b Pkwh = (59, – Milkwh)/(3600) Pkwh = – (Milkwh) This is the inverse demand equation Marginal Revenue has twice the slope MR = – (Milkwh)